-- Logs begin at Tue 2022-08-23 21:25:30 UTC, end at Tue 2022-08-23 22:44:05 UTC. -- Aug 23 22:11:23.876965 dv-cinder-850321-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 23 22:11:23.890215 dv-cinder-850321-4-smb devstack@keystone.service[81739]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 23 22:11:23.893103 dv-cinder-850321-4-smb devstack@keystone.service[81739]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 23 22:11:23 2022] *** Aug 23 22:11:23.893103 dv-cinder-850321-4-smb devstack@keystone.service[81739]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 23 22:11:23.893103 dv-cinder-850321-4-smb devstack@keystone.service[81739]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 23 22:11:23.893103 dv-cinder-850321-4-smb devstack@keystone.service[81739]: nodename: dv-cinder-850321-4-smb Aug 23 22:11:23.893103 dv-cinder-850321-4-smb devstack@keystone.service[81739]: machine: x86_64 Aug 23 22:11:23.893103 dv-cinder-850321-4-smb devstack@keystone.service[81739]: clock source: unix Aug 23 22:11:23.893103 dv-cinder-850321-4-smb devstack@keystone.service[81739]: pcre jit disabled Aug 23 22:11:23.893103 dv-cinder-850321-4-smb devstack@keystone.service[81739]: detected number of CPU cores: 4 Aug 23 22:11:23.893103 dv-cinder-850321-4-smb devstack@keystone.service[81739]: current working directory: / Aug 23 22:11:23.893103 dv-cinder-850321-4-smb devstack@keystone.service[81739]: detected binary path: /usr/bin/uwsgi-core Aug 23 22:11:23.893103 dv-cinder-850321-4-smb devstack@keystone.service[81739]: your processes number limit is 47680 Aug 23 22:11:23.893103 dv-cinder-850321-4-smb devstack@keystone.service[81739]: your memory page size is 4096 bytes Aug 23 22:11:23.893927 dv-cinder-850321-4-smb devstack@keystone.service[81739]: detected max file descriptor number: 2048 Aug 23 22:11:23.893927 dv-cinder-850321-4-smb devstack@keystone.service[81739]: lock engine: pthread robust mutexes Aug 23 22:11:23.893927 dv-cinder-850321-4-smb devstack@keystone.service[81739]: thunder lock: enabled Aug 23 22:11:23.893927 dv-cinder-850321-4-smb devstack@keystone.service[81739]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 23 22:11:23.893927 dv-cinder-850321-4-smb devstack@keystone.service[81739]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 23 22:11:23.938248 dv-cinder-850321-4-smb devstack@keystone.service[81739]: Python main interpreter initialized at 0x55e39e6d99c0 Aug 23 22:11:23.938248 dv-cinder-850321-4-smb devstack@keystone.service[81739]: python threads support enabled Aug 23 22:11:23.938248 dv-cinder-850321-4-smb devstack@keystone.service[81739]: your server socket listen backlog is limited to 100 connections Aug 23 22:11:23.938248 dv-cinder-850321-4-smb devstack@keystone.service[81739]: your mercy for graceful operations on workers is 90 seconds Aug 23 22:11:23.938908 dv-cinder-850321-4-smb devstack@keystone.service[81739]: mapped 403077 bytes (393 KB) for 2 cores Aug 23 22:11:23.938908 dv-cinder-850321-4-smb devstack@keystone.service[81739]: *** Operational MODE: preforking *** Aug 23 22:11:23.939169 dv-cinder-850321-4-smb devstack@keystone.service[81739]: *** uWSGI is running in multiple interpreter mode *** Aug 23 22:11:23.939169 dv-cinder-850321-4-smb devstack@keystone.service[81739]: spawned uWSGI master process (pid: 81739) Aug 23 22:11:23.939464 dv-cinder-850321-4-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 23 22:11:23.941229 dv-cinder-850321-4-smb devstack@keystone.service[81739]: spawned uWSGI worker 1 (pid: 81751, cores: 1) Aug 23 22:11:23.941229 dv-cinder-850321-4-smb devstack@keystone.service[81739]: spawned uWSGI worker 2 (pid: 81752, cores: 1) Aug 23 22:11:23.941229 dv-cinder-850321-4-smb devstack@keystone.service[81739]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 23 22:11:28.603517 dv-cinder-850321-4-smb devstack@keystone.service[81752]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 22:11:28.603517 dv-cinder-850321-4-smb devstack@keystone.service[81752]: from cryptography.utils import int_from_bytes Aug 23 22:11:28.604321 dv-cinder-850321-4-smb devstack@keystone.service[81752]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 22:11:28.604321 dv-cinder-850321-4-smb devstack@keystone.service[81752]: from cryptography.utils import int_from_bytes Aug 23 22:11:28.614462 dv-cinder-850321-4-smb devstack@keystone.service[81751]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 22:11:28.614462 dv-cinder-850321-4-smb devstack@keystone.service[81751]: from cryptography.utils import int_from_bytes Aug 23 22:11:28.615303 dv-cinder-850321-4-smb devstack@keystone.service[81751]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 22:11:28.615303 dv-cinder-850321-4-smb devstack@keystone.service[81751]: from cryptography.utils import int_from_bytes Aug 23 22:11:28.663062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 22:11:28.663301 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 22:11:28.663571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] command line args: [] {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 22:11:28.663937 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 22:11:28.664203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ================================================================================ {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 22:11:28.664616 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] admin_token = **** {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.665004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] config_dir = [] {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.665323 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.665599 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] config_source = [] {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.665879 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] debug = True {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.666188 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.667376 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.667376 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.667537 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.667928 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.668368 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] list_limit = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.668668 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] log_config_append = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.668950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.669229 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] log_dir = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.669564 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] log_file = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.669953 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.670343 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.670673 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.670999 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.671261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.671552 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.671949 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.672346 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.672726 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.673092 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.673486 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.673874 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.674344 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.674823 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.675324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.675881 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.77/identity {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.676139 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] publish_errors = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.676449 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.676756 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.676999 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.677320 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.677654 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.677841 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 22:11:28.678018 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] standard_threads = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.678133 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 22:11:28.678280 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] command line args: [] {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 22:11:28.678398 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.678661 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 22:11:28.678818 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.678952 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ================================================================================ {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 22:11:28.679080 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] admin_token = **** {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.679167 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.679334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] config_dir = [] {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.679423 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] use_journal = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.679549 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.679633 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] use_json = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.679756 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] config_source = [] {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.679873 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] debug = True {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.679959 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] use_stderr = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.680077 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.680181 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] use_syslog = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.680321 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.680670 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.680781 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.680863 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.680989 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.681065 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.681221 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] list_limit = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.681307 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.681485 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] log_config_append = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.681599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.681709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.681796 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] log_dir = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.681951 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] log_file = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.682076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.682204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.682436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.682571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.682695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.682845 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.682970 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.683130 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.683254 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.683339 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.683499 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.683593 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.683749 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.683981 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.684076 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.684324 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.684519 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.684726 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.684809 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.685582 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.685664 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.685724 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.685955 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.686140 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.686413 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.686858 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.687218 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.687302 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.77/identity {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.687581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] publish_errors = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.687783 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.687946 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.688040 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.688115 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.688293 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.688372 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.688549 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.688787 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.688865 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.689028 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] standard_threads = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.689207 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.689287 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.689595 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.689705 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.689826 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.690034 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] use_journal = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.690176 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.690253 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] use_json = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.690427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] use_stderr = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.690591 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.690669 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] use_syslog = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.690833 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:11:28.691023 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.691101 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.691330 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.691414 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.691600 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.691792 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.691872 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.692091 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.692168 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.692337 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.692524 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.692683 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.692823 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.692970 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.693079 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.693316 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.693435 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.693613 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.693730 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.693876 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.694098 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.694176 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.694444 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.694558 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.694846 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.694989 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.695239 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.695356 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.695601 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.695690 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.695911 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.695989 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.696317 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.696405 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.696671 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.696758 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.697037 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.697119 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.697304 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.697418 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.697633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.697912 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.698007 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.698093 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.698408 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.698503 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.698573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.698729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.698881 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.698988 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.699232 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.699309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.699495 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.699624 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.699753 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.699994 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.700071 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.700553 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.701250 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.701333 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.701447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.701508 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.701565 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.701622 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.701934 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.702041 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.702143 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.702238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.703457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.706195 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.706306 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.706377 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.706530 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.706631 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.706694 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.706754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.706934 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.706934 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.707065 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.707125 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.707187 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.707247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.707394 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.707502 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.707564 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.707622 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.707680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.707772 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.708869 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.709004 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.709109 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.709217 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.709319 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.709474 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.709611 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.709611 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.709740 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.709800 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.709969 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.710043 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.710115 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.710115 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.710266 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.710266 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.710456 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.710521 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.710613 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.710737 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.710855 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.710970 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.711085 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.711223 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.711364 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.711515 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.711651 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.711786 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.711926 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.712059 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.712208 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.712360 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.712497 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.712615 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.712797 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.712932 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.713074 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.713222 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.713454 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.713602 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.713736 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.713872 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.713985 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.714125 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.714268 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.714412 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.714544 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.714675 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.714805 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.714954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.715090 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.715201 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.715273 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.715334 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.715334 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.715449 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.715523 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.715655 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.715787 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.715905 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.716032 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.716687 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.716818 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.716941 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.717044 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.717147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.717248 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.717495 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.717576 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.717638 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.717820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.717915 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.717993 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.718075 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.718159 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.718246 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.718321 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.718382 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.718442 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.718501 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.718559 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.718627 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.718701 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.718852 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.718967 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] auth.external = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.719041 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.719111 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.719248 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.719408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.719487 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.719487 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.719618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.719686 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.719748 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] auth.password = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.719813 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.719874 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] auth.token = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.719932 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.719932 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.720051 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.720112 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.720170 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.720170 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.720300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.720370 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.720432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.720491 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.720558 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.720619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.720678 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.720742 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.720808 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] auth.external = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.720873 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] credential.caching = True {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.720946 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.721014 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.721074 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.721141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.721203 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.721262 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.721330 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] auth.password = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.721411 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.721474 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] auth.token = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.721534 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.721593 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.721651 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.721724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.721793 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.721855 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.721921 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.722100 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.722184 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.722343 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.722463 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.722591 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.722679 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.722937 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.723021 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.723194 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] credential.caching = True {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.723284 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.723452 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.723533 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.723710 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.723923 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.724012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.724174 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] federation.caching = True {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.724261 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.724437 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.724515 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.724679 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.724767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.724961 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.725041 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.725224 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.725355 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.725482 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.725643 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.725746 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.725894 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.726044 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.726160 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.726299 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.726434 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.726571 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.726702 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.726822 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.726961 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.727115 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.727324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.727405 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] federation.caching = True {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.727593 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] identity.caching = True {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.727680 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.727867 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.728046 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.728169 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.728252 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.728417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.728542 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.728663 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.728842 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.728960 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.729066 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.729243 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.729467 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.729568 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.729715 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.729781 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.729906 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.730007 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.730152 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.730249 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.730461 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.730645 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.730759 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] identity.caching = True {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.730841 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.731042 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.731185 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.731339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.731422 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.731580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.731719 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.732474 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.732589 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.732707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.732809 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.732908 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.733130 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.733243 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.733428 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.733578 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.733736 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.733844 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.733979 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.734086 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.734219 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.734347 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.734526 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.734631 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.734772 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.735026 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.735132 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.735277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.735578 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.735707 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.735943 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.736045 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.736144 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.736258 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.736417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.736536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.736712 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.736907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.737014 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.737190 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.737460 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.737601 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.737712 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.737931 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.738039 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.738174 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.738392 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.738588 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.738844 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.738950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.739091 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.739309 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.740023 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.740023 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.740140 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.740200 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.740200 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.740332 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.740396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.740531 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.740674 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.740763 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.741009 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.741129 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.741250 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.741398 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.741525 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.user = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.741653 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.741797 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.741935 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.742074 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.742177 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.742241 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.742469 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.742723 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.742964 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.743050 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.743230 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.743482 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.743573 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.743728 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.743973 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.744219 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.744299 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.744483 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.744742 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.744961 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.745046 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.745239 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.745526 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.745611 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.745796 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.746035 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.746209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.746289 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.746524 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.746760 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.746890 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.747047 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.747293 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.747484 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.747566 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.747949 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.748048 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.748395 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.748477 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.748755 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.748886 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.749002 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.749259 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.749461 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.749599 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.749767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.749901 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.750014 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.750271 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.750369 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.750522 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.750764 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.750843 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.751011 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.751263 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.751364 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] resource.caching = True {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.751523 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.751721 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.751803 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.752011 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.752196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.752282 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.752517 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.752760 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.752891 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.753016 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.753263 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.753404 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.753534 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.753781 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] role.caching = True {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.754075 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] role.driver = sql {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.754340 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.754442 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.user = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.754593 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.754850 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.755103 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.755196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.755389 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.755641 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.755724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.755896 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.756103 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.756191 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.756391 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.756599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.756681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.756872 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.757126 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.757287 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.757382 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.757646 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.757728 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.758007 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.758085 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.758358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.758444 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.758587 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.758844 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.758924 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.759100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.759358 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.759467 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.759675 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.759801 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.759883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.760086 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.760255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.760346 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.760558 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.760796 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.761033 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.761253 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.761337 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.761595 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.761816 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.762107 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.762204 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.762280 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.762560 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.762644 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.762890 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] token.caching = True {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.763149 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.763541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.763637 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.764208 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.764341 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.764428 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.764502 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.764653 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.764741 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.764863 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.765118 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.765200 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.765393 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.765787 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.766008 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.766142 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.766245 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.766323 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.766411 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.766487 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.766600 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.766856 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.766991 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.767098 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.767350 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.767429 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.767664 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.767893 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.767982 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] database.connection = **** {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.768174 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.768431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.768526 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.768673 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.768920 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.769172 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.769294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.769482 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.769731 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.769810 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.769976 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.770139 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.770226 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.770843 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.770975 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.771077 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.771077 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.771264 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.771373 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.771475 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.771574 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.771672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.771877 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.771984 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.772124 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.772348 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.772457 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.772557 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 22:11:28.772810 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.773295 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] resource.caching = True {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.773830 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.774314 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.774778 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.775260 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.775747 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.776020 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.776292 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.776754 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.777218 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.777789 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] role.caching = True {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.778593 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] role.driver = sql {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.779679 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.780586 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.781149 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.782053 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.782541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.782865 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.783334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.783820 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.784292 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.784761 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.785256 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.785792 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.786280 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.786765 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.787561 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.787907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.788382 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.788884 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.789386 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.789892 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.790361 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.790942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.791761 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.792395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.792971 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.793446 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.794050 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.796487 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.797040 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.797664 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.798143 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.798630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.799087 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.799545 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] token.caching = True {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.799948 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.801197 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.801197 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.801472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.801836 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.802106 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.802375 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.802850 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.803426 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.803984 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.804459 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.804948 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.805045 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:28.805115 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:28.805349 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:28.805501 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.806032 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.806556 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.807128 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.807620 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.808125 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] database.connection = **** {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.808603 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.808979 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.809246 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.809536 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.809857 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.810351 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.810826 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.811489 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.812295 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.812861 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.813395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.813957 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.814475 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.814992 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.815228 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:28.815575 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.816033 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.816475 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.816926 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:11:28.817257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 22:11:28.846442 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:28.846749 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:28.870526 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:28.870837 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:28.871102 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:28.891281 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:28.910017 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:28.929928 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:28.930291 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:28.963449 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:28.963680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:28.982062 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.021164 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.021419 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.132266 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.132466 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.132667 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.132898 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.133080 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.133307 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.159501 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.159733 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.159968 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.160199 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.160427 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.160651 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.160875 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.170654 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.171130 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.171487 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.171860 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.172222 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.172586 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.175228 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.188821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.189063 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.189262 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.189517 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.189777 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.189872 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.190028 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.190120 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.190249 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.190341 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.190477 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.190734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.190922 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.191141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.199449 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.203677 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.203904 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.204135 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.204358 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.204580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.204799 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.205017 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:11:29.210354 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.210589 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 22:11:29.210927 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.211134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 22:11:29.211417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.211686 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.212311 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.212585 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.217095 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.217349 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 22:11:29.217688 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.217870 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 22:11:29.218170 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.218431 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.218691 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.218952 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.223835 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.224140 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.224416 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.224715 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.229401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.229767 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.230075 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.230376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.232304 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.235734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.236031 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.236329 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.236618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.236906 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.237747 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.237747 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.237971 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.238487 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.238622 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.238745 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.238994 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.242167 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.242473 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.242766 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.243073 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.243360 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.243629 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.243922 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.244208 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.244484 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.244787 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.245057 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.264867 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.266574 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.266912 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.271869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.272100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.272232 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.272484 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.273398 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.273747 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.279700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.279999 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.280088 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.280293 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.280474 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.285006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.285309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.285641 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.285927 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.286218 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.286501 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.286780 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.287061 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.287427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.287737 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.292238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.292604 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.292931 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.293257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.293588 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.293945 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.294307 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.295264 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.306131 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.306441 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.311166 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.314411 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.314717 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.314918 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.315239 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.318737 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.319636 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.322377 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.322719 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.323009 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.326957 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.327286 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.327390 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.327581 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.327892 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.328177 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.328526 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.330981 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.334269 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.334590 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.334889 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.335187 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.335467 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.335757 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.346230 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.346551 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.346828 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.347115 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.353753 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.354073 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.354379 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.354520 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.354656 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.356002 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.356372 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.360385 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.360698 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.361040 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.361342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.361666 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.362602 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.364294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.364592 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.367488 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.367812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.368125 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.368413 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.368705 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.373978 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.374284 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.374580 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.374869 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.375164 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.375456 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.375744 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.380722 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.381024 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.381316 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.381633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.381923 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.382208 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.382569 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.392975 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.396198 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.399265 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.399431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.400750 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.402288 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.402432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.402570 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.402866 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.406676 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.408166 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.409786 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.410075 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.410376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.410505 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.412027 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.415162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.415462 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.415757 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.416041 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.417335 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.418998 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.423137 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.423496 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.423874 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.424196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.425167 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.425505 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.425808 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.432599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.432911 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.433087 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.433228 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.433361 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.433528 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.433820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.434100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.434437 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.434726 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.435045 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.435480 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.435983 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.436277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.436799 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.437101 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.437402 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.440901 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:11:29.441308 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.441724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.442203 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.442564 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.442914 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.443306 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.443706 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.444081 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.444458 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.444809 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.445145 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.445538 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.445881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:11:29.474400 dv-cinder-850321-4-smb devstack@keystone.service[81752]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e39e6d99c0 pid: 81752 (default app) Aug 23 22:11:29.478230 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221181c-d29b-4112-bcef-a0cb16dd0391 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:29.478522 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221181c-d29b-4112-bcef-a0cb16dd0391 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:29.478801 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221181c-d29b-4112-bcef-a0cb16dd0391 None None] PATH_INFO: `/v3` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:29.484050 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1/1] 10.222.0.77 () {50 vars in 791 bytes} [Tue Aug 23 22:11:29 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:29.484250 dv-cinder-850321-4-smb devstack@keystone.service[81751]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e39e6d99c0 pid: 81751 (default app) Aug 23 22:11:36.485689 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66556771-8c22-4e41-a0c7-9c59a0d08b40 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:36.486239 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66556771-8c22-4e41-a0c7-9c59a0d08b40 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:36.486239 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66556771-8c22-4e41-a0c7-9c59a0d08b40 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:36.487563 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 2/2] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:11:36.496719 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda553a-6028-4b24-a525-c6cdd395fac4 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:36.497170 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda553a-6028-4b24-a525-c6cdd395fac4 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:36.497276 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda553a-6028-4b24-a525-c6cdd395fac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:36.567998 dv-cinder-850321-4-smb devstack@keystone.service[81751]: INFO dbcounter [None req-5bda553a-6028-4b24-a525-c6cdd395fac4 None None] Registered counter for database keystone Aug 23 22:11:36.588419 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG oslo_db.sqlalchemy.engines [None req-5bda553a-6028-4b24-a525-c6cdd395fac4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81751) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:11:36.595516 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writer thread running {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:11:36.780941 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG passlib.handlers.bcrypt [None req-5bda553a-6028-4b24-a525-c6cdd395fac4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81751) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 23 22:11:36.781413 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG passlib.handlers.bcrypt [None req-5bda553a-6028-4b24-a525-c6cdd395fac4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81751) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 23 22:11:36.837586 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-5bda553a-6028-4b24-a525-c6cdd395fac4 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:36.839214 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-5bda553a-6028-4b24-a525-c6cdd395fac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:36.977570 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1/3] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 484 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 23 22:11:37.473399 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66556771-8c22-4e41-a0c7-9c59a0d08b40 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:37.542552 dv-cinder-850321-4-smb devstack@keystone.service[81752]: INFO dbcounter [None req-66556771-8c22-4e41-a0c7-9c59a0d08b40 None None] Registered counter for database keystone Aug 23 22:11:37.566198 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG oslo_db.sqlalchemy.engines [None req-66556771-8c22-4e41-a0c7-9c59a0d08b40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81752) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:11:37.572953 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writer thread running {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:11:37.703342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66556771-8c22-4e41-a0c7-9c59a0d08b40 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:37.707913 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba3d3d-1978-4c9a-b223-a29a6efc6023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:37.708565 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba3d3d-1978-4c9a-b223-a29a6efc6023 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:37.708855 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba3d3d-1978-4c9a-b223-a29a6efc6023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:37.709126 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba3d3d-1978-4c9a-b223-a29a6efc6023 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:37.718139 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba3d3d-1978-4c9a-b223-a29a6efc6023 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:37.770516 dv-cinder-850321-4-smb devstack@keystone.service[81752]: WARNING keystone.common.rbac_enforcer.enforcer [None req-daba3d3d-1978-4c9a-b223-a29a6efc6023 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 23 22:11:37.770851 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba3d3d-1978-4c9a-b223-a29a6efc6023 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:37.782252 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 3/4] 10.222.0.77 () {58 vars in 1324 bytes} [Tue Aug 23 22:11:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 22:11:37.788411 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda553a-6028-4b24-a525-c6cdd395fac4 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:37.805751 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda553a-6028-4b24-a525-c6cdd395fac4 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:37.810506 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13516243-904d-4192-bafc-bfd74843baa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:37.812145 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13516243-904d-4192-bafc-bfd74843baa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:37.812431 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13516243-904d-4192-bafc-bfd74843baa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:37.812747 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13516243-904d-4192-bafc-bfd74843baa8 admin admin] PATH_INFO: `/v3/projects/dad9b8e962404742bf84b26f82ffb671` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:37.814277 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13516243-904d-4192-bafc-bfd74843baa8 admin admin] RBAC: Authorizing `identity:get_project(project_id=dad9b8e962404742bf84b26f82ffb671)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:37.868438 dv-cinder-850321-4-smb devstack@keystone.service[81751]: WARNING keystone.common.rbac_enforcer.enforcer [None req-13516243-904d-4192-bafc-bfd74843baa8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 23 22:11:37.868783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13516243-904d-4192-bafc-bfd74843baa8 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:37.874052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 2/5] 10.222.0.77 () {56 vars in 1207 bytes} [Tue Aug 23 22:11:37 2022] GET /identity/v3/projects/dad9b8e962404742bf84b26f82ffb671 => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:39.984595 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c1a4d-1fa9-4420-b84e-42fa56e772e2 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:39.985140 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c1a4d-1fa9-4420-b84e-42fa56e772e2 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:39.985140 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c1a4d-1fa9-4420-b84e-42fa56e772e2 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:39.989330 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 4/6] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:11:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:11:39.995003 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179e629-c1a7-4d81-a1ba-2df49d188590 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:39.995445 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179e629-c1a7-4d81-a1ba-2df49d188590 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:39.995624 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179e629-c1a7-4d81-a1ba-2df49d188590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:40.016694 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-6179e629-c1a7-4d81-a1ba-2df49d188590 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:40.018289 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-6179e629-c1a7-4d81-a1ba-2df49d188590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:40.026299 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 3/7] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 23 22:11:40.307050 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c1a4d-1fa9-4420-b84e-42fa56e772e2 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:40.320990 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c1a4d-1fa9-4420-b84e-42fa56e772e2 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:40.325521 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148d167-bbb5-424b-802d-f822a676a525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:40.326726 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148d167-bbb5-424b-802d-f822a676a525 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:40.327010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148d167-bbb5-424b-802d-f822a676a525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:40.327281 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148d167-bbb5-424b-802d-f822a676a525 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:40.336257 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148d167-bbb5-424b-802d-f822a676a525 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:40.338147 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148d167-bbb5-424b-802d-f822a676a525 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:40.349027 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 5/8] 10.222.0.77 () {58 vars in 1324 bytes} [Tue Aug 23 22:11:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 22:11:40.355315 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179e629-c1a7-4d81-a1ba-2df49d188590 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:40.364906 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179e629-c1a7-4d81-a1ba-2df49d188590 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:40.369588 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53abe64c-9ac3-4c4d-a5e2-205dc107b2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:40.370268 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abe64c-9ac3-4c4d-a5e2-205dc107b2bb admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:40.370552 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abe64c-9ac3-4c4d-a5e2-205dc107b2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:40.370831 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abe64c-9ac3-4c4d-a5e2-205dc107b2bb admin admin] PATH_INFO: `/v3/users/3713f38f8dcb48a58e22f5fcfa10c524` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:40.372259 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53abe64c-9ac3-4c4d-a5e2-205dc107b2bb admin admin] RBAC: Authorizing `identity:get_user(user_id=3713f38f8dcb48a58e22f5fcfa10c524)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:40.374269 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53abe64c-9ac3-4c4d-a5e2-205dc107b2bb admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:40.375937 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 4/9] 10.222.0.77 () {56 vars in 1198 bytes} [Tue Aug 23 22:11:40 2022] GET /identity/v3/users/3713f38f8dcb48a58e22f5fcfa10c524 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:11:42.416604 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc75f8-5c1a-4401-897f-5cf7dd5c38d8 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:42.417176 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc75f8-5c1a-4401-897f-5cf7dd5c38d8 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:42.417176 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc75f8-5c1a-4401-897f-5cf7dd5c38d8 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:42.418520 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 6/10] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:42.423916 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74deaa-1699-44eb-be20-59f8d42f278c None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:42.424375 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74deaa-1699-44eb-be20-59f8d42f278c None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:42.424481 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74deaa-1699-44eb-be20-59f8d42f278c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:42.443475 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-ea74deaa-1699-44eb-be20-59f8d42f278c None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:42.444665 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-ea74deaa-1699-44eb-be20-59f8d42f278c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:42.464848 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8bcbad-2cf2-4757-8130-fa7ed0136607 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:42.465129 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8bcbad-2cf2-4757-8130-fa7ed0136607 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:42.465434 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8bcbad-2cf2-4757-8130-fa7ed0136607 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:42.467376 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 7/11] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:11:42.473141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282ac3b-7fca-4a27-85f2-50b47e433f8f None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:42.473458 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282ac3b-7fca-4a27-85f2-50b47e433f8f None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:42.473740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282ac3b-7fca-4a27-85f2-50b47e433f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:42.517590 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG passlib.handlers.bcrypt [None req-9282ac3b-7fca-4a27-85f2-50b47e433f8f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81752) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 23 22:11:42.518001 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG passlib.handlers.bcrypt [None req-9282ac3b-7fca-4a27-85f2-50b47e433f8f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81752) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 23 22:11:42.528103 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 5/12] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:42.564541 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-9282ac3b-7fca-4a27-85f2-50b47e433f8f None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:42.566188 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-9282ac3b-7fca-4a27-85f2-50b47e433f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:42.669268 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 8/13] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:42.801568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74deaa-1699-44eb-be20-59f8d42f278c None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:42.827632 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:42.909205 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74deaa-1699-44eb-be20-59f8d42f278c None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:42.935599 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282ac3b-7fca-4a27-85f2-50b47e433f8f None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:42.946734 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f770823-21cc-4623-86c4-7cd176bcb54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:42.947384 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f770823-21cc-4623-86c4-7cd176bcb54d None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:42.947675 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f770823-21cc-4623-86c4-7cd176bcb54d None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:42.947950 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f770823-21cc-4623-86c4-7cd176bcb54d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:42.960276 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f770823-21cc-4623-86c4-7cd176bcb54d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:42.969649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-1f770823-21cc-4623-86c4-7cd176bcb54d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:11:42.969649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:42.969649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:42.969649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:42.969649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:42.969649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:42.969649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:42.969649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:42.969649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:42.969649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:42.969649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:42.969649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:42.969649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:42.969649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:42.969649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:42.969649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:42.970768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:42.970768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:42.970768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:42.970768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:42.970768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:42.970768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:42.970768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:42.970768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:42.970768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:42.970768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:42.970768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:42.970768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:42.970768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:42.970768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:42.970768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:42.970768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:42.971777 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:42.971777 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:42.971777 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:42.971777 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:42.971777 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:42.971777 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:42.971777 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:42.971777 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:42.971777 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:42.971777 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:42.971777 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:11:42.971777 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:11:42.971777 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 6/14] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:11:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:11:42.976749 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f770823-21cc-4623-86c4-7cd176bcb54d None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:43.046955 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282ac3b-7fca-4a27-85f2-50b47e433f8f None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:43.049390 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:43.063577 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:43.083670 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f770823-21cc-4623-86c4-7cd176bcb54d None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:43.089509 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093db0a9-d222-44aa-a342-a8e5701e0246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:43.090388 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093db0a9-d222-44aa-a342-a8e5701e0246 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:43.090675 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093db0a9-d222-44aa-a342-a8e5701e0246 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:43.091952 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093db0a9-d222-44aa-a342-a8e5701e0246 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:43.118877 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52c748-2a31-45bc-8489-b527ffcea509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:43.119496 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52c748-2a31-45bc-8489-b527ffcea509 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:43.119775 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52c748-2a31-45bc-8489-b527ffcea509 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:43.120134 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52c748-2a31-45bc-8489-b527ffcea509 None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:43.120721 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52c748-2a31-45bc-8489-b527ffcea509 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:43.121023 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52c748-2a31-45bc-8489-b527ffcea509 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:43.122479 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52c748-2a31-45bc-8489-b527ffcea509 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:43.135480 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 7/15] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:11:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:11:43.141574 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52c748-2a31-45bc-8489-b527ffcea509 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:43.163965 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093db0a9-d222-44aa-a342-a8e5701e0246 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:43.165531 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093db0a9-d222-44aa-a342-a8e5701e0246 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:43.241420 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52c748-2a31-45bc-8489-b527ffcea509 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:43.267040 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 9/16] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:11:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 22:11:43.272660 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093db0a9-d222-44aa-a342-a8e5701e0246 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:43.275598 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:43.278160 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72c52d-900f-4012-8cc8-0c8220d95d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:43.279777 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72c52d-900f-4012-8cc8-0c8220d95d5f None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:43.280091 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72c52d-900f-4012-8cc8-0c8220d95d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:43.280572 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72c52d-900f-4012-8cc8-0c8220d95d5f None admin] PATH_INFO: `/v3/users/3713f38f8dcb48a58e22f5fcfa10c524` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:43.281889 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad72c52d-900f-4012-8cc8-0c8220d95d5f None admin] RBAC: Authorizing `identity:get_user(user_id=3713f38f8dcb48a58e22f5fcfa10c524)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:43.283382 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad72c52d-900f-4012-8cc8-0c8220d95d5f None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:43.285097 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 8/17] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:11:43 2022] GET /identity/v3/users/3713f38f8dcb48a58e22f5fcfa10c524 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:11:43.290599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72c52d-900f-4012-8cc8-0c8220d95d5f None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:43.305767 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:43.373350 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093db0a9-d222-44aa-a342-a8e5701e0246 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:43.426238 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd277333-29cd-4d18-be06-d7c8ad46a082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:43.427552 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd277333-29cd-4d18-be06-d7c8ad46a082 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:43.427943 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd277333-29cd-4d18-be06-d7c8ad46a082 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:43.428337 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd277333-29cd-4d18-be06-d7c8ad46a082 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:43.443056 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72c52d-900f-4012-8cc8-0c8220d95d5f None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:43.451472 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd277333-29cd-4d18-be06-d7c8ad46a082 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:43.453110 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd277333-29cd-4d18-be06-d7c8ad46a082 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:43.473820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-bd277333-29cd-4d18-be06-d7c8ad46a082 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:11:43.473820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:43.473820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:43.473820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:43.473820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:43.473820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:43.473820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:43.473820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:43.473820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:43.473820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:43.473820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:43.473820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:43.473820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:11:43.473820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:11:43.473820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:11:43.473820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:11:43.475769 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:43.475769 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:43.475769 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:43.475769 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:43.475769 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:43.475769 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:43.475769 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:43.475769 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:43.475769 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:43.475769 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:43.475769 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:43.475769 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:43.475769 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:43.475769 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:43.475769 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:43.475769 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:43.475769 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:11:43.477732 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:11:43.477732 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:11:43.477732 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:11:43.477732 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 10/18] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:11:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:11:43.481233 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd277333-29cd-4d18-be06-d7c8ad46a082 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:43.489256 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4e4ec-da97-48c4-8950-0cd9e36a6147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:43.489957 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4e4ec-da97-48c4-8950-0cd9e36a6147 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:43.490245 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4e4ec-da97-48c4-8950-0cd9e36a6147 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:43.490525 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4e4ec-da97-48c4-8950-0cd9e36a6147 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:43.491857 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4e4ec-da97-48c4-8950-0cd9e36a6147 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:43.493321 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4e4ec-da97-48c4-8950-0cd9e36a6147 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:43.495045 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 9/19] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:11:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:11:43.502096 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4e4ec-da97-48c4-8950-0cd9e36a6147 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:43.549200 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:43.600297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:43.605045 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd277333-29cd-4d18-be06-d7c8ad46a082 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:43.621743 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4e4ec-da97-48c4-8950-0cd9e36a6147 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:43.643297 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21b72e-04f7-487b-b415-344e4068ccd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:43.643930 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21b72e-04f7-487b-b415-344e4068ccd1 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:43.644212 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21b72e-04f7-487b-b415-344e4068ccd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:43.644483 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21b72e-04f7-487b-b415-344e4068ccd1 None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:43.645138 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f21b72e-04f7-487b-b415-344e4068ccd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:43.645474 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f21b72e-04f7-487b-b415-344e4068ccd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:43.646897 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f21b72e-04f7-487b-b415-344e4068ccd1 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:43.660634 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba64f8-b969-4bd5-912d-bb3a0cb124aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:43.661270 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba64f8-b969-4bd5-912d-bb3a0cb124aa None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:43.661583 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba64f8-b969-4bd5-912d-bb3a0cb124aa None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:43.661861 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba64f8-b969-4bd5-912d-bb3a0cb124aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:43.662614 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba64f8-b969-4bd5-912d-bb3a0cb124aa None admin] RBAC: Adding query filter params (role.id=e806ce849cf34b92979b5524f3ea9ff6, scope.domain.id=default, user.id=3713f38f8dcb48a58e22f5fcfa10c524) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:43.662929 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba64f8-b969-4bd5-912d-bb3a0cb124aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:43.664424 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba64f8-b969-4bd5-912d-bb3a0cb124aa None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:43.667731 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 11/20] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:11:43.673493 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 10/21] 10.222.0.77 () {56 vars in 1322 bytes} [Tue Aug 23 22:11:43 2022] GET /identity/v3/role_assignments?user.id=3713f38f8dcb48a58e22f5fcfa10c524&scope.domain.id=default&role.id=e806ce849cf34b92979b5524f3ea9ff6 => generated 233 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:11:45.813413 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549c435-d7af-4a2a-9767-b5f321bc6f0d None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:45.814382 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549c435-d7af-4a2a-9767-b5f321bc6f0d None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:45.814869 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549c435-d7af-4a2a-9767-b5f321bc6f0d None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:45.816794 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 12/22] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:11:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:11:45.822383 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745add0-1120-4d16-9d50-53fa25e643be None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:45.823298 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745add0-1120-4d16-9d50-53fa25e643be None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:45.823796 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745add0-1120-4d16-9d50-53fa25e643be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:45.854430 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-3745add0-1120-4d16-9d50-53fa25e643be None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:45.855994 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-3745add0-1120-4d16-9d50-53fa25e643be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:45.947607 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 11/23] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:46.234449 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d0dbc-8d79-4b93-aa1a-9d7b6e478974 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:46.235142 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d0dbc-8d79-4b93-aa1a-9d7b6e478974 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:46.235628 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d0dbc-8d79-4b93-aa1a-9d7b6e478974 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:46.237493 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 13/24] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:11:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:46.242750 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8d431-382c-4cc0-83da-7572004dc402 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:46.243333 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8d431-382c-4cc0-83da-7572004dc402 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:46.243807 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8d431-382c-4cc0-83da-7572004dc402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:46.266497 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d033b-f5f4-47ac-976a-f328d05e356c None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:46.267120 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d033b-f5f4-47ac-976a-f328d05e356c None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:46.267600 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d033b-f5f4-47ac-976a-f328d05e356c None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:46.269747 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 14/25] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:11:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:46.275277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251db8ee-0d5d-4df7-8210-6ecb533278a1 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:46.275596 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251db8ee-0d5d-4df7-8210-6ecb533278a1 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:46.275832 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251db8ee-0d5d-4df7-8210-6ecb533278a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:46.286971 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-f4d8d431-382c-4cc0-83da-7572004dc402 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:46.288217 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-f4d8d431-382c-4cc0-83da-7572004dc402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:46.315116 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-251db8ee-0d5d-4df7-8210-6ecb533278a1 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:46.316349 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-251db8ee-0d5d-4df7-8210-6ecb533278a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:46.434616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 12/26] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:46.448532 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8d431-382c-4cc0-83da-7572004dc402 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:46.455130 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:46.469646 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 15/27] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:11:46.574588 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8d431-382c-4cc0-83da-7572004dc402 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:46.617839 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a229c-add3-40f2-b0c9-12f43a6a1b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:46.618560 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a229c-add3-40f2-b0c9-12f43a6a1b86 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:46.618882 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a229c-add3-40f2-b0c9-12f43a6a1b86 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:46.619183 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a229c-add3-40f2-b0c9-12f43a6a1b86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:46.637627 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a229c-add3-40f2-b0c9-12f43a6a1b86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:46.643227 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-8b0a229c-add3-40f2-b0c9-12f43a6a1b86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:11:46.643227 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:46.643227 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:46.643227 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:46.643227 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:46.643227 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:46.643227 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:46.643227 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:46.643227 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:46.643227 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:46.643227 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:46.643227 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:46.643227 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:46.643227 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:46.643227 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:46.643227 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:46.644138 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:46.644138 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:46.644138 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:46.644138 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:46.644138 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:46.644138 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:46.644138 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:46.644138 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:46.644138 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:46.644138 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:46.644138 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:46.644138 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:46.644138 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:46.644138 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:46.644138 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:46.644138 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:46.644886 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:46.644886 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:46.644886 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:46.644886 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:46.644886 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:46.644886 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:46.644886 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:46.644886 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:46.644886 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:46.644886 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:46.644886 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:11:46.644886 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:11:46.644886 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 13/28] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:11:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:11:46.650489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251db8ee-0d5d-4df7-8210-6ecb533278a1 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:46.705205 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:46.724517 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608bfce-0232-40e0-8e14-18682bf5b050 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:46.724827 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608bfce-0232-40e0-8e14-18682bf5b050 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:46.725081 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608bfce-0232-40e0-8e14-18682bf5b050 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:46.726594 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 14/29] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:46.739860 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00e75d-e661-4a83-a589-fbee0739025b None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:46.740153 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00e75d-e661-4a83-a589-fbee0739025b None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:46.743706 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00e75d-e661-4a83-a589-fbee0739025b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:46.766332 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-dc00e75d-e661-4a83-a589-fbee0739025b None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:46.767146 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-dc00e75d-e661-4a83-a589-fbee0739025b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:46.814089 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251db8ee-0d5d-4df7-8210-6ecb533278a1 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:46.880502 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554dd67-2190-4f6c-a926-8d6fb368a773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:46.881085 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554dd67-2190-4f6c-a926-8d6fb368a773 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:46.881385 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554dd67-2190-4f6c-a926-8d6fb368a773 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:46.881666 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554dd67-2190-4f6c-a926-8d6fb368a773 None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:46.882349 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1554dd67-2190-4f6c-a926-8d6fb368a773 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:46.882670 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1554dd67-2190-4f6c-a926-8d6fb368a773 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:46.884245 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1554dd67-2190-4f6c-a926-8d6fb368a773 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:46.907517 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 16/30] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:11:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:11:46.908053 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:46.908473 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554dd67-2190-4f6c-a926-8d6fb368a773 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:46.922869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 15/31] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:11:46.934105 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00e75d-e661-4a83-a589-fbee0739025b None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:47.090544 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00e75d-e661-4a83-a589-fbee0739025b None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:47.173697 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554dd67-2190-4f6c-a926-8d6fb368a773 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:47.176224 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3f9d2-d106-44ba-a5da-20925e9cbd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:47.176881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3f9d2-d106-44ba-a5da-20925e9cbd98 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:47.177169 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3f9d2-d106-44ba-a5da-20925e9cbd98 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:47.177473 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3f9d2-d106-44ba-a5da-20925e9cbd98 None admin] PATH_INFO: `/v3/users/3713f38f8dcb48a58e22f5fcfa10c524` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:47.178644 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3f9d2-d106-44ba-a5da-20925e9cbd98 None admin] RBAC: Authorizing `identity:get_user(user_id=3713f38f8dcb48a58e22f5fcfa10c524)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:47.181235 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3f9d2-d106-44ba-a5da-20925e9cbd98 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:47.182878 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 16/32] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:11:46 2022] GET /identity/v3/users/3713f38f8dcb48a58e22f5fcfa10c524 => generated 247 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:47.183637 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3f9d2-d106-44ba-a5da-20925e9cbd98 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:47.195882 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:47.248638 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca90b1e-1eec-4f26-9e2f-63b4ff892b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:47.249304 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca90b1e-1eec-4f26-9e2f-63b4ff892b1f None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:47.249770 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca90b1e-1eec-4f26-9e2f-63b4ff892b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:47.250053 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca90b1e-1eec-4f26-9e2f-63b4ff892b1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:47.281104 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca90b1e-1eec-4f26-9e2f-63b4ff892b1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:47.282920 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca90b1e-1eec-4f26-9e2f-63b4ff892b1f None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:47.300667 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-eca90b1e-1eec-4f26-9e2f-63b4ff892b1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:11:47.300667 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:47.300667 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:47.300667 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:47.300667 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:47.300667 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:47.300667 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:47.300667 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:47.300667 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:47.300667 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:47.300667 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:47.300667 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:47.300667 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:11:47.300667 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:11:47.300667 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:11:47.300667 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:11:47.301708 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:47.301708 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:47.301708 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:47.301708 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:47.301708 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:47.301708 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:47.301708 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:47.301708 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:47.301708 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:47.301708 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:47.301708 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:47.301708 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:47.301708 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:47.301708 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:47.301708 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:47.301708 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:47.301708 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:11:47.302507 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:11:47.302507 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:11:47.302507 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:11:47.305013 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 17/33] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:11:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:11:47.306356 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca90b1e-1eec-4f26-9e2f-63b4ff892b1f None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:47.321817 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:47.384920 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3f9d2-d106-44ba-a5da-20925e9cbd98 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:47.451128 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0f11d-cc44-4588-bd11-623c41cd0e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:47.451847 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0f11d-cc44-4588-bd11-623c41cd0e46 None admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:47.452375 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0f11d-cc44-4588-bd11-623c41cd0e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:47.453214 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0f11d-cc44-4588-bd11-623c41cd0e46 None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:47.454637 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0f11d-cc44-4588-bd11-623c41cd0e46 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:47.456639 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0f11d-cc44-4588-bd11-623c41cd0e46 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:47.457417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca90b1e-1eec-4f26-9e2f-63b4ff892b1f None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:47.509580 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a10fc-afe2-4c89-8b1d-3f52cb1e3dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:47.510540 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a10fc-afe2-4c89-8b1d-3f52cb1e3dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:47.510971 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a10fc-afe2-4c89-8b1d-3f52cb1e3dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:47.511465 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a10fc-afe2-4c89-8b1d-3f52cb1e3dd1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:47.513215 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a10fc-afe2-4c89-8b1d-3f52cb1e3dd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:47.515470 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a10fc-afe2-4c89-8b1d-3f52cb1e3dd1 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:47.517913 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 18/34] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:11:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:47.519493 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a10fc-afe2-4c89-8b1d-3f52cb1e3dd1 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:47.558009 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:47.617802 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 17/35] 10.222.0.77 () {60 vars in 1131 bytes} [Tue Aug 23 22:11:47 2022] POST /identity/v3/roles => generated 219 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:11:47.619172 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0f11d-cc44-4588-bd11-623c41cd0e46 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:47.716083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a10fc-afe2-4c89-8b1d-3f52cb1e3dd1 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:47.750353 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0f11d-cc44-4588-bd11-623c41cd0e46 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:47.785281 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:47.786359 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2002021-79c5-49de-96c6-feb1da1b8c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:47.788671 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2002021-79c5-49de-96c6-feb1da1b8c25 None admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:47.789518 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2002021-79c5-49de-96c6-feb1da1b8c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:47.790211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2002021-79c5-49de-96c6-feb1da1b8c25 None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:47.792891 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2002021-79c5-49de-96c6-feb1da1b8c25 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:47.798513 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2002021-79c5-49de-96c6-feb1da1b8c25 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:47.803788 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0daf3-f52c-480f-aa32-90d58a0c2e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:47.804769 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0daf3-f52c-480f-aa32-90d58a0c2e37 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:47.805262 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0daf3-f52c-480f-aa32-90d58a0c2e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:47.805826 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0daf3-f52c-480f-aa32-90d58a0c2e37 None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:47.806907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0daf3-f52c-480f-aa32-90d58a0c2e37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:47.807454 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0daf3-f52c-480f-aa32-90d58a0c2e37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:47.809327 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0daf3-f52c-480f-aa32-90d58a0c2e37 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:47.839645 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 18/36] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:47.841204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0daf3-f52c-480f-aa32-90d58a0c2e37 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:47.955493 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 19/37] 10.222.0.77 () {60 vars in 1131 bytes} [Tue Aug 23 22:11:47 2022] POST /identity/v3/roles => generated 225 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:11:47.957679 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0e347-6dbf-4780-806d-d7a6b0a8095f None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:47.957964 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0e347-6dbf-4780-806d-d7a6b0a8095f None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:47.958237 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0e347-6dbf-4780-806d-d7a6b0a8095f None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:47.959701 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 20/38] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:47.961491 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0e347-6dbf-4780-806d-d7a6b0a8095f None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:48.028063 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0daf3-f52c-480f-aa32-90d58a0c2e37 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:48.072167 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd5b0a-ab2f-4a3b-a196-3953f9d72de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:48.072869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd5b0a-ab2f-4a3b-a196-3953f9d72de1 None admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:48.073164 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd5b0a-ab2f-4a3b-a196-3953f9d72de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:48.073477 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd5b0a-ab2f-4a3b-a196-3953f9d72de1 None admin] PATH_INFO: `/v3/domains/default/users/3713f38f8dcb48a58e22f5fcfa10c524/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:48.076451 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd5b0a-ab2f-4a3b-a196-3953f9d72de1 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3713f38f8dcb48a58e22f5fcfa10c524, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:48.078094 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd5b0a-ab2f-4a3b-a196-3953f9d72de1 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:48.098546 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 19/39] 10.222.0.77 () {58 vars in 1361 bytes} [Tue Aug 23 22:11:47 2022] PUT /identity/v3/domains/default/users/3713f38f8dcb48a58e22f5fcfa10c524/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:11:48.100401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021edfdc-177a-4632-a214-ba14dc8eac48 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:48.100705 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021edfdc-177a-4632-a214-ba14dc8eac48 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:48.101159 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021edfdc-177a-4632-a214-ba14dc8eac48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:48.111973 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:48.122191 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-021edfdc-177a-4632-a214-ba14dc8eac48 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:48.124452 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-021edfdc-177a-4632-a214-ba14dc8eac48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:48.137325 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0e347-6dbf-4780-806d-d7a6b0a8095f None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:48.179847 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:48.188575 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3a3e4-f570-4d7f-b240-a5db126cca17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:48.189417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3a3e4-f570-4d7f-b240-a5db126cca17 None admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:48.189748 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3a3e4-f570-4d7f-b240-a5db126cca17 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:48.190101 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3a3e4-f570-4d7f-b240-a5db126cca17 None admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:48.191492 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a3a3e4-f570-4d7f-b240-a5db126cca17 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:48.193191 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a3a3e4-f570-4d7f-b240-a5db126cca17 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:48.235700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 20/40] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:48.237677 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a4990-57ec-40f6-87eb-96fcc78934b4 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:48.238263 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a4990-57ec-40f6-87eb-96fcc78934b4 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:48.238759 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a4990-57ec-40f6-87eb-96fcc78934b4 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:48.239062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 21/41] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Aug 23 22:11:47 2022] POST /identity/v3/projects => generated 301 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:11:48.240682 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 21/42] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:11:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:48.252257 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbcd60-b493-4fd6-8877-d954f486dd46 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:48.252944 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbcd60-b493-4fd6-8877-d954f486dd46 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:48.253575 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbcd60-b493-4fd6-8877-d954f486dd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:48.276661 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-bafbcd60-b493-4fd6-8877-d954f486dd46 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:48.279733 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-bafbcd60-b493-4fd6-8877-d954f486dd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:48.376723 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 22/43] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:11:48.521795 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a4990-57ec-40f6-87eb-96fcc78934b4 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:48.672435 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a4990-57ec-40f6-87eb-96fcc78934b4 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:48.676189 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbcd60-b493-4fd6-8877-d954f486dd46 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:48.778088 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:48.821895 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbcd60-b493-4fd6-8877-d954f486dd46 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:48.829326 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2301137-103d-42cb-aeab-f0a943f77741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:48.830219 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2301137-103d-42cb-aeab-f0a943f77741 None admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:48.830529 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2301137-103d-42cb-aeab-f0a943f77741 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:48.830809 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2301137-103d-42cb-aeab-f0a943f77741 None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:48.831530 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2301137-103d-42cb-aeab-f0a943f77741 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:48.833188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2301137-103d-42cb-aeab-f0a943f77741 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:48.852510 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 22/44] 10.222.0.77 () {60 vars in 1131 bytes} [Tue Aug 23 22:11:48 2022] POST /identity/v3/roles => generated 223 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:11:48.869036 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe69d2-9a8b-4c07-90fb-b4a10fced60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:48.869863 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe69d2-9a8b-4c07-90fb-b4a10fced60c None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:48.870223 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe69d2-9a8b-4c07-90fb-b4a10fced60c None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:48.870566 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe69d2-9a8b-4c07-90fb-b4a10fced60c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:48.872096 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe69d2-9a8b-4c07-90fb-b4a10fced60c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:48.874343 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe69d2-9a8b-4c07-90fb-b4a10fced60c None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:48.876462 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 23/45] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:11:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:11:48.882603 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2301137-103d-42cb-aeab-f0a943f77741 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:48.938479 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:49.025152 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2301137-103d-42cb-aeab-f0a943f77741 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:49.065834 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d99e9d-22be-4a0a-ae9e-4bc14c60de6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:49.067269 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d99e9d-22be-4a0a-ae9e-4bc14c60de6c None admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:49.067760 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d99e9d-22be-4a0a-ae9e-4bc14c60de6c None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:49.068266 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d99e9d-22be-4a0a-ae9e-4bc14c60de6c None admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:49.069436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d99e9d-22be-4a0a-ae9e-4bc14c60de6c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:49.071117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d99e9d-22be-4a0a-ae9e-4bc14c60de6c None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:49.102819 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 23/46] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Aug 23 22:11:48 2022] POST /identity/v3/projects => generated 312 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:11:50.186152 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845e099-3173-4485-9cae-58b013777c33 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:50.186675 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845e099-3173-4485-9cae-58b013777c33 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:50.186814 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845e099-3173-4485-9cae-58b013777c33 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:50.188454 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 24/47] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:11:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:50.194247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d44d4e-2b77-4cfb-bfa3-03a790edf00f None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:50.194712 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d44d4e-2b77-4cfb-bfa3-03a790edf00f None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:50.194818 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d44d4e-2b77-4cfb-bfa3-03a790edf00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:50.214181 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-61d44d4e-2b77-4cfb-bfa3-03a790edf00f None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:50.215402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-61d44d4e-2b77-4cfb-bfa3-03a790edf00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:50.283634 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 24/48] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:50.550585 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845e099-3173-4485-9cae-58b013777c33 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:50.654925 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845e099-3173-4485-9cae-58b013777c33 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:50.689758 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35041000-e444-47d3-ab0d-194840b1602d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:50.690414 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35041000-e444-47d3-ab0d-194840b1602d None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:50.690696 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35041000-e444-47d3-ab0d-194840b1602d None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:50.690971 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35041000-e444-47d3-ab0d-194840b1602d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:50.699391 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:50.704348 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35041000-e444-47d3-ab0d-194840b1602d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:50.710849 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-35041000-e444-47d3-ab0d-194840b1602d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:11:50.710849 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:50.710849 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:50.710849 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:50.710849 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:50.710849 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:50.710849 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:50.710849 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:50.710849 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:50.710849 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:50.710849 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:50.710849 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:50.710849 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:50.710849 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:50.710849 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:50.710849 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:50.711753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:50.711753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:50.711753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:50.711753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:50.711753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:50.711753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:50.711753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:50.711753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:50.711753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:50.711753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:50.711753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:50.711753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:50.711753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:50.711753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:50.711753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:50.711753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:50.712711 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:50.712711 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:50.712711 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:50.712711 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:50.712711 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:50.712711 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:50.712711 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:50.712711 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:50.712711 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:50.712711 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:50.712711 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:11:50.712711 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:11:50.712711 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 25/49] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:11:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:11:50.718562 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d44d4e-2b77-4cfb-bfa3-03a790edf00f None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:50.735239 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:50.827715 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d44d4e-2b77-4cfb-bfa3-03a790edf00f None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:50.867635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99634b-65f3-4782-abe8-4eaee7578090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:50.868265 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99634b-65f3-4782-abe8-4eaee7578090 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:50.868549 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99634b-65f3-4782-abe8-4eaee7578090 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:50.868825 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99634b-65f3-4782-abe8-4eaee7578090 None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:50.869561 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99634b-65f3-4782-abe8-4eaee7578090 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:50.869869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99634b-65f3-4782-abe8-4eaee7578090 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:50.871338 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99634b-65f3-4782-abe8-4eaee7578090 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:50.881797 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 25/50] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:11:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:50.887539 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35041000-e444-47d3-ab0d-194840b1602d None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:50.990860 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35041000-e444-47d3-ab0d-194840b1602d None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:51.025965 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b6944-498a-44d0-8206-08b9fd880f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:51.026606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b6944-498a-44d0-8206-08b9fd880f7f None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:51.026884 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b6944-498a-44d0-8206-08b9fd880f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:51.027152 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b6944-498a-44d0-8206-08b9fd880f7f None admin] PATH_INFO: `/v3/users/3713f38f8dcb48a58e22f5fcfa10c524` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:51.028552 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b6944-498a-44d0-8206-08b9fd880f7f None admin] RBAC: Authorizing `identity:get_user(user_id=3713f38f8dcb48a58e22f5fcfa10c524)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:51.030940 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b6944-498a-44d0-8206-08b9fd880f7f None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:51.032565 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 26/51] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:11:50 2022] GET /identity/v3/users/3713f38f8dcb48a58e22f5fcfa10c524 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:51.038217 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99634b-65f3-4782-abe8-4eaee7578090 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:51.048416 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152e912-65fd-43bc-a643-bbfffce29781 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:51.048712 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152e912-65fd-43bc-a643-bbfffce29781 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:51.048998 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152e912-65fd-43bc-a643-bbfffce29781 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:51.050379 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 27/52] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:11:51.055761 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005294aa-62a4-4072-993c-32175cb0a910 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:51.056074 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005294aa-62a4-4072-993c-32175cb0a910 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:51.056354 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005294aa-62a4-4072-993c-32175cb0a910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:51.074876 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-005294aa-62a4-4072-993c-32175cb0a910 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:51.076733 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-005294aa-62a4-4072-993c-32175cb0a910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:51.118670 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:51.143152 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:51.146349 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99634b-65f3-4782-abe8-4eaee7578090 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:51.151003 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 28/53] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:11:51.181940 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0348ec-d2a4-4e2b-887b-7c1169a98ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:51.182580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0348ec-d2a4-4e2b-887b-7c1169a98ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:51.182869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0348ec-d2a4-4e2b-887b-7c1169a98ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:51.183155 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0348ec-d2a4-4e2b-887b-7c1169a98ef4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:51.184565 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0348ec-d2a4-4e2b-887b-7c1169a98ef4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:51.187560 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0348ec-d2a4-4e2b-887b-7c1169a98ef4 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:51.189209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 26/54] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:11:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:51.195138 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005294aa-62a4-4072-993c-32175cb0a910 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:51.302346 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005294aa-62a4-4072-993c-32175cb0a910 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:51.339054 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e1e42-26b9-4a7b-a303-1df7599bf7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:51.339683 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e1e42-26b9-4a7b-a303-1df7599bf7ad None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:51.339972 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e1e42-26b9-4a7b-a303-1df7599bf7ad None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:51.340319 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e1e42-26b9-4a7b-a303-1df7599bf7ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:51.340986 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e1e42-26b9-4a7b-a303-1df7599bf7ad None admin] RBAC: Adding query filter params (role.id=e806ce849cf34b92979b5524f3ea9ff6, scope.domain.id=default, user.id=3713f38f8dcb48a58e22f5fcfa10c524) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:51.342185 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e1e42-26b9-4a7b-a303-1df7599bf7ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:51.343803 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e1e42-26b9-4a7b-a303-1df7599bf7ad None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:51.353825 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 29/55] 10.222.0.77 () {56 vars in 1322 bytes} [Tue Aug 23 22:11:51 2022] GET /identity/v3/role_assignments?user.id=3713f38f8dcb48a58e22f5fcfa10c524&scope.domain.id=default&role.id=e806ce849cf34b92979b5524f3ea9ff6 => generated 530 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:11:51.422398 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0348ec-d2a4-4e2b-887b-7c1169a98ef4 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:51.552117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0348ec-d2a4-4e2b-887b-7c1169a98ef4 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:51.597072 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879efd27-45db-44c9-becd-f6ce4916b912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:51.597992 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879efd27-45db-44c9-becd-f6ce4916b912 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:51.598462 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879efd27-45db-44c9-becd-f6ce4916b912 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:51.598922 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879efd27-45db-44c9-becd-f6ce4916b912 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:51.600702 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879efd27-45db-44c9-becd-f6ce4916b912 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:51.602438 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879efd27-45db-44c9-becd-f6ce4916b912 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:51.605013 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 27/56] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:11:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:51.612927 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e1e42-26b9-4a7b-a303-1df7599bf7ad None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:51.685905 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:51.732023 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e1e42-26b9-4a7b-a303-1df7599bf7ad None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:51.768259 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37876910-d9c3-4845-9dcc-1e04bd447a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:51.768888 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37876910-d9c3-4845-9dcc-1e04bd447a17 None admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:51.769169 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37876910-d9c3-4845-9dcc-1e04bd447a17 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:51.769469 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37876910-d9c3-4845-9dcc-1e04bd447a17 None admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:51.770146 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37876910-d9c3-4845-9dcc-1e04bd447a17 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:51.771654 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37876910-d9c3-4845-9dcc-1e04bd447a17 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:51.908600 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 30/57] 10.222.0.77 () {60 vars in 1140 bytes} [Tue Aug 23 22:11:51 2022] POST /identity/v3/projects => generated 298 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:11:53.847865 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39de279-6836-4750-b79e-8b6253e8812d None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:53.848367 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39de279-6836-4750-b79e-8b6253e8812d None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:53.848451 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39de279-6836-4750-b79e-8b6253e8812d None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:53.849810 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 28/58] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:53.854985 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c2afa-b477-4091-957b-cf34ca692aa8 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:53.855363 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c2afa-b477-4091-957b-cf34ca692aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:53.855535 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c2afa-b477-4091-957b-cf34ca692aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:53.875051 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-613c2afa-b477-4091-957b-cf34ca692aa8 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:53.876276 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-613c2afa-b477-4091-957b-cf34ca692aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:53.946498 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 31/59] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:54.217575 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39de279-6836-4750-b79e-8b6253e8812d None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:54.236164 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:54.330821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39de279-6836-4750-b79e-8b6253e8812d None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:54.370335 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f43f1-6809-4ff1-aa58-8eba42a79490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:54.370975 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f43f1-6809-4ff1-aa58-8eba42a79490 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:54.371260 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f43f1-6809-4ff1-aa58-8eba42a79490 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:54.371538 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f43f1-6809-4ff1-aa58-8eba42a79490 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:54.372735 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f43f1-6809-4ff1-aa58-8eba42a79490 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:54.374231 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f43f1-6809-4ff1-aa58-8eba42a79490 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:54.375825 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 29/60] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:11:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:54.382175 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c2afa-b477-4091-957b-cf34ca692aa8 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:54.433814 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:54.493577 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c2afa-b477-4091-957b-cf34ca692aa8 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:54.528139 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bf3fa-9d0e-4781-84a2-2a273eb4970b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:54.528761 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bf3fa-9d0e-4781-84a2-2a273eb4970b None admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:54.529045 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bf3fa-9d0e-4781-84a2-2a273eb4970b None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:54.529324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bf3fa-9d0e-4781-84a2-2a273eb4970b None admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:54.530001 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766bf3fa-9d0e-4781-84a2-2a273eb4970b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:54.531451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766bf3fa-9d0e-4781-84a2-2a273eb4970b None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:54.559158 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 32/61] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Aug 23 22:11:54 2022] POST /identity/v3/users => generated 275 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:11:57.544401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21ccb7-99df-4c78-af40-6defa794218d None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:57.546012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21ccb7-99df-4c78-af40-6defa794218d None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:57.546849 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21ccb7-99df-4c78-af40-6defa794218d None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:57.550274 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 30/62] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:11:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:57.556589 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700032b2-1db5-42cf-8772-94bcc73f099d None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:57.557593 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700032b2-1db5-42cf-8772-94bcc73f099d None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:57.558065 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700032b2-1db5-42cf-8772-94bcc73f099d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:57.582924 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-700032b2-1db5-42cf-8772-94bcc73f099d None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:57.584476 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-700032b2-1db5-42cf-8772-94bcc73f099d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:57.671703 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 33/63] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:11:57.959067 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df574a8-0856-49e6-815a-c2bb46cf9980 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:57.959758 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df574a8-0856-49e6-815a-c2bb46cf9980 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:57.960265 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df574a8-0856-49e6-815a-c2bb46cf9980 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:57.961913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 31/64] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:11:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:11:57.969645 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc6a01-10a4-4eb0-a411-498b1c8672fb None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:57.970260 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc6a01-10a4-4eb0-a411-498b1c8672fb None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:57.970727 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc6a01-10a4-4eb0-a411-498b1c8672fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:57.992499 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-95dc6a01-10a4-4eb0-a411-498b1c8672fb None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:57.994753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-95dc6a01-10a4-4eb0-a411-498b1c8672fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:58.037286 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:58.101130 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 34/65] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:58.131339 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df574a8-0856-49e6-815a-c2bb46cf9980 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:58.274796 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:58.311364 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df574a8-0856-49e6-815a-c2bb46cf9980 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:58.363274 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ffbe8-6dd7-42fe-992e-61e4d6e73048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:58.364518 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ffbe8-6dd7-42fe-992e-61e4d6e73048 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:58.365020 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ffbe8-6dd7-42fe-992e-61e4d6e73048 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:58.365552 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ffbe8-6dd7-42fe-992e-61e4d6e73048 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:58.389649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ffbe8-6dd7-42fe-992e-61e4d6e73048 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:58.395401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-034ffbe8-6dd7-42fe-992e-61e4d6e73048 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:11:58.395401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:58.395401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:58.395401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:58.395401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:58.395401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:58.395401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:58.395401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:58.395401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:58.395401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:58.395401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:58.395401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:58.395401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:58.395401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:58.395401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:58.395401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:58.396271 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:58.396271 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:58.396271 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:58.396271 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:58.396271 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:58.396271 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:58.396271 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:58.396271 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:58.396271 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:58.396271 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:58.396271 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:58.396271 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:58.396271 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:58.396271 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:58.396271 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:58.396271 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:58.397027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:58.397027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:58.397027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:58.397027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:58.397027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:58.397027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:58.397027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:58.397027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:58.397027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:58.397027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:58.397027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:11:58.397027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:11:58.399757 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 32/66] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:11:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:11:58.406792 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc6a01-10a4-4eb0-a411-498b1c8672fb None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:58.421889 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12155430-426e-4a28-ac1f-e04cc9bfdb79 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:58.422504 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12155430-426e-4a28-ac1f-e04cc9bfdb79 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:58.423600 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12155430-426e-4a28-ac1f-e04cc9bfdb79 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:58.425300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 33/67] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:11:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:11:58.433384 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224506fc-30b5-400e-86e8-651b051f7643 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:58.433746 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224506fc-30b5-400e-86e8-651b051f7643 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:58.433969 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224506fc-30b5-400e-86e8-651b051f7643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:58.456580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-224506fc-30b5-400e-86e8-651b051f7643 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:58.457873 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-224506fc-30b5-400e-86e8-651b051f7643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:58.543659 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 34/68] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:58.546994 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f3e81-eeda-4032-97a8-015d95b0b53a None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:58.548334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f3e81-eeda-4032-97a8-015d95b0b53a None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:58.548822 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f3e81-eeda-4032-97a8-015d95b0b53a None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:58.551152 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 35/69] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:11:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:58.552173 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f3e81-eeda-4032-97a8-015d95b0b53a None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:58.563908 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc6a01-10a4-4eb0-a411-498b1c8672fb None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:58.608473 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d2f21-dfd5-43a4-9511-ff6322dcd1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:58.609511 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d2f21-dfd5-43a4-9511-ff6322dcd1ad None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:58.609968 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d2f21-dfd5-43a4-9511-ff6322dcd1ad None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:58.610443 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d2f21-dfd5-43a4-9511-ff6322dcd1ad None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:58.611425 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d2f21-dfd5-43a4-9511-ff6322dcd1ad None admin] RBAC: Adding query filter params (name=member) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:58.611916 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d2f21-dfd5-43a4-9511-ff6322dcd1ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:58.613695 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d2f21-dfd5-43a4-9511-ff6322dcd1ad None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:58.625509 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 35/70] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Aug 23 22:11:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:58.627904 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7730a0-d32d-4f5e-ae3c-9c06904140fe None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:58.628795 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7730a0-d32d-4f5e-ae3c-9c06904140fe None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:58.629331 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7730a0-d32d-4f5e-ae3c-9c06904140fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:58.645381 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:58.654418 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-0c7730a0-d32d-4f5e-ae3c-9c06904140fe None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:58.656049 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-0c7730a0-d32d-4f5e-ae3c-9c06904140fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:58.673232 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:58.691634 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f3e81-eeda-4032-97a8-015d95b0b53a None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:58.737856 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 36/71] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:58.738940 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7730a0-d32d-4f5e-ae3c-9c06904140fe None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:58.742268 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8dd225-0d39-47d8-8212-a532a132e7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:58.743160 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dd225-0d39-47d8-8212-a532a132e7b1 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:58.743645 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dd225-0d39-47d8-8212-a532a132e7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:58.744158 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dd225-0d39-47d8-8212-a532a132e7b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:58.760131 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8dd225-0d39-47d8-8212-a532a132e7b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:58.767943 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-5d8dd225-0d39-47d8-8212-a532a132e7b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:11:58.767943 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:58.767943 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:58.767943 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:58.767943 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:58.767943 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:58.767943 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:58.767943 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:58.767943 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:58.767943 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:58.767943 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:58.767943 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:58.767943 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:58.767943 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:58.767943 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:58.767943 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:58.769508 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:58.769508 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:58.769508 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:58.769508 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:58.769508 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:58.769508 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:58.769508 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:58.769508 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:58.769508 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:58.769508 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:58.769508 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:58.769508 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:58.769508 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:58.769508 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:58.769508 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:58.769508 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:58.770982 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:58.770982 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:58.770982 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:58.770982 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:58.770982 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:58.770982 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:58.770982 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:58.770982 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:58.770982 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:58.770982 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:58.770982 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:11:58.770982 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:11:58.778880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 36/72] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:11:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:11:58.781181 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ea022-e82f-43a7-9a02-b230f757e7ca None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:58.781756 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ea022-e82f-43a7-9a02-b230f757e7ca None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:58.782203 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ea022-e82f-43a7-9a02-b230f757e7ca None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:58.783701 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 37/73] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:11:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:58.786232 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ea022-e82f-43a7-9a02-b230f757e7ca None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:58.908362 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7730a0-d32d-4f5e-ae3c-9c06904140fe None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:58.939426 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ea022-e82f-43a7-9a02-b230f757e7ca None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:58.958694 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24021847-2712-4718-b9fe-82fb4ab28e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:58.959403 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24021847-2712-4718-b9fe-82fb4ab28e72 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:58.959686 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24021847-2712-4718-b9fe-82fb4ab28e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:58.959955 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24021847-2712-4718-b9fe-82fb4ab28e72 None admin] PATH_INFO: `/v3/users/20a5fed4c1cc4e61a08385f0a1b65924` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:58.976025 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24021847-2712-4718-b9fe-82fb4ab28e72 None admin] RBAC: Authorizing `identity:get_user(user_id=20a5fed4c1cc4e61a08385f0a1b65924)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:58.976209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:58.977703 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24021847-2712-4718-b9fe-82fb4ab28e72 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:58.979406 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 37/74] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:11:58 2022] GET /identity/v3/users/20a5fed4c1cc4e61a08385f0a1b65924 => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:58.979406 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c228b-d770-42c0-a373-ed7aa4895677 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:58.979406 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c228b-d770-42c0-a373-ed7aa4895677 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:58.979406 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c228b-d770-42c0-a373-ed7aa4895677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:58.985615 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af148e-4c65-429c-9dc7-1ff0f4881b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:58.985971 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af148e-4c65-429c-9dc7-1ff0f4881b7c None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:58.986634 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af148e-4c65-429c-9dc7-1ff0f4881b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:58.987288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af148e-4c65-429c-9dc7-1ff0f4881b7c None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:58.988440 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af148e-4c65-429c-9dc7-1ff0f4881b7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:58.989310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af148e-4c65-429c-9dc7-1ff0f4881b7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:58.991114 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af148e-4c65-429c-9dc7-1ff0f4881b7c None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:59.002051 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 38/75] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:11:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:11:59.003109 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af148e-4c65-429c-9dc7-1ff0f4881b7c None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:59.004625 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-d22c228b-d770-42c0-a373-ed7aa4895677 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:59.006058 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-d22c228b-d770-42c0-a373-ed7aa4895677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:59.008753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:59.094552 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 38/76] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:59.095494 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c228b-d770-42c0-a373-ed7aa4895677 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:59.131957 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af148e-4c65-429c-9dc7-1ff0f4881b7c None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:59.180025 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12804d1-099e-4c18-855e-d94b6ffe0c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:59.181038 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12804d1-099e-4c18-855e-d94b6ffe0c80 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:59.181503 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12804d1-099e-4c18-855e-d94b6ffe0c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:59.181849 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12804d1-099e-4c18-855e-d94b6ffe0c80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:59.183080 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12804d1-099e-4c18-855e-d94b6ffe0c80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:59.184580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12804d1-099e-4c18-855e-d94b6ffe0c80 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:59.186828 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 39/77] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:11:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:59.187769 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12804d1-099e-4c18-855e-d94b6ffe0c80 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:59.249856 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c228b-d770-42c0-a373-ed7aa4895677 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:59.287832 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:59.297188 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c0fbfa-450c-4979-80a3-87ad8ebb9f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:59.298577 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0fbfa-450c-4979-80a3-87ad8ebb9f06 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:59.298577 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0fbfa-450c-4979-80a3-87ad8ebb9f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:59.298577 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0fbfa-450c-4979-80a3-87ad8ebb9f06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:59.309531 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:59.350706 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12804d1-099e-4c18-855e-d94b6ffe0c80 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:59.388250 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c0fbfa-450c-4979-80a3-87ad8ebb9f06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:59.390508 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c0fbfa-450c-4979-80a3-87ad8ebb9f06 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:59.391193 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c3148-2659-4c1a-9e2e-3b1a01424191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:59.391846 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c3148-2659-4c1a-9e2e-3b1a01424191 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:59.392137 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c3148-2659-4c1a-9e2e-3b1a01424191 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:59.392420 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c3148-2659-4c1a-9e2e-3b1a01424191 None admin] PATH_INFO: `/v3/users/3713f38f8dcb48a58e22f5fcfa10c524` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:59.393646 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c3148-2659-4c1a-9e2e-3b1a01424191 None admin] RBAC: Authorizing `identity:get_user(user_id=3713f38f8dcb48a58e22f5fcfa10c524)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:59.395101 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c3148-2659-4c1a-9e2e-3b1a01424191 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:59.396721 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 40/78] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:11:59 2022] GET /identity/v3/users/3713f38f8dcb48a58e22f5fcfa10c524 => generated 247 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:59.397543 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c3148-2659-4c1a-9e2e-3b1a01424191 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:59.507874 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 39/79] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:11:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:11:59.508798 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c0fbfa-450c-4979-80a3-87ad8ebb9f06 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:59.523626 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c3148-2659-4c1a-9e2e-3b1a01424191 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:59.552374 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:59.566214 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ad658-fc6b-49d9-885f-c798d4f9101c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:59.567189 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:59.568409 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ad658-fc6b-49d9-885f-c798d4f9101c None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:59.568759 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ad658-fc6b-49d9-885f-c798d4f9101c None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:59.569097 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ad658-fc6b-49d9-885f-c798d4f9101c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:59.583089 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ad658-fc6b-49d9-885f-c798d4f9101c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:59.588380 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-e88ad658-fc6b-49d9-885f-c798d4f9101c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:11:59.588380 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:59.588380 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:59.588380 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:59.588380 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:59.588380 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:59.588380 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:59.588380 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:59.588380 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:59.588380 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:59.588380 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:59.588380 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:59.588380 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:59.588380 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:59.588380 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:59.588380 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:59.589274 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:59.589274 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:59.589274 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:59.589274 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:59.589274 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:59.589274 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:59.589274 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:59.589274 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:59.589274 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:59.589274 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:59.589274 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:59.589274 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:59.589274 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:59.589274 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:59.589274 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:59.589274 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:59.590254 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:59.590254 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:59.590254 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:59.590254 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:59.590254 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:59.590254 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:59.590254 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:59.590254 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:59.590254 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:59.590254 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:59.590254 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:11:59.590254 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:11:59.590254 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 41/80] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Aug 23 22:11:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:11:59.591210 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ad658-fc6b-49d9-885f-c798d4f9101c None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:59.647194 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c0fbfa-450c-4979-80a3-87ad8ebb9f06 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:59.687557 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d575c7b-610f-4cc6-b132-2dc7bb22f13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:59.688260 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d575c7b-610f-4cc6-b132-2dc7bb22f13a None admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:59.688663 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d575c7b-610f-4cc6-b132-2dc7bb22f13a None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:59.688964 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d575c7b-610f-4cc6-b132-2dc7bb22f13a None admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:59.689667 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d575c7b-610f-4cc6-b132-2dc7bb22f13a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:59.691174 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d575c7b-610f-4cc6-b132-2dc7bb22f13a None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:59.709221 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ad658-fc6b-49d9-885f-c798d4f9101c None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:59.719796 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 40/81] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Aug 23 22:11:59 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:11:59.720664 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d575c7b-610f-4cc6-b132-2dc7bb22f13a None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:59.784872 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ac731-957f-49b2-9d4a-ecf616642d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:59.785608 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ac731-957f-49b2-9d4a-ecf616642d10 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:59.785940 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ac731-957f-49b2-9d4a-ecf616642d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:59.786221 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ac731-957f-49b2-9d4a-ecf616642d10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:59.803466 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ac731-957f-49b2-9d4a-ecf616642d10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:59.810394 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-670ac731-957f-49b2-9d4a-ecf616642d10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:11:59.810394 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:59.810394 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:59.810394 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:59.810394 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:59.810394 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:59.810394 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:59.810394 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:59.810394 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:59.810394 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:59.810394 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:59.810394 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:59.810394 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:59.810394 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:59.810394 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:59.810394 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:59.811803 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:59.811803 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:59.811803 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:59.811803 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:59.811803 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:59.811803 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:59.811803 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:59.811803 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:59.811803 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:59.811803 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:59.811803 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:59.811803 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:59.811803 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:59.811803 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:59.811803 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:59.811803 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:59.813287 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:59.813287 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:59.813287 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:59.813287 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:59.813287 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:59.813287 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:59.813287 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:59.813287 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:59.813287 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:59.813287 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:59.813287 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:11:59.813287 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:11:59.813287 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 42/82] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:11:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:11:59.813287 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ac731-957f-49b2-9d4a-ecf616642d10 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:59.875091 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:59.884560 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d575c7b-610f-4cc6-b132-2dc7bb22f13a None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:59.898255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:59.945727 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d6b70-fa54-45ce-bcf4-9c8fe8804063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:59.946368 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d6b70-fa54-45ce-bcf4-9c8fe8804063 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:59.946649 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d6b70-fa54-45ce-bcf4-9c8fe8804063 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:59.946921 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d6b70-fa54-45ce-bcf4-9c8fe8804063 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:59.983888 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ac731-957f-49b2-9d4a-ecf616642d10 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:00.033911 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e737a81-3048-452b-9b39-073ccf26db87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:00.034568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e737a81-3048-452b-9b39-073ccf26db87 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:00.034864 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e737a81-3048-452b-9b39-073ccf26db87 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:00.035312 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e737a81-3048-452b-9b39-073ccf26db87 None admin] PATH_INFO: `/v3/projects/60a5733a3c634efca6df17f66d53c587` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:00.037505 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e737a81-3048-452b-9b39-073ccf26db87 None admin] RBAC: Authorizing `identity:get_project(project_id=60a5733a3c634efca6df17f66d53c587)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:00.039149 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e737a81-3048-452b-9b39-073ccf26db87 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:00.040931 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 43/83] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:11:59 2022] GET /identity/v3/projects/60a5733a3c634efca6df17f66d53c587 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:00.042338 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e737a81-3048-452b-9b39-073ccf26db87 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:00.084785 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d6b70-fa54-45ce-bcf4-9c8fe8804063 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:00.087417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d6b70-fa54-45ce-bcf4-9c8fe8804063 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:00.219259 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:00.229406 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 41/84] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:11:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:00.230797 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d6b70-fa54-45ce-bcf4-9c8fe8804063 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:00.241478 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e737a81-3048-452b-9b39-073ccf26db87 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:00.266263 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:00.293661 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93234f6-4d94-4ab2-a37a-bb5c5531dd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:00.295121 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93234f6-4d94-4ab2-a37a-bb5c5531dd7f None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:00.295580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93234f6-4d94-4ab2-a37a-bb5c5531dd7f None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:00.296273 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93234f6-4d94-4ab2-a37a-bb5c5531dd7f None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:00.297413 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93234f6-4d94-4ab2-a37a-bb5c5531dd7f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:00.297969 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93234f6-4d94-4ab2-a37a-bb5c5531dd7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:00.299625 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93234f6-4d94-4ab2-a37a-bb5c5531dd7f None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:00.316523 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 44/85] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:12:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:00.317922 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93234f6-4d94-4ab2-a37a-bb5c5531dd7f None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:00.365354 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d6b70-fa54-45ce-bcf4-9c8fe8804063 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:00.412988 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984a64c-4fc5-4848-8e72-d6d0bc8e8902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:00.413679 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984a64c-4fc5-4848-8e72-d6d0bc8e8902 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:00.413968 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984a64c-4fc5-4848-8e72-d6d0bc8e8902 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:00.414247 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984a64c-4fc5-4848-8e72-d6d0bc8e8902 None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:00.414930 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984a64c-4fc5-4848-8e72-d6d0bc8e8902 None admin] RBAC: Adding query filter params (name=member) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:00.415241 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984a64c-4fc5-4848-8e72-d6d0bc8e8902 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:00.416654 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984a64c-4fc5-4848-8e72-d6d0bc8e8902 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:00.429931 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 42/86] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:00.430982 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984a64c-4fc5-4848-8e72-d6d0bc8e8902 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:00.473281 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93234f6-4d94-4ab2-a37a-bb5c5531dd7f None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:00.496393 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:00.520891 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e5c05-9b41-49d0-9ce8-90a250da2775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:00.521691 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e5c05-9b41-49d0-9ce8-90a250da2775 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:00.521988 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e5c05-9b41-49d0-9ce8-90a250da2775 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:00.522274 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e5c05-9b41-49d0-9ce8-90a250da2775 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:00.523139 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e5c05-9b41-49d0-9ce8-90a250da2775 None admin] RBAC: Adding query filter params (role.id=eabf42a0387a47218c5ce577dd65f61c, scope.project.id=60a5733a3c634efca6df17f66d53c587, user.id=20a5fed4c1cc4e61a08385f0a1b65924) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:00.523466 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e5c05-9b41-49d0-9ce8-90a250da2775 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:00.524947 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e5c05-9b41-49d0-9ce8-90a250da2775 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:00.537915 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 45/87] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:12:00 2022] GET /identity/v3/role_assignments?user.id=20a5fed4c1cc4e61a08385f0a1b65924&scope.project.id=60a5733a3c634efca6df17f66d53c587&role.id=eabf42a0387a47218c5ce577dd65f61c => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:00.538999 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e5c05-9b41-49d0-9ce8-90a250da2775 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:00.553646 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984a64c-4fc5-4848-8e72-d6d0bc8e8902 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:00.598535 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2099e9-5abc-4f50-8da4-70fe6b100bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:00.599323 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2099e9-5abc-4f50-8da4-70fe6b100bbe None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:00.599513 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2099e9-5abc-4f50-8da4-70fe6b100bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:00.599790 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2099e9-5abc-4f50-8da4-70fe6b100bbe None admin] PATH_INFO: `/v3/projects/60a5733a3c634efca6df17f66d53c587` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:00.601187 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2099e9-5abc-4f50-8da4-70fe6b100bbe None admin] RBAC: Authorizing `identity:get_project(project_id=60a5733a3c634efca6df17f66d53c587)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:00.602818 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2099e9-5abc-4f50-8da4-70fe6b100bbe None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:00.604656 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 43/88] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:00 2022] GET /identity/v3/projects/60a5733a3c634efca6df17f66d53c587 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:00.605628 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2099e9-5abc-4f50-8da4-70fe6b100bbe None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:00.642758 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:00.729549 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e5c05-9b41-49d0-9ce8-90a250da2775 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:00.760657 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2099e9-5abc-4f50-8da4-70fe6b100bbe None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:00.782547 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edbbd6-5a92-4487-910b-1257ec3a3974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:00.783227 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edbbd6-5a92-4487-910b-1257ec3a3974 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:00.783517 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edbbd6-5a92-4487-910b-1257ec3a3974 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:00.783935 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edbbd6-5a92-4487-910b-1257ec3a3974 None admin] PATH_INFO: `/v3/users/20a5fed4c1cc4e61a08385f0a1b65924` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:00.790368 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81edbbd6-5a92-4487-910b-1257ec3a3974 None admin] RBAC: Authorizing `identity:get_user(user_id=20a5fed4c1cc4e61a08385f0a1b65924)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:00.792451 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81edbbd6-5a92-4487-910b-1257ec3a3974 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:00.796009 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:00.796396 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 46/89] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:00 2022] GET /identity/v3/users/20a5fed4c1cc4e61a08385f0a1b65924 => generated 275 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:00.797884 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edbbd6-5a92-4487-910b-1257ec3a3974 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:00.816459 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae300cea-2dab-4164-a8ba-0c79edb3ba28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:00.817095 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae300cea-2dab-4164-a8ba-0c79edb3ba28 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:00.817487 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae300cea-2dab-4164-a8ba-0c79edb3ba28 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:00.817774 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae300cea-2dab-4164-a8ba-0c79edb3ba28 None admin] PATH_INFO: `/v3/users/20a5fed4c1cc4e61a08385f0a1b65924` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:00.820121 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae300cea-2dab-4164-a8ba-0c79edb3ba28 None admin] RBAC: Authorizing `identity:get_user(user_id=20a5fed4c1cc4e61a08385f0a1b65924)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:00.821665 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae300cea-2dab-4164-a8ba-0c79edb3ba28 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:00.824897 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 44/90] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:00 2022] GET /identity/v3/users/20a5fed4c1cc4e61a08385f0a1b65924 => generated 275 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:00.826649 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae300cea-2dab-4164-a8ba-0c79edb3ba28 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:01.011371 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edbbd6-5a92-4487-910b-1257ec3a3974 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:01.035172 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:01.053110 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95144566-0b22-48de-8b9f-bd88f1782721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:01.053846 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95144566-0b22-48de-8b9f-bd88f1782721 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:01.054132 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95144566-0b22-48de-8b9f-bd88f1782721 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:01.054410 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95144566-0b22-48de-8b9f-bd88f1782721 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:01.055617 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95144566-0b22-48de-8b9f-bd88f1782721 None admin] RBAC: Adding query filter params (role.id=e806ce849cf34b92979b5524f3ea9ff6, scope.project.id=60a5733a3c634efca6df17f66d53c587, user.id=3713f38f8dcb48a58e22f5fcfa10c524) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:01.055984 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95144566-0b22-48de-8b9f-bd88f1782721 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:01.057497 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95144566-0b22-48de-8b9f-bd88f1782721 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:01.057779 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae300cea-2dab-4164-a8ba-0c79edb3ba28 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:01.065425 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 47/91] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:12:00 2022] GET /identity/v3/role_assignments?user.id=3713f38f8dcb48a58e22f5fcfa10c524&scope.project.id=60a5733a3c634efca6df17f66d53c587&role.id=e806ce849cf34b92979b5524f3ea9ff6 => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:01.066592 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95144566-0b22-48de-8b9f-bd88f1782721 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:01.150460 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73da85-d280-4e42-86ba-f337c629cbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:01.151187 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73da85-d280-4e42-86ba-f337c629cbf8 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:01.151533 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73da85-d280-4e42-86ba-f337c629cbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:01.151853 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73da85-d280-4e42-86ba-f337c629cbf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:01.227784 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95144566-0b22-48de-8b9f-bd88f1782721 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:01.269760 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:01.291561 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73da85-d280-4e42-86ba-f337c629cbf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:01.294133 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73da85-d280-4e42-86ba-f337c629cbf8 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:01.339774 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775a7ba-311e-4fba-a4a6-f9399738a995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:01.340770 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775a7ba-311e-4fba-a4a6-f9399738a995 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:01.341880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775a7ba-311e-4fba-a4a6-f9399738a995 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:01.342360 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775a7ba-311e-4fba-a4a6-f9399738a995 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:01.438510 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:01.499714 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775a7ba-311e-4fba-a4a6-f9399738a995 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:01.501319 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775a7ba-311e-4fba-a4a6-f9399738a995 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:01.549467 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 45/92] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 724 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:01.558542 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73da85-d280-4e42-86ba-f337c629cbf8 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:01.713284 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 48/93] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:01.722789 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775a7ba-311e-4fba-a4a6-f9399738a995 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:01.752909 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:01.779235 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73da85-d280-4e42-86ba-f337c629cbf8 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:01.887445 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6973ade-8d33-412a-bad5-c7f88c860876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:01.888196 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6973ade-8d33-412a-bad5-c7f88c860876 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:01.888600 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6973ade-8d33-412a-bad5-c7f88c860876 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:01.889109 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6973ade-8d33-412a-bad5-c7f88c860876 None admin] PATH_INFO: `/v3/projects/60a5733a3c634efca6df17f66d53c587` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:01.892734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6973ade-8d33-412a-bad5-c7f88c860876 None admin] RBAC: Authorizing `identity:get_project(project_id=60a5733a3c634efca6df17f66d53c587)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:01.894258 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6973ade-8d33-412a-bad5-c7f88c860876 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:01.895977 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 46/94] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:01 2022] GET /identity/v3/projects/60a5733a3c634efca6df17f66d53c587 => generated 298 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:01.902773 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:01.902940 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6973ade-8d33-412a-bad5-c7f88c860876 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:01.974628 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775a7ba-311e-4fba-a4a6-f9399738a995 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:02.066484 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0d63e-9ebf-45ea-a854-bcad2abd7bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:02.067178 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0d63e-9ebf-45ea-a854-bcad2abd7bcd None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:02.067478 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0d63e-9ebf-45ea-a854-bcad2abd7bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:02.067759 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0d63e-9ebf-45ea-a854-bcad2abd7bcd None admin] PATH_INFO: `/v3/projects/798a38ebdada476aa5f9aca24023d7ce` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:02.069515 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f0d63e-9ebf-45ea-a854-bcad2abd7bcd None admin] RBAC: Authorizing `identity:get_project(project_id=798a38ebdada476aa5f9aca24023d7ce)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:02.071003 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f0d63e-9ebf-45ea-a854-bcad2abd7bcd None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:02.072861 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 49/95] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:01 2022] GET /identity/v3/projects/798a38ebdada476aa5f9aca24023d7ce => generated 312 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:02.082736 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0d63e-9ebf-45ea-a854-bcad2abd7bcd None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:02.156797 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6973ade-8d33-412a-bad5-c7f88c860876 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:02.257861 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6290d221-565a-43a6-922f-c72031d7b0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:02.258418 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290d221-565a-43a6-922f-c72031d7b0a0 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:02.258702 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290d221-565a-43a6-922f-c72031d7b0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:02.258975 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290d221-565a-43a6-922f-c72031d7b0a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:02.259719 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6290d221-565a-43a6-922f-c72031d7b0a0 None admin] RBAC: Adding query filter params (role.id=a0449d430ec54adcabb96193af2f7cd5, scope.project.id=60a5733a3c634efca6df17f66d53c587, user.id=20a5fed4c1cc4e61a08385f0a1b65924) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:02.260034 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6290d221-565a-43a6-922f-c72031d7b0a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:02.261531 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6290d221-565a-43a6-922f-c72031d7b0a0 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:02.278474 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 47/96] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:12:01 2022] GET /identity/v3/role_assignments?user.id=20a5fed4c1cc4e61a08385f0a1b65924&scope.project.id=60a5733a3c634efca6df17f66d53c587&role.id=a0449d430ec54adcabb96193af2f7cd5 => generated 259 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:02.280988 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e8150-7b04-492a-929b-ff9996e0a519 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:02.281284 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e8150-7b04-492a-929b-ff9996e0a519 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:02.281594 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e8150-7b04-492a-929b-ff9996e0a519 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:02.282961 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 48/97] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:02.290653 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c16c93-2b08-4e93-9eb9-14fc70e25f1e None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:02.290960 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c16c93-2b08-4e93-9eb9-14fc70e25f1e None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:02.291247 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c16c93-2b08-4e93-9eb9-14fc70e25f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:02.335812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0d63e-9ebf-45ea-a854-bcad2abd7bcd None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:02.340182 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-f4c16c93-2b08-4e93-9eb9-14fc70e25f1e None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:02.341554 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-f4c16c93-2b08-4e93-9eb9-14fc70e25f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:02.387042 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:02.406079 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2ce0d-37cf-4594-8c85-c331cfd7ea97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:02.406728 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2ce0d-37cf-4594-8c85-c331cfd7ea97 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:02.407019 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2ce0d-37cf-4594-8c85-c331cfd7ea97 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:02.407299 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2ce0d-37cf-4594-8c85-c331cfd7ea97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:02.410125 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2ce0d-37cf-4594-8c85-c331cfd7ea97 None admin] RBAC: Adding query filter params (role.id=eabf42a0387a47218c5ce577dd65f61c, scope.project.id=798a38ebdada476aa5f9aca24023d7ce, user.id=20a5fed4c1cc4e61a08385f0a1b65924) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:02.410450 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2ce0d-37cf-4594-8c85-c331cfd7ea97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:02.414383 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2ce0d-37cf-4594-8c85-c331cfd7ea97 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:02.426753 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 50/98] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:12:02 2022] GET /identity/v3/role_assignments?user.id=20a5fed4c1cc4e61a08385f0a1b65924&scope.project.id=798a38ebdada476aa5f9aca24023d7ce&role.id=eabf42a0387a47218c5ce577dd65f61c => generated 259 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:02.488245 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 49/99] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:02.877616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac58acd-8b5c-4ae5-803f-448a6dd6ec6d None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:02.878155 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac58acd-8b5c-4ae5-803f-448a6dd6ec6d None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:02.878232 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac58acd-8b5c-4ae5-803f-448a6dd6ec6d None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:02.879652 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 51/100] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:02.887359 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68294d24-9843-4196-a36a-e121b286a573 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:02.887925 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68294d24-9843-4196-a36a-e121b286a573 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:02.887925 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68294d24-9843-4196-a36a-e121b286a573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:02.914510 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac58acd-8b5c-4ae5-803f-448a6dd6ec6d None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:02.924375 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:02.934559 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-68294d24-9843-4196-a36a-e121b286a573 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:02.936393 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-68294d24-9843-4196-a36a-e121b286a573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:03.065489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 50/101] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:12:03.117325 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac58acd-8b5c-4ae5-803f-448a6dd6ec6d None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:03.157444 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0815d-19a8-4743-b903-f5f377b2dfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:03.158172 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0815d-19a8-4743-b903-f5f377b2dfb8 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:03.158462 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0815d-19a8-4743-b903-f5f377b2dfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:03.158744 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0815d-19a8-4743-b903-f5f377b2dfb8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:03.178326 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0815d-19a8-4743-b903-f5f377b2dfb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:03.183255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-dec0815d-19a8-4743-b903-f5f377b2dfb8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:12:03.183255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:03.183255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:03.183255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:03.183255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:03.183255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:03.183255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:03.183255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:03.183255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:03.183255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:03.183255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:03.183255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:03.183255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:03.183255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:03.183255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:03.183255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:03.185319 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:03.185319 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:03.185319 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:03.185319 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:03.185319 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:03.185319 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:03.185319 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:03.185319 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:03.185319 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:03.185319 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:03.185319 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:03.185319 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:03.185319 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:03.185319 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:03.185319 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:03.185319 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:03.187721 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:03.187721 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:03.187721 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:03.187721 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:03.187721 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:03.187721 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:03.187721 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:03.187721 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:03.187721 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:03.187721 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:03.187721 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:12:03.187721 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:12:03.187721 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 52/102] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:03.193394 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68294d24-9843-4196-a36a-e121b286a573 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:03.297809 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:03.315652 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68294d24-9843-4196-a36a-e121b286a573 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:03.358951 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89f20f-fb93-4f6a-84d3-5f7ece1ad16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:03.359575 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89f20f-fb93-4f6a-84d3-5f7ece1ad16b None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:03.359861 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89f20f-fb93-4f6a-84d3-5f7ece1ad16b None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:03.360138 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89f20f-fb93-4f6a-84d3-5f7ece1ad16b None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:03.360822 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89f20f-fb93-4f6a-84d3-5f7ece1ad16b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:03.361130 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89f20f-fb93-4f6a-84d3-5f7ece1ad16b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:03.362613 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89f20f-fb93-4f6a-84d3-5f7ece1ad16b None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:03.371771 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 51/103] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:03.377445 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0815d-19a8-4743-b903-f5f377b2dfb8 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:03.393114 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f47cb5-57bb-490b-a456-e194658eb496 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:03.393449 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f47cb5-57bb-490b-a456-e194658eb496 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:03.393708 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f47cb5-57bb-490b-a456-e194658eb496 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:03.396094 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 52/104] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:12:03.412811 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879800f-48f4-47e3-aecb-a096a263e769 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:03.413164 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879800f-48f4-47e3-aecb-a096a263e769 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:03.413477 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879800f-48f4-47e3-aecb-a096a263e769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:03.442611 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-0879800f-48f4-47e3-aecb-a096a263e769 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:03.444673 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-0879800f-48f4-47e3-aecb-a096a263e769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:03.509900 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:03.542483 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0815d-19a8-4743-b903-f5f377b2dfb8 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:03.582301 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 53/105] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 23 22:12:03.584188 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879800f-48f4-47e3-aecb-a096a263e769 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:03.587871 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9919cf-cd63-4bcb-ac90-220583359e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:03.588542 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9919cf-cd63-4bcb-ac90-220583359e93 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:03.588826 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9919cf-cd63-4bcb-ac90-220583359e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:03.589105 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9919cf-cd63-4bcb-ac90-220583359e93 None admin] PATH_INFO: `/v3/users/257c6b0c67bc4baab9553aba85f9577c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:03.625040 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9919cf-cd63-4bcb-ac90-220583359e93 None admin] RBAC: Authorizing `identity:get_user(user_id=257c6b0c67bc4baab9553aba85f9577c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:03.626642 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9919cf-cd63-4bcb-ac90-220583359e93 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:03.633557 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 53/106] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:03 2022] GET /identity/v3/users/257c6b0c67bc4baab9553aba85f9577c => generated 289 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:03.637012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9919cf-cd63-4bcb-ac90-220583359e93 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:03.703188 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:03.732063 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879800f-48f4-47e3-aecb-a096a263e769 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:03.770302 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ef553-67b7-4134-8fd4-fe2e95aecacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:03.771169 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ef553-67b7-4134-8fd4-fe2e95aecacd None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:03.771461 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ef553-67b7-4134-8fd4-fe2e95aecacd None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:03.771736 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ef553-67b7-4134-8fd4-fe2e95aecacd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:03.782545 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ef553-67b7-4134-8fd4-fe2e95aecacd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:03.784642 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ef553-67b7-4134-8fd4-fe2e95aecacd None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:03.786498 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 54/107] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:03.798477 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ef553-67b7-4134-8fd4-fe2e95aecacd None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:03.947646 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9919cf-cd63-4bcb-ac90-220583359e93 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:03.973806 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ef553-67b7-4134-8fd4-fe2e95aecacd None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:04.011291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d76e8-0a02-4cd5-a6b5-52d34657aa4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:04.011926 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d76e8-0a02-4cd5-a6b5-52d34657aa4d None admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:04.012209 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d76e8-0a02-4cd5-a6b5-52d34657aa4d None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:04.012485 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d76e8-0a02-4cd5-a6b5-52d34657aa4d None admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:04.013771 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d76e8-0a02-4cd5-a6b5-52d34657aa4d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:04.015250 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d76e8-0a02-4cd5-a6b5-52d34657aa4d None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:04.027984 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:04.033966 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:04.053966 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 55/108] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Aug 23 22:12:03 2022] POST /identity/v3/projects => generated 302 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:12:04.055280 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac46b06-f851-402d-959e-4f53e3f579a4 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:04.055573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac46b06-f851-402d-959e-4f53e3f579a4 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:04.055858 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac46b06-f851-402d-959e-4f53e3f579a4 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:04.056824 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60650712-250c-4b4c-8728-569208c873c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:04.057534 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 56/109] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:04.057644 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60650712-250c-4b4c-8728-569208c873c5 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:04.058070 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60650712-250c-4b4c-8728-569208c873c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:04.058295 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac46b06-f851-402d-959e-4f53e3f579a4 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:04.058536 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60650712-250c-4b4c-8728-569208c873c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:04.213534 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac46b06-f851-402d-959e-4f53e3f579a4 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:04.233271 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60650712-250c-4b4c-8728-569208c873c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:04.235038 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60650712-250c-4b4c-8728-569208c873c5 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:04.289943 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f702e-c384-4f8e-82bc-ca6e1661d34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:04.290922 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f702e-c384-4f8e-82bc-ca6e1661d34d None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:04.291345 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f702e-c384-4f8e-82bc-ca6e1661d34d None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:04.291808 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f702e-c384-4f8e-82bc-ca6e1661d34d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:04.325345 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f702e-c384-4f8e-82bc-ca6e1661d34d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:04.331004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-ea4f702e-c384-4f8e-82bc-ca6e1661d34d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:04.331004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:04.331004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:04.331004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:04.331004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:04.331004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:04.331004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:04.331004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:04.331004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:04.331004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:04.331004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:04.331004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:04.331004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:04.331004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:04.331004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:04.331004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:04.331985 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:04.331985 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:04.331985 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:04.331985 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:04.331985 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:04.331985 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:04.331985 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:04.331985 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:04.331985 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:04.331985 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:04.331985 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:04.331985 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:04.331985 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:04.331985 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:04.331985 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:04.331985 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:04.332740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:04.332740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:04.332740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:04.332740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:04.332740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:04.332740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:04.332740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:04.332740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:04.332740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:04.332740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:04.332740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:04.332740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:12:04.332740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 57/110] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:04.336189 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e92ab-5f79-462c-8569-eba3b3e0e0a1 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:04.336189 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e92ab-5f79-462c-8569-eba3b3e0e0a1 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:04.336189 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e92ab-5f79-462c-8569-eba3b3e0e0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:04.354356 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-a91e92ab-5f79-462c-8569-eba3b3e0e0a1 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:04.355593 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-a91e92ab-5f79-462c-8569-eba3b3e0e0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:04.382039 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 54/111] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 745 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:04.383264 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60650712-250c-4b4c-8728-569208c873c5 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:04.424463 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:04.427866 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:04.454180 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 58/112] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:04.455059 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e92ab-5f79-462c-8569-eba3b3e0e0a1 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:04.526396 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60650712-250c-4b4c-8728-569208c873c5 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:04.610592 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209aeac-cc58-400b-a4aa-4ba21df2437b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:04.611537 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209aeac-cc58-400b-a4aa-4ba21df2437b None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:04.611829 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209aeac-cc58-400b-a4aa-4ba21df2437b None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:04.612128 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209aeac-cc58-400b-a4aa-4ba21df2437b None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:04.613021 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3209aeac-cc58-400b-a4aa-4ba21df2437b None admin] RBAC: Adding query filter params (name=member) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:04.613340 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3209aeac-cc58-400b-a4aa-4ba21df2437b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:04.615350 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3209aeac-cc58-400b-a4aa-4ba21df2437b None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:04.637067 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 55/113] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:04.644242 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209aeac-cc58-400b-a4aa-4ba21df2437b None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:04.778860 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e92ab-5f79-462c-8569-eba3b3e0e0a1 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:04.844558 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:04.850908 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d91b04-57d2-400c-b946-6384a200254e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:04.851570 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d91b04-57d2-400c-b946-6384a200254e None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:04.851852 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d91b04-57d2-400c-b946-6384a200254e None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:04.852128 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d91b04-57d2-400c-b946-6384a200254e None admin] PATH_INFO: `/v3/projects/60a5733a3c634efca6df17f66d53c587` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:04.853974 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d91b04-57d2-400c-b946-6384a200254e None admin] RBAC: Authorizing `identity:get_project(project_id=60a5733a3c634efca6df17f66d53c587)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:04.855594 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d91b04-57d2-400c-b946-6384a200254e None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:04.858006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 59/114] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:04 2022] GET /identity/v3/projects/60a5733a3c634efca6df17f66d53c587 => generated 298 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:04.859204 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d91b04-57d2-400c-b946-6384a200254e None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:04.892238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209aeac-cc58-400b-a4aa-4ba21df2437b None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:04.960955 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cd6f3-ccd4-4629-9188-324f8e29a057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:04.961708 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cd6f3-ccd4-4629-9188-324f8e29a057 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:04.962060 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cd6f3-ccd4-4629-9188-324f8e29a057 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:04.962416 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cd6f3-ccd4-4629-9188-324f8e29a057 None admin] PATH_INFO: `/v3/users/20a5fed4c1cc4e61a08385f0a1b65924` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:04.963732 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504cd6f3-ccd4-4629-9188-324f8e29a057 None admin] RBAC: Authorizing `identity:get_user(user_id=20a5fed4c1cc4e61a08385f0a1b65924)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:04.965359 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504cd6f3-ccd4-4629-9188-324f8e29a057 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:04.968162 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 56/115] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:04 2022] GET /identity/v3/users/20a5fed4c1cc4e61a08385f0a1b65924 => generated 275 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:04.969249 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cd6f3-ccd4-4629-9188-324f8e29a057 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:04.976416 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:05.082763 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d91b04-57d2-400c-b946-6384a200254e None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:05.090614 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cd6f3-ccd4-4629-9188-324f8e29a057 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:05.153400 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbbf1e-3b1f-44ca-874a-c6967b841b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:05.154089 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbbf1e-3b1f-44ca-874a-c6967b841b1d None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:05.154369 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbbf1e-3b1f-44ca-874a-c6967b841b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:05.154643 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbbf1e-3b1f-44ca-874a-c6967b841b1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:05.156419 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39150ff4-f9eb-473c-ae76-d0560d2b88c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:05.157031 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39150ff4-f9eb-473c-ae76-d0560d2b88c9 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:05.157310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39150ff4-f9eb-473c-ae76-d0560d2b88c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:05.157607 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39150ff4-f9eb-473c-ae76-d0560d2b88c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:05.158343 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39150ff4-f9eb-473c-ae76-d0560d2b88c9 None admin] RBAC: Adding query filter params (role.id=6eb34cd17388449f9099dd83fb076032, scope.project.id=60a5733a3c634efca6df17f66d53c587, user.id=257c6b0c67bc4baab9553aba85f9577c) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:05.158651 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39150ff4-f9eb-473c-ae76-d0560d2b88c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:05.160124 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39150ff4-f9eb-473c-ae76-d0560d2b88c9 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:05.173353 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 57/116] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:12:04 2022] GET /identity/v3/role_assignments?user.id=257c6b0c67bc4baab9553aba85f9577c&scope.project.id=60a5733a3c634efca6df17f66d53c587&role.id=6eb34cd17388449f9099dd83fb076032 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:05.174264 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39150ff4-f9eb-473c-ae76-d0560d2b88c9 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:05.182973 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dbbf1e-3b1f-44ca-874a-c6967b841b1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:05.189262 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-00dbbf1e-3b1f-44ca-874a-c6967b841b1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:12:05.189262 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:05.189262 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:05.189262 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:05.189262 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:05.189262 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:05.189262 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:05.189262 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:05.189262 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:05.189262 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:05.189262 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:05.189262 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:05.189262 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:05.189262 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:05.189262 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:05.189262 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:05.190243 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:05.190243 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:05.190243 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:05.190243 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:05.190243 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:05.190243 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:05.190243 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:05.190243 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:05.190243 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:05.190243 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:05.190243 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:05.190243 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:05.190243 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:05.190243 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:05.190243 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:05.190243 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:05.191010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:05.191010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:05.191010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:05.191010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:05.191010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:05.191010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:05.191010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:05.191010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:05.191010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:05.191010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:05.191010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:12:05.191010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:12:05.191010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 60/117] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:12:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:05.209579 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbbf1e-3b1f-44ca-874a-c6967b841b1d None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:05.251812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:05.390475 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbbf1e-3b1f-44ca-874a-c6967b841b1d None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:05.416717 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:05.449086 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39150ff4-f9eb-473c-ae76-d0560d2b88c9 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:05.456991 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc5a2f-20b2-4c8d-a5ce-7bbd9bede519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:05.457650 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc5a2f-20b2-4c8d-a5ce-7bbd9bede519 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:05.457934 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc5a2f-20b2-4c8d-a5ce-7bbd9bede519 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:05.458210 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc5a2f-20b2-4c8d-a5ce-7bbd9bede519 None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:05.458890 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc5a2f-20b2-4c8d-a5ce-7bbd9bede519 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:05.459195 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc5a2f-20b2-4c8d-a5ce-7bbd9bede519 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:05.460660 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc5a2f-20b2-4c8d-a5ce-7bbd9bede519 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:05.476597 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 61/118] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:05.482675 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1161f-8c12-47e8-9196-086f5f071e05 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:05.482996 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1161f-8c12-47e8-9196-086f5f071e05 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:05.483258 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1161f-8c12-47e8-9196-086f5f071e05 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:05.484870 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 62/119] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:05.487432 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6907d6-8184-4692-8ad7-d9f926411fdb None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:05.487692 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6907d6-8184-4692-8ad7-d9f926411fdb None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:05.489470 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6907d6-8184-4692-8ad7-d9f926411fdb None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:05.490227 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 63/120] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:05.490961 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6907d6-8184-4692-8ad7-d9f926411fdb None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:05.503553 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a79571-3259-4d65-b788-8a8763660aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:05.504697 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a79571-3259-4d65-b788-8a8763660aee None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:05.505343 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a79571-3259-4d65-b788-8a8763660aee None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:05.505876 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a79571-3259-4d65-b788-8a8763660aee None admin] PATH_INFO: `/v3/projects/60a5733a3c634efca6df17f66d53c587` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:05.507851 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a79571-3259-4d65-b788-8a8763660aee None admin] RBAC: Authorizing `identity:get_project(project_id=60a5733a3c634efca6df17f66d53c587)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:05.509823 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a79571-3259-4d65-b788-8a8763660aee None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:05.511924 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 58/121] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:05 2022] GET /identity/v3/projects/60a5733a3c634efca6df17f66d53c587 => generated 298 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:05.514163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc0add-4b49-4bed-b5a3-baadd8df6ac0 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:05.514699 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc0add-4b49-4bed-b5a3-baadd8df6ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:05.515193 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc0add-4b49-4bed-b5a3-baadd8df6ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:05.536406 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-62dc0add-4b49-4bed-b5a3-baadd8df6ac0 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:05.538064 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-62dc0add-4b49-4bed-b5a3-baadd8df6ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:05.618247 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6907d6-8184-4692-8ad7-d9f926411fdb None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:05.631297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 59/122] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:05.631297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd854a9-6885-4c8f-8b4f-19519173c8ff None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:05.631297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd854a9-6885-4c8f-8b4f-19519173c8ff None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:05.631297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd854a9-6885-4c8f-8b4f-19519173c8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:05.650831 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-ffd854a9-6885-4c8f-8b4f-19519173c8ff None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:05.652113 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-ffd854a9-6885-4c8f-8b4f-19519173c8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:05.669883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:05.706541 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510301d-0ece-4ae9-b133-7bde176b38d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:05.707533 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510301d-0ece-4ae9-b133-7bde176b38d3 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:05.707982 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510301d-0ece-4ae9-b133-7bde176b38d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:05.708395 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510301d-0ece-4ae9-b133-7bde176b38d3 None admin] PATH_INFO: `/v3/users/3713f38f8dcb48a58e22f5fcfa10c524` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:05.710532 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510301d-0ece-4ae9-b133-7bde176b38d3 None admin] RBAC: Authorizing `identity:get_user(user_id=3713f38f8dcb48a58e22f5fcfa10c524)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:05.712249 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510301d-0ece-4ae9-b133-7bde176b38d3 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:05.714320 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 64/123] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:05 2022] GET /identity/v3/users/3713f38f8dcb48a58e22f5fcfa10c524 => generated 247 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:05.715238 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510301d-0ece-4ae9-b133-7bde176b38d3 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:05.732742 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 60/124] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:05.733482 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd854a9-6885-4c8f-8b4f-19519173c8ff None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:05.833236 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:05.849030 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd854a9-6885-4c8f-8b4f-19519173c8ff None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:05.885804 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ecee05-96ba-4abc-baf7-0a34e4a59cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:05.886454 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ecee05-96ba-4abc-baf7-0a34e4a59cc3 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:05.886740 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ecee05-96ba-4abc-baf7-0a34e4a59cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:05.887022 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ecee05-96ba-4abc-baf7-0a34e4a59cc3 None admin] PATH_INFO: `/v3/projects/60a5733a3c634efca6df17f66d53c587` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:05.888212 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ecee05-96ba-4abc-baf7-0a34e4a59cc3 None admin] RBAC: Authorizing `identity:get_project(project_id=60a5733a3c634efca6df17f66d53c587)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:05.890190 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ecee05-96ba-4abc-baf7-0a34e4a59cc3 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:05.897656 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 61/125] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:05 2022] GET /identity/v3/projects/60a5733a3c634efca6df17f66d53c587 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:05.903942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ecee05-96ba-4abc-baf7-0a34e4a59cc3 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:05.949757 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:05.976081 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510301d-0ece-4ae9-b133-7bde176b38d3 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:06.039044 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaab863-1efc-4162-9914-f290f9303094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:06.039810 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaab863-1efc-4162-9914-f290f9303094 None admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:06.040062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaab863-1efc-4162-9914-f290f9303094 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:06.040297 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaab863-1efc-4162-9914-f290f9303094 None admin] PATH_INFO: `/v3/projects/60a5733a3c634efca6df17f66d53c587/users/20a5fed4c1cc4e61a08385f0a1b65924/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:06.046903 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaab863-1efc-4162-9914-f290f9303094 None admin] RBAC: Authorizing `identity:create_grant(project_id=60a5733a3c634efca6df17f66d53c587, user_id=20a5fed4c1cc4e61a08385f0a1b65924, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:06.048414 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaab863-1efc-4162-9914-f290f9303094 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:06.063881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ecee05-96ba-4abc-baf7-0a34e4a59cc3 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:06.081580 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 65/126] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Aug 23 22:12:05 2022] PUT /identity/v3/projects/60a5733a3c634efca6df17f66d53c587/users/20a5fed4c1cc4e61a08385f0a1b65924/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:12:06.104954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaab863-1efc-4162-9914-f290f9303094 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:06.105306 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe24049-ad93-46c9-b1cf-f54dd4cc4f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:06.106014 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe24049-ad93-46c9-b1cf-f54dd4cc4f85 None admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:06.106298 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe24049-ad93-46c9-b1cf-f54dd4cc4f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:06.106572 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe24049-ad93-46c9-b1cf-f54dd4cc4f85 None admin] PATH_INFO: `/v3/projects/60a5733a3c634efca6df17f66d53c587/users/3713f38f8dcb48a58e22f5fcfa10c524/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:06.109355 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe24049-ad93-46c9-b1cf-f54dd4cc4f85 None admin] RBAC: Authorizing `identity:create_grant(project_id=60a5733a3c634efca6df17f66d53c587, user_id=3713f38f8dcb48a58e22f5fcfa10c524, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:06.110890 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe24049-ad93-46c9-b1cf-f54dd4cc4f85 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:06.131890 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 62/127] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Aug 23 22:12:05 2022] PUT /identity/v3/projects/60a5733a3c634efca6df17f66d53c587/users/3713f38f8dcb48a58e22f5fcfa10c524/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:12:06.276613 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaab863-1efc-4162-9914-f290f9303094 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:06.280559 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:06.314896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe24049-ad93-46c9-b1cf-f54dd4cc4f85 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:06.343724 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49287e-e838-4c15-9d7b-8d7296b56f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:06.345089 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49287e-e838-4c15-9d7b-8d7296b56f97 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:06.345626 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49287e-e838-4c15-9d7b-8d7296b56f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:06.346080 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49287e-e838-4c15-9d7b-8d7296b56f97 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:06.363705 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae49287e-e838-4c15-9d7b-8d7296b56f97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:06.371353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-ae49287e-e838-4c15-9d7b-8d7296b56f97 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:12:06.371353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:06.371353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:06.371353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:06.371353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:06.371353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:06.371353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:06.371353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:06.371353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:06.371353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:06.371353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:06.371353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:06.371353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:06.371353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:06.371353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:06.371353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:06.372311 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:06.372311 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:06.372311 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:06.372311 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:06.372311 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:06.372311 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:06.372311 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:06.372311 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:06.372311 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:06.372311 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:06.372311 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:06.372311 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:06.372311 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:06.372311 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:06.372311 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:06.372311 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:06.373114 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:06.373114 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:06.373114 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:06.373114 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:06.373114 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:06.373114 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:06.373114 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:06.373114 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:06.373114 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:06.373114 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:06.373114 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:12:06.373114 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:12:06.376371 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 66/128] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Aug 23 22:12:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:12:06.385897 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49287e-e838-4c15-9d7b-8d7296b56f97 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:06.458052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:06.494173 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe24049-ad93-46c9-b1cf-f54dd4cc4f85 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:06.534575 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49287e-e838-4c15-9d7b-8d7296b56f97 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:06.550242 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773be4e-3bf5-48fc-a441-1f4412a84495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:06.551322 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773be4e-3bf5-48fc-a441-1f4412a84495 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:06.551847 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773be4e-3bf5-48fc-a441-1f4412a84495 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:06.552285 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773be4e-3bf5-48fc-a441-1f4412a84495 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:06.568159 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773be4e-3bf5-48fc-a441-1f4412a84495 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:06.577893 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-e773be4e-3bf5-48fc-a441-1f4412a84495 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:06.577893 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:06.577893 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:06.577893 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:06.577893 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:06.577893 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:06.577893 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:06.577893 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:06.577893 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:06.577893 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:06.577893 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:06.577893 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:06.577893 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:06.577893 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:06.577893 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:06.577893 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:06.579729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:06.579729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:06.579729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:06.579729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:06.579729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:06.579729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:06.579729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:06.579729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:06.579729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:06.579729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:06.579729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:06.579729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:06.579729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:06.579729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:06.579729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:06.579729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:06.580700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:06.580700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:06.580700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:06.580700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:06.580700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:06.580700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:06.580700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:06.580700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:06.580700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:06.580700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:06.580700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:06.580700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:12:06.581866 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803d34d-728d-44d5-921e-c8a60cc962c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:06.582585 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803d34d-728d-44d5-921e-c8a60cc962c6 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:06.582869 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803d34d-728d-44d5-921e-c8a60cc962c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:06.583151 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803d34d-728d-44d5-921e-c8a60cc962c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:06.583818 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 63/129] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:12:06.583914 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803d34d-728d-44d5-921e-c8a60cc962c6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:06.584142 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803d34d-728d-44d5-921e-c8a60cc962c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:06.587047 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803d34d-728d-44d5-921e-c8a60cc962c6 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:06.590520 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773be4e-3bf5-48fc-a441-1f4412a84495 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:06.597310 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 67/130] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:12:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:06.606138 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803d34d-728d-44d5-921e-c8a60cc962c6 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:06.649419 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:06.731863 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773be4e-3bf5-48fc-a441-1f4412a84495 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:06.782062 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bc928-fb0c-49e1-9dc1-19af4451541e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:06.783725 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bc928-fb0c-49e1-9dc1-19af4451541e None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:06.784371 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bc928-fb0c-49e1-9dc1-19af4451541e None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:06.785956 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bc928-fb0c-49e1-9dc1-19af4451541e None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:06.787049 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2bc928-fb0c-49e1-9dc1-19af4451541e None admin] RBAC: Adding query filter params (name=member) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:06.789964 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2bc928-fb0c-49e1-9dc1-19af4451541e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:06.792198 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2bc928-fb0c-49e1-9dc1-19af4451541e None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:06.796294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:06.812991 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 64/131] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:06.818836 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803d34d-728d-44d5-921e-c8a60cc962c6 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:06.821283 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bc928-fb0c-49e1-9dc1-19af4451541e None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:06.922893 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af210b59-2e34-4417-9d53-6546409b5123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:06.923554 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af210b59-2e34-4417-9d53-6546409b5123 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:06.923837 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af210b59-2e34-4417-9d53-6546409b5123 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:06.924112 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af210b59-2e34-4417-9d53-6546409b5123 None admin] PATH_INFO: `/v3/users/20a5fed4c1cc4e61a08385f0a1b65924` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:06.927780 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af210b59-2e34-4417-9d53-6546409b5123 None admin] RBAC: Authorizing `identity:get_user(user_id=20a5fed4c1cc4e61a08385f0a1b65924)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:06.929399 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af210b59-2e34-4417-9d53-6546409b5123 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:06.931142 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 68/132] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:06 2022] GET /identity/v3/users/20a5fed4c1cc4e61a08385f0a1b65924 => generated 275 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:06.938769 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af210b59-2e34-4417-9d53-6546409b5123 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:07.087448 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bc928-fb0c-49e1-9dc1-19af4451541e None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:07.101419 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:07.115560 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af210b59-2e34-4417-9d53-6546409b5123 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:07.174851 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fee720-24a8-4a0e-a06d-2b75e252186a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:07.175523 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fee720-24a8-4a0e-a06d-2b75e252186a None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:07.175818 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fee720-24a8-4a0e-a06d-2b75e252186a None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:07.176148 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fee720-24a8-4a0e-a06d-2b75e252186a None admin] PATH_INFO: `/v3/projects/60a5733a3c634efca6df17f66d53c587` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:07.177429 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fee720-24a8-4a0e-a06d-2b75e252186a None admin] RBAC: Authorizing `identity:get_project(project_id=60a5733a3c634efca6df17f66d53c587)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:07.178925 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fee720-24a8-4a0e-a06d-2b75e252186a None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:07.179783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d1633-d1e0-4a5b-b045-e587bb3d2d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:07.180655 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d1633-d1e0-4a5b-b045-e587bb3d2d4b None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:07.180756 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 69/133] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:06 2022] GET /identity/v3/projects/60a5733a3c634efca6df17f66d53c587 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:07.181236 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d1633-d1e0-4a5b-b045-e587bb3d2d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:07.181746 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d1633-d1e0-4a5b-b045-e587bb3d2d4b None admin] PATH_INFO: `/v3/users/20a5fed4c1cc4e61a08385f0a1b65924` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:07.181909 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c403e30-d108-495a-94e0-20600d78526b None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:07.182193 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c403e30-d108-495a-94e0-20600d78526b None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:07.182475 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c403e30-d108-495a-94e0-20600d78526b None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:07.185834 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 70/134] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:07.187023 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d1633-d1e0-4a5b-b045-e587bb3d2d4b None admin] RBAC: Authorizing `identity:get_user(user_id=20a5fed4c1cc4e61a08385f0a1b65924)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:07.188765 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d1633-d1e0-4a5b-b045-e587bb3d2d4b None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:07.191183 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c403e30-d108-495a-94e0-20600d78526b None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:07.194226 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 65/135] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:06 2022] GET /identity/v3/users/20a5fed4c1cc4e61a08385f0a1b65924 => generated 275 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:07.196633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece66d9-a87f-4367-8a5b-621d29f20c2e None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:07.196932 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece66d9-a87f-4367-8a5b-621d29f20c2e None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:07.197217 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece66d9-a87f-4367-8a5b-621d29f20c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:07.240980 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-2ece66d9-a87f-4367-8a5b-621d29f20c2e None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:07.242267 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-2ece66d9-a87f-4367-8a5b-621d29f20c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:07.350100 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:07.369890 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 66/136] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:07.371173 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece66d9-a87f-4367-8a5b-621d29f20c2e None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:07.439090 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c403e30-d108-495a-94e0-20600d78526b None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:07.517522 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9767040-f40a-4932-8cf3-9c2950118006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:07.518596 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9767040-f40a-4932-8cf3-9c2950118006 None admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:07.519114 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9767040-f40a-4932-8cf3-9c2950118006 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:07.519587 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9767040-f40a-4932-8cf3-9c2950118006 None admin] PATH_INFO: `/v3/projects/60a5733a3c634efca6df17f66d53c587/users/20a5fed4c1cc4e61a08385f0a1b65924/roles/a0449d430ec54adcabb96193af2f7cd5` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:07.527351 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9767040-f40a-4932-8cf3-9c2950118006 None admin] RBAC: Authorizing `identity:create_grant(project_id=60a5733a3c634efca6df17f66d53c587, user_id=20a5fed4c1cc4e61a08385f0a1b65924, role_id=a0449d430ec54adcabb96193af2f7cd5)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:07.529331 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9767040-f40a-4932-8cf3-9c2950118006 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:07.551690 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 71/137] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Aug 23 22:12:07 2022] PUT /identity/v3/projects/60a5733a3c634efca6df17f66d53c587/users/20a5fed4c1cc4e61a08385f0a1b65924/roles/a0449d430ec54adcabb96193af2f7cd5 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:12:07.639531 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece66d9-a87f-4367-8a5b-621d29f20c2e None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:07.725344 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b7e43-58bb-404f-ad05-cd502c506af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:07.726400 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b7e43-58bb-404f-ad05-cd502c506af9 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:07.727058 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b7e43-58bb-404f-ad05-cd502c506af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:07.727703 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b7e43-58bb-404f-ad05-cd502c506af9 None admin] PATH_INFO: `/v3/projects/798a38ebdada476aa5f9aca24023d7ce` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:07.729628 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b7e43-58bb-404f-ad05-cd502c506af9 None admin] RBAC: Authorizing `identity:get_project(project_id=798a38ebdada476aa5f9aca24023d7ce)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:07.733554 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b7e43-58bb-404f-ad05-cd502c506af9 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:07.736816 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 67/138] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:07 2022] GET /identity/v3/projects/798a38ebdada476aa5f9aca24023d7ce => generated 312 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:07.742890 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9767040-f40a-4932-8cf3-9c2950118006 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:07.788397 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:07.911027 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9767040-f40a-4932-8cf3-9c2950118006 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:07.947011 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027a815-7e02-4e60-a352-105c70c2a177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:07.947704 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027a815-7e02-4e60-a352-105c70c2a177 None admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:07.947964 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027a815-7e02-4e60-a352-105c70c2a177 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:07.948231 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027a815-7e02-4e60-a352-105c70c2a177 None admin] PATH_INFO: `/v3/projects/798a38ebdada476aa5f9aca24023d7ce/users/20a5fed4c1cc4e61a08385f0a1b65924/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:07.951018 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027a815-7e02-4e60-a352-105c70c2a177 None admin] RBAC: Authorizing `identity:create_grant(project_id=798a38ebdada476aa5f9aca24023d7ce, user_id=20a5fed4c1cc4e61a08385f0a1b65924, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:07.952576 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027a815-7e02-4e60-a352-105c70c2a177 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:07.962896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b7e43-58bb-404f-ad05-cd502c506af9 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:07.971586 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 72/139] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Aug 23 22:12:07 2022] PUT /identity/v3/projects/798a38ebdada476aa5f9aca24023d7ce/users/20a5fed4c1cc4e61a08385f0a1b65924/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:12:08.069633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:08.133831 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b7e43-58bb-404f-ad05-cd502c506af9 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:08.137002 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4c2fc-9646-4687-8cea-8ff95b95c30d None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:08.137553 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4c2fc-9646-4687-8cea-8ff95b95c30d None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:08.137905 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4c2fc-9646-4687-8cea-8ff95b95c30d None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:08.140318 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 73/140] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:12:08.145968 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c4271-b773-497a-a3a6-881873f1da15 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:08.146499 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c4271-b773-497a-a3a6-881873f1da15 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:08.146918 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c4271-b773-497a-a3a6-881873f1da15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:08.182304 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-853c4271-b773-497a-a3a6-881873f1da15 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:08.187488 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-853c4271-b773-497a-a3a6-881873f1da15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:08.211215 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c0011-5fdf-4433-9ab7-c6a7fe2f50a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:08.212280 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c0011-5fdf-4433-9ab7-c6a7fe2f50a6 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:08.212785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c0011-5fdf-4433-9ab7-c6a7fe2f50a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:08.213330 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c0011-5fdf-4433-9ab7-c6a7fe2f50a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:08.217111 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c0011-5fdf-4433-9ab7-c6a7fe2f50a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:08.220572 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c0011-5fdf-4433-9ab7-c6a7fe2f50a6 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:08.224599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 68/141] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:08.230958 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c0011-5fdf-4433-9ab7-c6a7fe2f50a6 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:08.302001 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 74/142] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:12:08.400384 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c0011-5fdf-4433-9ab7-c6a7fe2f50a6 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:08.440613 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:08.448679 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aca95e-4c25-4c94-8574-692b4eb5fc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:08.449439 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aca95e-4c25-4c94-8574-692b4eb5fc5b None admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:08.449739 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aca95e-4c25-4c94-8574-692b4eb5fc5b None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:08.450070 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aca95e-4c25-4c94-8574-692b4eb5fc5b None admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:08.451326 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aca95e-4c25-4c94-8574-692b4eb5fc5b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:08.452932 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aca95e-4c25-4c94-8574-692b4eb5fc5b None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:08.492970 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 69/143] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Aug 23 22:12:08 2022] POST /identity/v3/users => generated 283 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:12:08.816801 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c4271-b773-497a-a3a6-881873f1da15 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:08.838319 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:08.951219 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c4271-b773-497a-a3a6-881873f1da15 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:08.991289 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e54e67-6590-4669-99a1-af6278b852e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:08.991870 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e54e67-6590-4669-99a1-af6278b852e1 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:08.992190 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e54e67-6590-4669-99a1-af6278b852e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:08.992487 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e54e67-6590-4669-99a1-af6278b852e1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:09.005102 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e54e67-6590-4669-99a1-af6278b852e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:09.010156 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-70e54e67-6590-4669-99a1-af6278b852e1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:12:09.010156 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:09.010156 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:09.010156 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:09.010156 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:09.010156 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:09.010156 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:09.010156 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:09.010156 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:09.010156 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:09.010156 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:09.010156 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:09.010156 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:09.010156 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:09.010156 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:09.010156 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:09.011191 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:09.011191 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:09.011191 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:09.011191 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:09.011191 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:09.011191 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:09.011191 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:09.011191 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:09.011191 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:09.011191 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:09.011191 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:09.011191 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:09.011191 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:09.011191 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:09.011191 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:09.011191 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:09.011969 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:09.011969 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:09.011969 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:09.011969 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:09.011969 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:09.011969 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:09.011969 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:09.011969 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:09.011969 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:09.011969 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:09.011969 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:12:09.011969 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:12:09.011969 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 75/144] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:09.018214 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aca95e-4c25-4c94-8574-692b4eb5fc5b None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:09.170617 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aca95e-4c25-4c94-8574-692b4eb5fc5b None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:09.220394 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f57f6a-29b4-46aa-9a08-6c082d8c70c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:09.221033 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f57f6a-29b4-46aa-9a08-6c082d8c70c9 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:09.221322 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f57f6a-29b4-46aa-9a08-6c082d8c70c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:09.221725 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f57f6a-29b4-46aa-9a08-6c082d8c70c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:09.222505 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f57f6a-29b4-46aa-9a08-6c082d8c70c9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:09.222881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f57f6a-29b4-46aa-9a08-6c082d8c70c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:09.224568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f57f6a-29b4-46aa-9a08-6c082d8c70c9 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:09.236271 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 70/145] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:09.242157 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e54e67-6590-4669-99a1-af6278b852e1 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:09.338164 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:09.379841 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e54e67-6590-4669-99a1-af6278b852e1 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:09.422977 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6f1a0-0aff-4a76-b0ef-02c4e5197c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:09.423717 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6f1a0-0aff-4a76-b0ef-02c4e5197c56 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:09.423997 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6f1a0-0aff-4a76-b0ef-02c4e5197c56 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:09.424309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6f1a0-0aff-4a76-b0ef-02c4e5197c56 None admin] PATH_INFO: `/v3/users/257c6b0c67bc4baab9553aba85f9577c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:09.425566 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c6f1a0-0aff-4a76-b0ef-02c4e5197c56 None admin] RBAC: Authorizing `identity:get_user(user_id=257c6b0c67bc4baab9553aba85f9577c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:09.427431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c6f1a0-0aff-4a76-b0ef-02c4e5197c56 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:09.429172 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 76/146] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:09 2022] GET /identity/v3/users/257c6b0c67bc4baab9553aba85f9577c => generated 289 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:09.436459 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f57f6a-29b4-46aa-9a08-6c082d8c70c9 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:09.502191 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:09.547092 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4e26a-54f6-4722-ae2c-c20c42646086 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:09.547412 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4e26a-54f6-4722-ae2c-c20c42646086 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:09.547647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4e26a-54f6-4722-ae2c-c20c42646086 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:09.549125 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 77/147] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:12:09.562935 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063d388-b324-49eb-9eab-98c60b11ebd8 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:09.563271 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063d388-b324-49eb-9eab-98c60b11ebd8 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:09.563507 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063d388-b324-49eb-9eab-98c60b11ebd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:09.577839 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f57f6a-29b4-46aa-9a08-6c082d8c70c9 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:09.589794 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-3063d388-b324-49eb-9eab-98c60b11ebd8 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:09.592213 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-3063d388-b324-49eb-9eab-98c60b11ebd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:09.624898 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569389d-534a-4cef-8453-58e62b6fd1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:09.625590 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569389d-534a-4cef-8453-58e62b6fd1ec None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:09.625875 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569389d-534a-4cef-8453-58e62b6fd1ec None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:09.626152 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569389d-534a-4cef-8453-58e62b6fd1ec None admin] PATH_INFO: `/v3/projects/60a5733a3c634efca6df17f66d53c587` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:09.627421 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4569389d-534a-4cef-8453-58e62b6fd1ec None admin] RBAC: Authorizing `identity:get_project(project_id=60a5733a3c634efca6df17f66d53c587)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:09.629007 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4569389d-534a-4cef-8453-58e62b6fd1ec None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:09.631130 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 71/148] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:09 2022] GET /identity/v3/projects/60a5733a3c634efca6df17f66d53c587 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:09.643314 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569389d-534a-4cef-8453-58e62b6fd1ec None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:09.767568 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 78/149] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:12:09.815477 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569389d-534a-4cef-8453-58e62b6fd1ec None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:09.840934 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:09.873747 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1076feb-07af-4acf-805b-2d733d2fc698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:09.874588 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1076feb-07af-4acf-805b-2d733d2fc698 None admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:09.874873 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1076feb-07af-4acf-805b-2d733d2fc698 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:09.875152 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1076feb-07af-4acf-805b-2d733d2fc698 None admin] PATH_INFO: `/v3/projects/60a5733a3c634efca6df17f66d53c587/users/257c6b0c67bc4baab9553aba85f9577c/roles/6eb34cd17388449f9099dd83fb076032` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:09.879660 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1076feb-07af-4acf-805b-2d733d2fc698 None admin] RBAC: Authorizing `identity:create_grant(project_id=60a5733a3c634efca6df17f66d53c587, user_id=257c6b0c67bc4baab9553aba85f9577c, role_id=6eb34cd17388449f9099dd83fb076032)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:09.881746 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1076feb-07af-4acf-805b-2d733d2fc698 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:09.902363 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 72/150] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Aug 23 22:12:09 2022] PUT /identity/v3/projects/60a5733a3c634efca6df17f66d53c587/users/257c6b0c67bc4baab9553aba85f9577c/roles/6eb34cd17388449f9099dd83fb076032 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:12:09.931088 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e383e-1b78-4550-9ab9-049be57f0cdb None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:09.931408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e383e-1b78-4550-9ab9-049be57f0cdb None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:09.931645 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e383e-1b78-4550-9ab9-049be57f0cdb None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:09.933447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 79/151] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:09.940686 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c4930-0f08-493b-be59-34e898e52538 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:09.940978 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c4930-0f08-493b-be59-34e898e52538 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:09.941258 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c4930-0f08-493b-be59-34e898e52538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:09.967489 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-3e8c4930-0f08-493b-be59-34e898e52538 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:09.968830 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-3e8c4930-0f08-493b-be59-34e898e52538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:10.073922 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 73/152] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:10.417327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e383e-1b78-4550-9ab9-049be57f0cdb None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:10.526119 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:10.568009 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e383e-1b78-4550-9ab9-049be57f0cdb None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:10.621758 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60fc43-a6e2-41c5-9d84-a88ab55570c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:10.622944 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60fc43-a6e2-41c5-9d84-a88ab55570c7 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:10.623300 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60fc43-a6e2-41c5-9d84-a88ab55570c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:10.623801 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60fc43-a6e2-41c5-9d84-a88ab55570c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:10.642376 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60fc43-a6e2-41c5-9d84-a88ab55570c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:10.647422 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-ce60fc43-a6e2-41c5-9d84-a88ab55570c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:10.647422 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:10.647422 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:10.647422 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:10.647422 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:10.647422 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:10.647422 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:10.647422 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:10.647422 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:10.647422 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:10.647422 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:10.647422 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:10.647422 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:10.647422 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:10.647422 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:10.647422 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:10.648269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:10.648269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:10.648269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:10.648269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:10.648269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:10.648269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:10.648269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:10.648269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:10.648269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:10.648269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:10.648269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:10.648269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:10.648269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:10.648269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:10.648269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:10.648269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:10.649107 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:10.649107 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:10.649107 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:10.649107 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:10.649107 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:10.649107 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:10.649107 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:10.649107 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:10.649107 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:10.649107 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:10.649107 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:10.649107 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:12:10.649107 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 80/153] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:10.655940 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c4930-0f08-493b-be59-34e898e52538 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:10.818726 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c4930-0f08-493b-be59-34e898e52538 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:10.832896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:10.873680 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaef706-77e7-4add-a2cc-a9aba2ea36b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:10.874728 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaef706-77e7-4add-a2cc-a9aba2ea36b2 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:10.875203 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaef706-77e7-4add-a2cc-a9aba2ea36b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:10.875688 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaef706-77e7-4add-a2cc-a9aba2ea36b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:10.876561 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaef706-77e7-4add-a2cc-a9aba2ea36b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:10.877055 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaef706-77e7-4add-a2cc-a9aba2ea36b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:10.878677 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaef706-77e7-4add-a2cc-a9aba2ea36b2 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:10.890826 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 74/154] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:10.896469 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60fc43-a6e2-41c5-9d84-a88ab55570c7 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:11.048250 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60fc43-a6e2-41c5-9d84-a88ab55570c7 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:11.093063 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:11.099675 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7e944-e289-4505-b594-382c8c96b0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:11.100345 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7e944-e289-4505-b594-382c8c96b0fd None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:11.100626 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7e944-e289-4505-b594-382c8c96b0fd None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:11.100901 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7e944-e289-4505-b594-382c8c96b0fd None admin] PATH_INFO: `/v3/users/20a5fed4c1cc4e61a08385f0a1b65924` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:11.102186 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7e944-e289-4505-b594-382c8c96b0fd None admin] RBAC: Authorizing `identity:get_user(user_id=20a5fed4c1cc4e61a08385f0a1b65924)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:11.103765 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7e944-e289-4505-b594-382c8c96b0fd None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:11.105752 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 81/155] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:10 2022] GET /identity/v3/users/20a5fed4c1cc4e61a08385f0a1b65924 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:11.108989 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaef706-77e7-4add-a2cc-a9aba2ea36b2 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:11.112757 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7e944-e289-4505-b594-382c8c96b0fd None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:11.290774 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaef706-77e7-4add-a2cc-a9aba2ea36b2 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:11.307546 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7e944-e289-4505-b594-382c8c96b0fd None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:11.353323 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff61c44-6aa2-4edb-8534-b4f5aa9232f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:11.354389 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff61c44-6aa2-4edb-8534-b4f5aa9232f9 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:11.354861 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff61c44-6aa2-4edb-8534-b4f5aa9232f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:11.355343 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff61c44-6aa2-4edb-8534-b4f5aa9232f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:11.381973 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff61c44-6aa2-4edb-8534-b4f5aa9232f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:11.401749 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd15ed-fe43-4223-93c8-720bffd9e24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:11.402786 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd15ed-fe43-4223-93c8-720bffd9e24f None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:11.403312 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd15ed-fe43-4223-93c8-720bffd9e24f None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:11.405895 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd15ed-fe43-4223-93c8-720bffd9e24f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:11.408669 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-fff61c44-6aa2-4edb-8534-b4f5aa9232f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:12:11.408669 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:11.408669 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:11.408669 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:11.408669 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:11.408669 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:11.408669 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:11.408669 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:11.408669 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:11.408669 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:11.408669 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:11.408669 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:11.408669 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:11.408669 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:11.408669 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:11.408669 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:11.409807 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:11.409807 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:11.409807 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:11.409807 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:11.409807 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:11.409807 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:11.409807 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:11.409807 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:11.409807 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:11.409807 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:11.409807 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:11.409807 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:11.409807 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:11.409807 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:11.409807 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:11.409807 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:11.410671 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:11.410671 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:11.410671 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:11.410671 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:11.410671 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:11.410671 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:11.410671 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:11.410671 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:11.410671 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:11.410671 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:11.410671 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:12:11.410671 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:12:11.413720 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 75/156] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:12:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:11.417416 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d1b0e-cf4b-4d64-9a01-1bfa88bf54a6 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:11.418988 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d1b0e-cf4b-4d64-9a01-1bfa88bf54a6 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:11.419719 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d1b0e-cf4b-4d64-9a01-1bfa88bf54a6 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:11.423461 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 76/157] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:11.430480 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d1b0e-cf4b-4d64-9a01-1bfa88bf54a6 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:11.484539 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:11.534002 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:11.541471 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd15ed-fe43-4223-93c8-720bffd9e24f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:11.543012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd15ed-fe43-4223-93c8-720bffd9e24f None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:11.603274 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d1b0e-cf4b-4d64-9a01-1bfa88bf54a6 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:11.683694 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ba364-9c53-4ad2-9d25-c7499aa30caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:11.686234 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ba364-9c53-4ad2-9d25-c7499aa30caa None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:11.686707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ba364-9c53-4ad2-9d25-c7499aa30caa None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:11.687389 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ba364-9c53-4ad2-9d25-c7499aa30caa None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:11.688638 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ba364-9c53-4ad2-9d25-c7499aa30caa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:11.689197 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ba364-9c53-4ad2-9d25-c7499aa30caa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:11.691866 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ba364-9c53-4ad2-9d25-c7499aa30caa None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:11.720605 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 77/158] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:11.722844 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3902b-224e-456d-8556-200f7b389de2 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:11.723633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3902b-224e-456d-8556-200f7b389de2 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:11.724247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3902b-224e-456d-8556-200f7b389de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:11.769690 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-84b3902b-224e-456d-8556-200f7b389de2 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:11.771670 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-84b3902b-224e-456d-8556-200f7b389de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:11.775494 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 82/159] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 22:12:11.775494 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd15ed-fe43-4223-93c8-720bffd9e24f None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:11.944175 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 78/160] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:11.945290 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3902b-224e-456d-8556-200f7b389de2 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:11.989858 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:12.009868 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:12.014572 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd15ed-fe43-4223-93c8-720bffd9e24f None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:12.094673 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f6abf-1232-4043-99b0-ea6771616d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:12.095729 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f6abf-1232-4043-99b0-ea6771616d8f None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:12.096240 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f6abf-1232-4043-99b0-ea6771616d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:12.096734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f6abf-1232-4043-99b0-ea6771616d8f None admin] PATH_INFO: `/v3/users/3713f38f8dcb48a58e22f5fcfa10c524` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:12.098133 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f6abf-1232-4043-99b0-ea6771616d8f None admin] RBAC: Authorizing `identity:get_user(user_id=3713f38f8dcb48a58e22f5fcfa10c524)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:12.100008 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f6abf-1232-4043-99b0-ea6771616d8f None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:12.101927 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 83/161] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:11 2022] GET /identity/v3/users/3713f38f8dcb48a58e22f5fcfa10c524 => generated 247 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:12.106208 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3ac74-68fd-4b3c-81b2-0f368063ac22 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:12.107501 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3ac74-68fd-4b3c-81b2-0f368063ac22 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:12.108105 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3ac74-68fd-4b3c-81b2-0f368063ac22 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:12.109839 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 84/162] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:12.110858 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3ac74-68fd-4b3c-81b2-0f368063ac22 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:12.112545 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3902b-224e-456d-8556-200f7b389de2 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:12.173973 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23270d-ca45-4fb9-a3fa-4a017e5a0137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:12.174633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23270d-ca45-4fb9-a3fa-4a017e5a0137 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:12.174931 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23270d-ca45-4fb9-a3fa-4a017e5a0137 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:12.175186 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23270d-ca45-4fb9-a3fa-4a017e5a0137 None admin] PATH_INFO: `/v3/projects/60a5733a3c634efca6df17f66d53c587` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:12.176374 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23270d-ca45-4fb9-a3fa-4a017e5a0137 None admin] RBAC: Authorizing `identity:get_project(project_id=60a5733a3c634efca6df17f66d53c587)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:12.177863 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23270d-ca45-4fb9-a3fa-4a017e5a0137 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:12.179834 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 79/163] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:11 2022] GET /identity/v3/projects/60a5733a3c634efca6df17f66d53c587 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:12.180994 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f39f1-cc89-43e8-9547-62ab743659a0 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:12.181274 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f39f1-cc89-43e8-9547-62ab743659a0 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:12.181569 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f39f1-cc89-43e8-9547-62ab743659a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:12.214627 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-3e6f39f1-cc89-43e8-9547-62ab743659a0 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:12.215755 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-3e6f39f1-cc89-43e8-9547-62ab743659a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:12.313574 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3ac74-68fd-4b3c-81b2-0f368063ac22 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:12.314462 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 80/164] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:12.315125 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f39f1-cc89-43e8-9547-62ab743659a0 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:12.347406 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:12.391189 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee39403-a3b8-4c67-901d-a949f25ff43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:12.392230 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee39403-a3b8-4c67-901d-a949f25ff43b None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:12.392718 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee39403-a3b8-4c67-901d-a949f25ff43b None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:12.393240 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee39403-a3b8-4c67-901d-a949f25ff43b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:12.457955 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:12.474185 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f39f1-cc89-43e8-9547-62ab743659a0 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:12.509797 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee39403-a3b8-4c67-901d-a949f25ff43b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:12.511657 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee39403-a3b8-4c67-901d-a949f25ff43b None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:12.534165 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff50bc0-8792-447b-95b4-1916300722c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:12.534817 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff50bc0-8792-447b-95b4-1916300722c9 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:12.535358 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff50bc0-8792-447b-95b4-1916300722c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:12.535358 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff50bc0-8792-447b-95b4-1916300722c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:12.536148 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff50bc0-8792-447b-95b4-1916300722c9 None admin] RBAC: Adding query filter params (role.id=eabf42a0387a47218c5ce577dd65f61c, scope.project.id=60a5733a3c634efca6df17f66d53c587, user.id=20a5fed4c1cc4e61a08385f0a1b65924) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:12.536459 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff50bc0-8792-447b-95b4-1916300722c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:12.537952 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff50bc0-8792-447b-95b4-1916300722c9 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:12.544251 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 81/165] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:12:12 2022] GET /identity/v3/role_assignments?user.id=20a5fed4c1cc4e61a08385f0a1b65924&scope.project.id=60a5733a3c634efca6df17f66d53c587&role.id=eabf42a0387a47218c5ce577dd65f61c => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:12.599228 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff50bc0-8792-447b-95b4-1916300722c9 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:12.690142 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 85/166] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:12.696219 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee39403-a3b8-4c67-901d-a949f25ff43b None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:12.741872 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:12.783148 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff50bc0-8792-447b-95b4-1916300722c9 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:12.859569 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85767e-b4ee-476f-a535-bab976765bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:12.860534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85767e-b4ee-476f-a535-bab976765bab None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:12.860955 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85767e-b4ee-476f-a535-bab976765bab None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:12.861404 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85767e-b4ee-476f-a535-bab976765bab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:12.866032 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:12.883177 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85767e-b4ee-476f-a535-bab976765bab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:12.893640 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-cd85767e-b4ee-476f-a535-bab976765bab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:12:12.893640 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:12.893640 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:12.893640 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:12.893640 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:12.893640 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:12.893640 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:12.893640 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:12.893640 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:12.893640 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:12.893640 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:12.893640 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:12.893640 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:12.893640 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:12.893640 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:12.893640 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:12.894581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:12.894581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:12.894581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:12.894581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:12.894581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:12.894581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:12.894581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:12.894581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:12.894581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:12.894581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:12.894581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:12.894581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:12.894581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:12.894581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:12.894581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:12.894581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:12.895616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:12.895616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:12.895616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:12.895616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:12.895616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:12.895616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:12.895616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:12.895616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:12.895616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:12.895616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:12.895616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:12:12.895616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:12:12.898053 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 82/167] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Aug 23 22:12:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:12:12.904765 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85767e-b4ee-476f-a535-bab976765bab None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:12.909611 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee39403-a3b8-4c67-901d-a949f25ff43b None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:12.973258 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3e1ab-0bf2-4408-ab2f-0e8de883bfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:12.974248 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3e1ab-0bf2-4408-ab2f-0e8de883bfe7 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:12.974760 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3e1ab-0bf2-4408-ab2f-0e8de883bfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:12.975437 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3e1ab-0bf2-4408-ab2f-0e8de883bfe7 None admin] PATH_INFO: `/v3/projects/60a5733a3c634efca6df17f66d53c587` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:12.982601 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3e1ab-0bf2-4408-ab2f-0e8de883bfe7 None admin] RBAC: Authorizing `identity:get_project(project_id=60a5733a3c634efca6df17f66d53c587)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:12.984985 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3e1ab-0bf2-4408-ab2f-0e8de883bfe7 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:12.987032 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 86/168] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:12 2022] GET /identity/v3/projects/60a5733a3c634efca6df17f66d53c587 => generated 298 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:12.993491 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3e1ab-0bf2-4408-ab2f-0e8de883bfe7 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:13.066510 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85767e-b4ee-476f-a535-bab976765bab None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:13.122173 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b70f9-58ff-4e00-a099-0cdb1b91e6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:13.123302 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b70f9-58ff-4e00-a099-0cdb1b91e6bb None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:13.123728 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b70f9-58ff-4e00-a099-0cdb1b91e6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:13.124159 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b70f9-58ff-4e00-a099-0cdb1b91e6bb None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:13.125014 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b70f9-58ff-4e00-a099-0cdb1b91e6bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:13.125499 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b70f9-58ff-4e00-a099-0cdb1b91e6bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:13.127104 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b70f9-58ff-4e00-a099-0cdb1b91e6bb None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:13.136666 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 83/169] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:12:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:13.143638 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b70f9-58ff-4e00-a099-0cdb1b91e6bb None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:13.149737 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:13.168297 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3e1ab-0bf2-4408-ab2f-0e8de883bfe7 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:13.229089 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f941e9c-84aa-46db-8414-8bb7f8fdc4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:13.230123 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f941e9c-84aa-46db-8414-8bb7f8fdc4bc None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:13.230623 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f941e9c-84aa-46db-8414-8bb7f8fdc4bc None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:13.231090 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f941e9c-84aa-46db-8414-8bb7f8fdc4bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:13.232624 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f941e9c-84aa-46db-8414-8bb7f8fdc4bc None admin] RBAC: Adding query filter params (role.id=e806ce849cf34b92979b5524f3ea9ff6, scope.project.id=60a5733a3c634efca6df17f66d53c587, user.id=3713f38f8dcb48a58e22f5fcfa10c524) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:13.233472 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f941e9c-84aa-46db-8414-8bb7f8fdc4bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:13.235225 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f941e9c-84aa-46db-8414-8bb7f8fdc4bc None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:13.238498 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:13.252887 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 87/170] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:12:12 2022] GET /identity/v3/role_assignments?user.id=3713f38f8dcb48a58e22f5fcfa10c524&scope.project.id=60a5733a3c634efca6df17f66d53c587&role.id=e806ce849cf34b92979b5524f3ea9ff6 => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:13.297188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b70f9-58ff-4e00-a099-0cdb1b91e6bb None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:13.305344 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f941e9c-84aa-46db-8414-8bb7f8fdc4bc None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:13.362124 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df13b7-cb0d-4373-9abf-e3805651e5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:13.362799 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df13b7-cb0d-4373-9abf-e3805651e5b5 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:13.363080 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df13b7-cb0d-4373-9abf-e3805651e5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:13.363355 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df13b7-cb0d-4373-9abf-e3805651e5b5 None admin] PATH_INFO: `/v3/users/20a5fed4c1cc4e61a08385f0a1b65924` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:13.370120 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df13b7-cb0d-4373-9abf-e3805651e5b5 None admin] RBAC: Authorizing `identity:get_user(user_id=20a5fed4c1cc4e61a08385f0a1b65924)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:13.371648 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df13b7-cb0d-4373-9abf-e3805651e5b5 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:13.373747 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 84/171] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:13 2022] GET /identity/v3/users/20a5fed4c1cc4e61a08385f0a1b65924 => generated 275 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:13.380181 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df13b7-cb0d-4373-9abf-e3805651e5b5 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:13.505866 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:13.549443 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f941e9c-84aa-46db-8414-8bb7f8fdc4bc None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:13.550862 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df13b7-cb0d-4373-9abf-e3805651e5b5 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:13.595608 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e071f61-e66b-48a9-b612-d287e785ac93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:13.596658 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e071f61-e66b-48a9-b612-d287e785ac93 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:13.597101 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e071f61-e66b-48a9-b612-d287e785ac93 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:13.597559 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e071f61-e66b-48a9-b612-d287e785ac93 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:13.607612 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec969d5f-2d77-4236-8377-c4e978b81276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:13.608538 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec969d5f-2d77-4236-8377-c4e978b81276 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:13.609036 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec969d5f-2d77-4236-8377-c4e978b81276 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:13.609494 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec969d5f-2d77-4236-8377-c4e978b81276 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:13.619420 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e071f61-e66b-48a9-b612-d287e785ac93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:13.628350 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-0e071f61-e66b-48a9-b612-d287e785ac93 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:13.628350 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:13.628350 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:13.628350 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:13.628350 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:13.628350 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:13.628350 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:13.628350 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:13.628350 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:13.628350 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:13.628350 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:13.628350 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:13.628350 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:13.628350 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:13.628350 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:13.628350 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:13.633519 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:13.633519 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:13.633519 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:13.633519 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:13.633519 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:13.633519 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:13.633519 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:13.633519 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:13.633519 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:13.633519 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:13.633519 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:13.633519 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:13.633519 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:13.633519 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:13.633519 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:13.633519 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:13.634559 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:13.634559 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:13.634559 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:13.634559 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:13.634559 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:13.634559 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:13.634559 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:13.634559 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:13.634559 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:13.634559 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:13.634559 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:13.634559 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:12:13.634559 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 88/172] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:13.635586 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e071f61-e66b-48a9-b612-d287e785ac93 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:13.724885 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec969d5f-2d77-4236-8377-c4e978b81276 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:13.726713 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec969d5f-2d77-4236-8377-c4e978b81276 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:13.770591 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:13.825284 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e071f61-e66b-48a9-b612-d287e785ac93 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:13.856297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:13.877132 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b165947-96d9-44ca-8431-414d55ddeab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:13.877898 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b165947-96d9-44ca-8431-414d55ddeab2 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:13.878205 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b165947-96d9-44ca-8431-414d55ddeab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:13.878466 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b165947-96d9-44ca-8431-414d55ddeab2 None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:13.879197 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b165947-96d9-44ca-8431-414d55ddeab2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:13.879588 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b165947-96d9-44ca-8431-414d55ddeab2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:13.881236 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b165947-96d9-44ca-8431-414d55ddeab2 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:13.905267 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 89/173] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:13.907054 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e16d3-ae40-4179-aa88-2ebbf2f6b9ef None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:13.907343 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e16d3-ae40-4179-aa88-2ebbf2f6b9ef None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:13.907642 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e16d3-ae40-4179-aa88-2ebbf2f6b9ef None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:13.909780 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 90/174] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:13.918439 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 85/175] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 22:12:13.920007 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5e924-714f-4d4d-86df-87c334ce917b None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:13.920322 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5e924-714f-4d4d-86df-87c334ce917b None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:13.920599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5e924-714f-4d4d-86df-87c334ce917b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:13.924577 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e16d3-ae40-4179-aa88-2ebbf2f6b9ef None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:13.977383 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-40b5e924-714f-4d4d-86df-87c334ce917b None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:13.978629 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-40b5e924-714f-4d4d-86df-87c334ce917b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:14.132729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 86/176] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:14.132729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5e924-714f-4d4d-86df-87c334ce917b None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:14.160161 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e16d3-ae40-4179-aa88-2ebbf2f6b9ef None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:14.217249 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:14.274430 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a384612-7017-4f36-8e3b-33793e53d585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:14.275489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a384612-7017-4f36-8e3b-33793e53d585 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:14.275989 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a384612-7017-4f36-8e3b-33793e53d585 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:14.276604 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a384612-7017-4f36-8e3b-33793e53d585 None admin] PATH_INFO: `/v3/users/20a5fed4c1cc4e61a08385f0a1b65924` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:14.280922 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a384612-7017-4f36-8e3b-33793e53d585 None admin] RBAC: Authorizing `identity:get_user(user_id=20a5fed4c1cc4e61a08385f0a1b65924)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:14.283159 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a384612-7017-4f36-8e3b-33793e53d585 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:14.286288 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 91/177] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:13 2022] GET /identity/v3/users/20a5fed4c1cc4e61a08385f0a1b65924 => generated 275 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:14.287487 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7554883-d493-4ffa-9e03-9d224640e124 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:14.287903 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7554883-d493-4ffa-9e03-9d224640e124 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:14.297872 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5e924-714f-4d4d-86df-87c334ce917b None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:14.298220 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7554883-d493-4ffa-9e03-9d224640e124 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:14.299940 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:14.301630 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 92/178] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:14 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:14.302319 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7554883-d493-4ffa-9e03-9d224640e124 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:14.362504 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4a326-0784-4476-a89d-2744ee0091b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:14.363228 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4a326-0784-4476-a89d-2744ee0091b8 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:14.363513 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4a326-0784-4476-a89d-2744ee0091b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:14.363791 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4a326-0784-4476-a89d-2744ee0091b8 None admin] PATH_INFO: `/v3/projects/60a5733a3c634efca6df17f66d53c587` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:14.365119 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a4a326-0784-4476-a89d-2744ee0091b8 None admin] RBAC: Authorizing `identity:get_project(project_id=60a5733a3c634efca6df17f66d53c587)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:14.366704 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a4a326-0784-4476-a89d-2744ee0091b8 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:14.368476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 87/179] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:14 2022] GET /identity/v3/projects/60a5733a3c634efca6df17f66d53c587 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:14.369867 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24839703-28d8-4fe9-a67a-6b699d056abf None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:14.370123 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24839703-28d8-4fe9-a67a-6b699d056abf None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:14.370433 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24839703-28d8-4fe9-a67a-6b699d056abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:14.394433 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-24839703-28d8-4fe9-a67a-6b699d056abf None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:14.395571 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-24839703-28d8-4fe9-a67a-6b699d056abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:14.494579 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7554883-d493-4ffa-9e03-9d224640e124 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:14.508994 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 88/180] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:14.513202 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046b01e-9d99-4ba4-aa1a-115e6d32061b None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:14.514230 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046b01e-9d99-4ba4-aa1a-115e6d32061b None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:14.514615 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046b01e-9d99-4ba4-aa1a-115e6d32061b None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:14.518977 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 89/181] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:14.518977 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046b01e-9d99-4ba4-aa1a-115e6d32061b None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:14.563742 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78e9bb-ce2b-4291-bc7e-4a291704f970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:14.564849 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78e9bb-ce2b-4291-bc7e-4a291704f970 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:14.565302 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78e9bb-ce2b-4291-bc7e-4a291704f970 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:14.565901 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78e9bb-ce2b-4291-bc7e-4a291704f970 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:14.681605 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:14.688814 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:14.697156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046b01e-9d99-4ba4-aa1a-115e6d32061b None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:14.702570 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78e9bb-ce2b-4291-bc7e-4a291704f970 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:14.705031 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78e9bb-ce2b-4291-bc7e-4a291704f970 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:14.767318 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa801ee-6408-4685-a3b4-fcf94d4ee014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:14.767954 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa801ee-6408-4685-a3b4-fcf94d4ee014 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:14.768223 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa801ee-6408-4685-a3b4-fcf94d4ee014 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:14.768536 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa801ee-6408-4685-a3b4-fcf94d4ee014 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:14.772622 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa801ee-6408-4685-a3b4-fcf94d4ee014 None admin] RBAC: Adding query filter params (role.id=a0449d430ec54adcabb96193af2f7cd5, scope.project.id=60a5733a3c634efca6df17f66d53c587, user.id=20a5fed4c1cc4e61a08385f0a1b65924) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:14.772622 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa801ee-6408-4685-a3b4-fcf94d4ee014 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:14.772622 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa801ee-6408-4685-a3b4-fcf94d4ee014 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:14.793474 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 90/182] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:12:14 2022] GET /identity/v3/role_assignments?user.id=20a5fed4c1cc4e61a08385f0a1b65924&scope.project.id=60a5733a3c634efca6df17f66d53c587&role.id=a0449d430ec54adcabb96193af2f7cd5 => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:14.794006 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293689f-8509-447a-866a-d715b2045f0c None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:14.794443 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293689f-8509-447a-866a-d715b2045f0c None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:14.795004 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293689f-8509-447a-866a-d715b2045f0c None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:14.803681 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 91/183] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:14.803681 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc93577-229b-4128-99c8-079533546a34 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:14.803681 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc93577-229b-4128-99c8-079533546a34 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:14.803681 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc93577-229b-4128-99c8-079533546a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:14.839954 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-3fc93577-229b-4128-99c8-079533546a34 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:14.844202 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-3fc93577-229b-4128-99c8-079533546a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:14.913644 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 93/184] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:14.916144 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78e9bb-ce2b-4291-bc7e-4a291704f970 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:14.992200 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 92/185] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:14.994402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fabea4-5862-4f3a-8c97-392e0e1001c3 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:14.994876 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fabea4-5862-4f3a-8c97-392e0e1001c3 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:14.995306 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fabea4-5862-4f3a-8c97-392e0e1001c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:15.035674 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-c2fabea4-5862-4f3a-8c97-392e0e1001c3 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:15.038331 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-c2fabea4-5862-4f3a-8c97-392e0e1001c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:15.123108 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:15.152772 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78e9bb-ce2b-4291-bc7e-4a291704f970 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:15.196382 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 93/186] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:15.198040 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fabea4-5862-4f3a-8c97-392e0e1001c3 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:15.208276 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5fef76-bf32-49d6-a5c6-cfd65838b461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:15.208972 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fef76-bf32-49d6-a5c6-cfd65838b461 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:15.209318 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fef76-bf32-49d6-a5c6-cfd65838b461 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:15.209810 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fef76-bf32-49d6-a5c6-cfd65838b461 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:15.226342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5fef76-bf32-49d6-a5c6-cfd65838b461 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:15.231292 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-6d5fef76-bf32-49d6-a5c6-cfd65838b461 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:12:15.231292 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:15.231292 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:15.231292 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:15.231292 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:15.231292 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:15.231292 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:15.231292 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:15.231292 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:15.231292 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:15.231292 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:15.231292 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:15.231292 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:15.231292 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:15.231292 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:15.231292 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:15.233146 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:15.233146 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:15.233146 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:15.233146 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:15.233146 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:15.233146 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:15.233146 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:15.233146 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:15.233146 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:15.233146 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:15.233146 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:15.233146 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:15.233146 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:15.233146 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:15.233146 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:15.233146 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:15.235162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:15.235162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:15.235162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:15.235162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:15.235162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:15.235162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:15.235162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:15.235162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:15.235162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:15.235162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:15.235162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:12:15.235162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:12:15.235162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 94/187] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Aug 23 22:12:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:15.235162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5fef76-bf32-49d6-a5c6-cfd65838b461 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:15.252466 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:15.368822 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fabea4-5862-4f3a-8c97-392e0e1001c3 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:15.408592 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5fef76-bf32-49d6-a5c6-cfd65838b461 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:15.423672 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612744c-35cd-460e-8430-9559de8b3eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:15.424012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612744c-35cd-460e-8430-9559de8b3eae None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:15.426274 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612744c-35cd-460e-8430-9559de8b3eae None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:15.426274 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612744c-35cd-460e-8430-9559de8b3eae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:15.441829 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612744c-35cd-460e-8430-9559de8b3eae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:15.446780 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-3612744c-35cd-460e-8430-9559de8b3eae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:12:15.446780 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:15.446780 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:15.446780 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:15.446780 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:15.446780 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:15.446780 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:15.446780 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:15.446780 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:15.446780 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:15.446780 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:15.446780 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:15.446780 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:15.446780 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:15.446780 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:15.446780 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:15.448165 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:15.448165 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:15.448165 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:15.448165 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:15.448165 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:15.448165 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:15.448165 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:15.448165 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:15.448165 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:15.448165 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:15.448165 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:15.448165 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:15.448165 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:15.448165 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:15.448165 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:15.448165 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:15.449270 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:15.449270 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:15.449270 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:15.449270 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:15.449270 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:15.449270 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:15.449270 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:15.449270 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:15.449270 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:15.449270 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:15.449270 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:12:15.449270 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:12:15.449270 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 94/188] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:12:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:15.449270 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612744c-35cd-460e-8430-9559de8b3eae None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:15.473081 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bde875-d880-40e6-8561-6931a65537fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:15.474118 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bde875-d880-40e6-8561-6931a65537fd None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:15.474573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bde875-d880-40e6-8561-6931a65537fd None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:15.475017 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bde875-d880-40e6-8561-6931a65537fd None admin] PATH_INFO: `/v3/projects/798a38ebdada476aa5f9aca24023d7ce` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:15.476712 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bde875-d880-40e6-8561-6931a65537fd None admin] RBAC: Authorizing `identity:get_project(project_id=798a38ebdada476aa5f9aca24023d7ce)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:15.479291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bde875-d880-40e6-8561-6931a65537fd None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:15.487752 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 95/189] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:15 2022] GET /identity/v3/projects/798a38ebdada476aa5f9aca24023d7ce => generated 312 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:15.487752 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bde875-d880-40e6-8561-6931a65537fd None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:15.519248 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:15.603218 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:15.640543 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612744c-35cd-460e-8430-9559de8b3eae None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:15.680829 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bde875-d880-40e6-8561-6931a65537fd None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:15.706158 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc51b4-8ae3-4ad9-b284-3ca220474d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:15.707111 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc51b4-8ae3-4ad9-b284-3ca220474d8e None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:15.707581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc51b4-8ae3-4ad9-b284-3ca220474d8e None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:15.708036 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc51b4-8ae3-4ad9-b284-3ca220474d8e None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:15.709147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc51b4-8ae3-4ad9-b284-3ca220474d8e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:15.709696 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc51b4-8ae3-4ad9-b284-3ca220474d8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:15.712159 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc51b4-8ae3-4ad9-b284-3ca220474d8e None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:15.733482 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 95/190] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:12:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:15.737543 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc51b4-8ae3-4ad9-b284-3ca220474d8e None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:15.755664 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4de208-e6bc-46ea-9b75-c0268f03033e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:15.756955 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4de208-e6bc-46ea-9b75-c0268f03033e None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:15.757656 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4de208-e6bc-46ea-9b75-c0268f03033e None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:15.758243 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4de208-e6bc-46ea-9b75-c0268f03033e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:15.781851 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4de208-e6bc-46ea-9b75-c0268f03033e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:15.790050 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-2d4de208-e6bc-46ea-9b75-c0268f03033e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:12:15.790050 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:15.790050 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:15.790050 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:15.790050 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:15.790050 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:15.790050 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:15.790050 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:15.790050 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:15.790050 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:15.790050 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:15.790050 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:15.790050 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:15.790050 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:15.790050 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:15.790050 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:15.791079 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:15.791079 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:15.791079 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:15.791079 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:15.791079 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:15.791079 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:15.791079 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:15.791079 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:15.791079 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:15.791079 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:15.791079 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:15.791079 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:15.791079 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:15.791079 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:15.791079 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:15.791079 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:15.791882 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:15.791882 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:15.791882 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:15.791882 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:15.791882 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:15.791882 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:15.791882 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:15.791882 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:15.791882 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:15.791882 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:15.791882 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:12:15.791882 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:12:15.791882 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 96/191] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:15.793770 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4de208-e6bc-46ea-9b75-c0268f03033e None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:15.915017 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:15.922690 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc51b4-8ae3-4ad9-b284-3ca220474d8e None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:15.964781 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4de208-e6bc-46ea-9b75-c0268f03033e None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:15.980195 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf6b27-0da8-4405-85ad-9efaa437f393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:15.981150 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf6b27-0da8-4405-85ad-9efaa437f393 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:15.981580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf6b27-0da8-4405-85ad-9efaa437f393 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:15.982353 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf6b27-0da8-4405-85ad-9efaa437f393 None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:15.983709 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf6b27-0da8-4405-85ad-9efaa437f393 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:15.984138 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf6b27-0da8-4405-85ad-9efaa437f393 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:15.986185 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf6b27-0da8-4405-85ad-9efaa437f393 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:16.003209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 96/192] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:16.004664 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf6b27-0da8-4405-85ad-9efaa437f393 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:16.026142 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:16.034175 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab8963-eca2-46d0-af3c-3992b7b378c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:16.035100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab8963-eca2-46d0-af3c-3992b7b378c8 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:16.035583 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab8963-eca2-46d0-af3c-3992b7b378c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:16.036053 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab8963-eca2-46d0-af3c-3992b7b378c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:16.037589 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab8963-eca2-46d0-af3c-3992b7b378c8 None admin] RBAC: Adding query filter params (role.id=eabf42a0387a47218c5ce577dd65f61c, scope.project.id=798a38ebdada476aa5f9aca24023d7ce, user.id=20a5fed4c1cc4e61a08385f0a1b65924) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:16.038690 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab8963-eca2-46d0-af3c-3992b7b378c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:16.040806 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab8963-eca2-46d0-af3c-3992b7b378c8 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:16.052238 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 97/193] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:12:15 2022] GET /identity/v3/role_assignments?user.id=20a5fed4c1cc4e61a08385f0a1b65924&scope.project.id=798a38ebdada476aa5f9aca24023d7ce&role.id=eabf42a0387a47218c5ce577dd65f61c => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:16.053791 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab8963-eca2-46d0-af3c-3992b7b378c8 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:16.186131 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf6b27-0da8-4405-85ad-9efaa437f393 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:16.234848 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab8963-eca2-46d0-af3c-3992b7b378c8 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:16.235984 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1565a-178f-44e8-bfe9-9e700fc8454c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:16.237299 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1565a-178f-44e8-bfe9-9e700fc8454c None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:16.237299 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1565a-178f-44e8-bfe9-9e700fc8454c None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:16.237299 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1565a-178f-44e8-bfe9-9e700fc8454c None admin] PATH_INFO: `/v3/users/e23a452ca033413cb81310b4f12ab72f` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:16.259240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1565a-178f-44e8-bfe9-9e700fc8454c None admin] RBAC: Authorizing `identity:get_user(user_id=e23a452ca033413cb81310b4f12ab72f)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:16.260810 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1565a-178f-44e8-bfe9-9e700fc8454c None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:16.263598 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 97/194] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:16 2022] GET /identity/v3/users/e23a452ca033413cb81310b4f12ab72f => generated 283 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:16.264225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1565a-178f-44e8-bfe9-9e700fc8454c None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:16.312795 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc8ddd-d271-42f7-9dda-b8b8cd49ac43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:16.313771 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc8ddd-d271-42f7-9dda-b8b8cd49ac43 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:16.314246 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc8ddd-d271-42f7-9dda-b8b8cd49ac43 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:16.314680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc8ddd-d271-42f7-9dda-b8b8cd49ac43 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:16.316554 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc8ddd-d271-42f7-9dda-b8b8cd49ac43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:16.319407 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc8ddd-d271-42f7-9dda-b8b8cd49ac43 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:16.323613 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 98/195] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:16.324712 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc8ddd-d271-42f7-9dda-b8b8cd49ac43 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:16.345074 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:16.385392 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:16.438872 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1565a-178f-44e8-bfe9-9e700fc8454c None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:16.479456 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc8ddd-d271-42f7-9dda-b8b8cd49ac43 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:16.495616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3866ebf-0d33-4559-addd-490f58c1a8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:16.496376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3866ebf-0d33-4559-addd-490f58c1a8b0 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:16.496768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3866ebf-0d33-4559-addd-490f58c1a8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:16.497106 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3866ebf-0d33-4559-addd-490f58c1a8b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:16.498427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3866ebf-0d33-4559-addd-490f58c1a8b0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:16.498792 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3866ebf-0d33-4559-addd-490f58c1a8b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:16.500303 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3866ebf-0d33-4559-addd-490f58c1a8b0 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:16.510320 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 98/196] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:16.511202 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3866ebf-0d33-4559-addd-490f58c1a8b0 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:16.531354 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f49443-2d7d-4452-a4e6-d0d54c5ccff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:16.532246 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f49443-2d7d-4452-a4e6-d0d54c5ccff3 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:16.532636 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f49443-2d7d-4452-a4e6-d0d54c5ccff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:16.533004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f49443-2d7d-4452-a4e6-d0d54c5ccff3 None admin] PATH_INFO: `/v3/users/e23a452ca033413cb81310b4f12ab72f` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:16.534530 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f49443-2d7d-4452-a4e6-d0d54c5ccff3 None admin] RBAC: Authorizing `identity:get_user(user_id=e23a452ca033413cb81310b4f12ab72f)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:16.536110 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f49443-2d7d-4452-a4e6-d0d54c5ccff3 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:16.543745 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 99/197] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:16 2022] GET /identity/v3/users/e23a452ca033413cb81310b4f12ab72f => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:16.543745 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f49443-2d7d-4452-a4e6-d0d54c5ccff3 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:16.662119 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:16.668095 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3866ebf-0d33-4559-addd-490f58c1a8b0 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:16.694573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f49443-2d7d-4452-a4e6-d0d54c5ccff3 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:16.719054 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:16.736612 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8c868-a6c4-463a-a50c-9bbab2622536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:16.741586 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8c868-a6c4-463a-a50c-9bbab2622536 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:16.741586 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8c868-a6c4-463a-a50c-9bbab2622536 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:16.741586 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8c868-a6c4-463a-a50c-9bbab2622536 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:16.759365 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49acc2ca-8529-4bc5-a4d5-47bc24156af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:16.760905 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acc2ca-8529-4bc5-a4d5-47bc24156af9 None admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:16.760905 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acc2ca-8529-4bc5-a4d5-47bc24156af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:16.760905 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acc2ca-8529-4bc5-a4d5-47bc24156af9 None admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:16.761932 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49acc2ca-8529-4bc5-a4d5-47bc24156af9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:16.764003 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49acc2ca-8529-4bc5-a4d5-47bc24156af9 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:16.802202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 100/198] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Aug 23 22:12:16 2022] POST /identity/v3/users => generated 297 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:12:16.803429 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49acc2ca-8529-4bc5-a4d5-47bc24156af9 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:16.891781 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8c868-a6c4-463a-a50c-9bbab2622536 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:16.893792 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8c868-a6c4-463a-a50c-9bbab2622536 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:16.972049 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49acc2ca-8529-4bc5-a4d5-47bc24156af9 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:17.018331 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:17.033330 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1e3c2-ceda-4bea-8d7e-aa127d3e5a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:17.034824 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1e3c2-ceda-4bea-8d7e-aa127d3e5a1a None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:17.035241 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1e3c2-ceda-4bea-8d7e-aa127d3e5a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:17.035699 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1e3c2-ceda-4bea-8d7e-aa127d3e5a1a None admin] PATH_INFO: `/v3/users/257c6b0c67bc4baab9553aba85f9577c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:17.037521 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1e3c2-ceda-4bea-8d7e-aa127d3e5a1a None admin] RBAC: Authorizing `identity:get_user(user_id=257c6b0c67bc4baab9553aba85f9577c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:17.039109 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1e3c2-ceda-4bea-8d7e-aa127d3e5a1a None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:17.046391 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 101/199] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:16 2022] GET /identity/v3/users/257c6b0c67bc4baab9553aba85f9577c => generated 289 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:17.046391 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1e3c2-ceda-4bea-8d7e-aa127d3e5a1a None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:17.103440 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 99/200] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:17.104456 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8c868-a6c4-463a-a50c-9bbab2622536 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:17.155789 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:17.261610 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1e3c2-ceda-4bea-8d7e-aa127d3e5a1a None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:17.301734 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8c868-a6c4-463a-a50c-9bbab2622536 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:17.334236 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3bce0f-dd00-4564-8be6-e2886cf1951b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:17.335805 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bce0f-dd00-4564-8be6-e2886cf1951b None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:17.336595 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bce0f-dd00-4564-8be6-e2886cf1951b None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:17.337432 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bce0f-dd00-4564-8be6-e2886cf1951b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:17.375435 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c63e5-57e3-45c3-bf34-97c843a2a940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:17.376560 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c63e5-57e3-45c3-bf34-97c843a2a940 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:17.377050 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c63e5-57e3-45c3-bf34-97c843a2a940 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:17.377575 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c63e5-57e3-45c3-bf34-97c843a2a940 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:17.463368 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:17.467227 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3bce0f-dd00-4564-8be6-e2886cf1951b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:17.469417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3bce0f-dd00-4564-8be6-e2886cf1951b None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:17.542152 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5c63e5-57e3-45c3-bf34-97c843a2a940 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:17.543557 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5c63e5-57e3-45c3-bf34-97c843a2a940 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:17.610732 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:17.633860 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 102/201] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:17.634913 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3bce0f-dd00-4564-8be6-e2886cf1951b None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:17.801527 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 100/202] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 693 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:17.801527 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c63e5-57e3-45c3-bf34-97c843a2a940 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:17.865149 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:17.872440 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3bce0f-dd00-4564-8be6-e2886cf1951b None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:17.954438 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cbd56-6bc4-4874-bbca-5e2c76405937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:17.955860 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cbd56-6bc4-4874-bbca-5e2c76405937 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:17.956568 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cbd56-6bc4-4874-bbca-5e2c76405937 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:17.957185 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cbd56-6bc4-4874-bbca-5e2c76405937 None admin] PATH_INFO: `/v3/projects/20cc73f001a245c680144a956b81a15e` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:17.959402 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4cbd56-6bc4-4874-bbca-5e2c76405937 None admin] RBAC: Authorizing `identity:get_project(project_id=20cc73f001a245c680144a956b81a15e)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:17.961994 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4cbd56-6bc4-4874-bbca-5e2c76405937 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:17.964949 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 103/203] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:17 2022] GET /identity/v3/projects/20cc73f001a245c680144a956b81a15e => generated 302 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:17.967458 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cbd56-6bc4-4874-bbca-5e2c76405937 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:18.009569 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c63e5-57e3-45c3-bf34-97c843a2a940 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:18.082247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:18.100875 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464352a-fc54-4b9b-9d8c-35b61e762c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:18.102179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464352a-fc54-4b9b-9d8c-35b61e762c13 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:18.102660 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464352a-fc54-4b9b-9d8c-35b61e762c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:18.103149 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464352a-fc54-4b9b-9d8c-35b61e762c13 None admin] PATH_INFO: `/v3/projects/20cc73f001a245c680144a956b81a15e` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:18.105196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464352a-fc54-4b9b-9d8c-35b61e762c13 None admin] RBAC: Authorizing `identity:get_project(project_id=20cc73f001a245c680144a956b81a15e)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:18.109200 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464352a-fc54-4b9b-9d8c-35b61e762c13 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:18.113929 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 101/204] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:17 2022] GET /identity/v3/projects/20cc73f001a245c680144a956b81a15e => generated 302 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:18.115378 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464352a-fc54-4b9b-9d8c-35b61e762c13 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:18.199339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cbd56-6bc4-4874-bbca-5e2c76405937 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:18.276437 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a17c9-c36f-4297-9a4d-4e5de3870037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:18.278030 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a17c9-c36f-4297-9a4d-4e5de3870037 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:18.278828 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a17c9-c36f-4297-9a4d-4e5de3870037 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:18.279658 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a17c9-c36f-4297-9a4d-4e5de3870037 None admin] PATH_INFO: `/v3/projects/60a5733a3c634efca6df17f66d53c587` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:18.285072 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a17c9-c36f-4297-9a4d-4e5de3870037 None admin] RBAC: Authorizing `identity:get_project(project_id=60a5733a3c634efca6df17f66d53c587)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:18.288266 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a17c9-c36f-4297-9a4d-4e5de3870037 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:18.297931 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 104/205] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:17 2022] GET /identity/v3/projects/60a5733a3c634efca6df17f66d53c587 => generated 298 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:18.299995 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a17c9-c36f-4297-9a4d-4e5de3870037 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:18.335013 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464352a-fc54-4b9b-9d8c-35b61e762c13 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:18.376808 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:18.409084 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87bc9f6-2c9d-4324-9fdd-b98cbf3f9839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:18.410521 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87bc9f6-2c9d-4324-9fdd-b98cbf3f9839 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:18.411207 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87bc9f6-2c9d-4324-9fdd-b98cbf3f9839 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:18.411968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87bc9f6-2c9d-4324-9fdd-b98cbf3f9839 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:18.413660 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87bc9f6-2c9d-4324-9fdd-b98cbf3f9839 None admin] RBAC: Adding query filter params (role.id=a0449d430ec54adcabb96193af2f7cd5, scope.project.id=20cc73f001a245c680144a956b81a15e, user.id=e23a452ca033413cb81310b4f12ab72f) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:18.414610 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87bc9f6-2c9d-4324-9fdd-b98cbf3f9839 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:18.417689 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87bc9f6-2c9d-4324-9fdd-b98cbf3f9839 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:18.429701 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 102/206] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:12:18 2022] GET /identity/v3/role_assignments?user.id=e23a452ca033413cb81310b4f12ab72f&scope.project.id=20cc73f001a245c680144a956b81a15e&role.id=a0449d430ec54adcabb96193af2f7cd5 => generated 259 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:18.431694 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87bc9f6-2c9d-4324-9fdd-b98cbf3f9839 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:18.515231 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a17c9-c36f-4297-9a4d-4e5de3870037 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:18.558673 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1f38c-7691-4e26-8896-cda280dc4c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:18.559538 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1f38c-7691-4e26-8896-cda280dc4c18 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:18.560474 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1f38c-7691-4e26-8896-cda280dc4c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:18.560921 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1f38c-7691-4e26-8896-cda280dc4c18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:18.562001 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb1f38c-7691-4e26-8896-cda280dc4c18 None admin] RBAC: Adding query filter params (role.id=e806ce849cf34b92979b5524f3ea9ff6, scope.project.id=20cc73f001a245c680144a956b81a15e, user.id=e23a452ca033413cb81310b4f12ab72f) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:18.562636 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb1f38c-7691-4e26-8896-cda280dc4c18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:18.564364 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb1f38c-7691-4e26-8896-cda280dc4c18 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:18.565441 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:18.573952 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 105/207] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:12:18 2022] GET /identity/v3/role_assignments?user.id=e23a452ca033413cb81310b4f12ab72f&scope.project.id=20cc73f001a245c680144a956b81a15e&role.id=e806ce849cf34b92979b5524f3ea9ff6 => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:18.651650 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87bc9f6-2c9d-4324-9fdd-b98cbf3f9839 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:18.709934 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcdc3b9-99dc-4195-914a-b5e81f1aab2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:18.710580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdc3b9-99dc-4195-914a-b5e81f1aab2c None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:18.710866 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdc3b9-99dc-4195-914a-b5e81f1aab2c None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:18.711132 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdc3b9-99dc-4195-914a-b5e81f1aab2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:18.711912 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcdc3b9-99dc-4195-914a-b5e81f1aab2c None admin] RBAC: Adding query filter params (role.id=6eb34cd17388449f9099dd83fb076032, scope.project.id=60a5733a3c634efca6df17f66d53c587, user.id=257c6b0c67bc4baab9553aba85f9577c) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:18.712224 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcdc3b9-99dc-4195-914a-b5e81f1aab2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:18.713838 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcdc3b9-99dc-4195-914a-b5e81f1aab2c None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:18.724069 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 103/208] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:12:18 2022] GET /identity/v3/role_assignments?user.id=257c6b0c67bc4baab9553aba85f9577c&scope.project.id=60a5733a3c634efca6df17f66d53c587&role.id=6eb34cd17388449f9099dd83fb076032 => generated 608 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:20.064375 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0aa5cd-7550-4015-9917-a9accb73b4d3 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:20.065100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0aa5cd-7550-4015-9917-a9accb73b4d3 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:20.065230 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0aa5cd-7550-4015-9917-a9accb73b4d3 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:20.068562 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 106/209] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:20.079583 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fbd7d-61b3-4bcc-94b9-2ba1edb0aad6 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:20.080364 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fbd7d-61b3-4bcc-94b9-2ba1edb0aad6 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:20.080672 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fbd7d-61b3-4bcc-94b9-2ba1edb0aad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:20.116687 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-704fbd7d-61b3-4bcc-94b9-2ba1edb0aad6 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:20.119164 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-704fbd7d-61b3-4bcc-94b9-2ba1edb0aad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:20.236257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 104/210] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:20.643901 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97323f-2a34-4b72-8c93-f3bda2a61514 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:20.644402 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97323f-2a34-4b72-8c93-f3bda2a61514 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:20.645179 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97323f-2a34-4b72-8c93-f3bda2a61514 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:20.651112 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 107/211] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:20.660824 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724e567-dea8-4a11-a99a-44418a1c5bac None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:20.661232 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724e567-dea8-4a11-a99a-44418a1c5bac None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:20.661854 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724e567-dea8-4a11-a99a-44418a1c5bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:20.692915 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-6724e567-dea8-4a11-a99a-44418a1c5bac None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:20.694862 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-6724e567-dea8-4a11-a99a-44418a1c5bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:20.798058 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:20.802972 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c97323f-2a34-4b72-8c93-f3bda2a61514 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:20.822810 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 105/212] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:21.043326 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:21.052230 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c97323f-2a34-4b72-8c93-f3bda2a61514 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:21.129753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bd2bb-a146-4a8b-bacc-d69b6dd25807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:21.130884 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bd2bb-a146-4a8b-bacc-d69b6dd25807 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:21.131316 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bd2bb-a146-4a8b-bacc-d69b6dd25807 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:21.131797 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bd2bb-a146-4a8b-bacc-d69b6dd25807 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:21.160498 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bd2bb-a146-4a8b-bacc-d69b6dd25807 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:21.173897 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-714bd2bb-a146-4a8b-bacc-d69b6dd25807 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:21.173897 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:21.173897 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:21.173897 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:21.173897 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:21.173897 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:21.173897 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:21.173897 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:21.173897 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:21.173897 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:21.173897 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:21.173897 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:21.173897 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:21.173897 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:21.173897 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:21.173897 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:21.175597 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:21.175597 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:21.175597 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:21.175597 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:21.175597 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:21.175597 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:21.175597 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:21.175597 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:21.175597 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:21.175597 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:21.175597 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:21.175597 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:21.175597 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:21.175597 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:21.175597 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:21.175597 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:21.177006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:21.177006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:21.177006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:21.177006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:21.177006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:21.177006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:21.177006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:21.177006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:21.177006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:21.177006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:21.177006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:21.177006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:12:21.177006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 108/213] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:12:21.185657 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724e567-dea8-4a11-a99a-44418a1c5bac None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:21.354591 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724e567-dea8-4a11-a99a-44418a1c5bac None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:21.381675 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bd2bb-a146-4a8b-bacc-d69b6dd25807 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:21.412078 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a4b5f-b5c9-4817-b73f-c0a5e7ebedb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:21.413297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a4b5f-b5c9-4817-b73f-c0a5e7ebedb4 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:21.414059 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a4b5f-b5c9-4817-b73f-c0a5e7ebedb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:21.414566 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a4b5f-b5c9-4817-b73f-c0a5e7ebedb4 None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:21.415637 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a4b5f-b5c9-4817-b73f-c0a5e7ebedb4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:21.416343 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a4b5f-b5c9-4817-b73f-c0a5e7ebedb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:21.418580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a4b5f-b5c9-4817-b73f-c0a5e7ebedb4 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:21.437050 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 106/214] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:21.448410 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a4b5f-b5c9-4817-b73f-c0a5e7ebedb4 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:21.580995 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:21.619632 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bd2bb-a146-4a8b-bacc-d69b6dd25807 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:21.681303 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75863acc-7fd7-485a-a3c9-184fc94f9d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:21.682252 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75863acc-7fd7-485a-a3c9-184fc94f9d64 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:21.682690 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75863acc-7fd7-485a-a3c9-184fc94f9d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:21.683053 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75863acc-7fd7-485a-a3c9-184fc94f9d64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:21.684668 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75863acc-7fd7-485a-a3c9-184fc94f9d64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:21.686872 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75863acc-7fd7-485a-a3c9-184fc94f9d64 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:21.689285 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 109/215] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:21.691469 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaad689-b6f6-4fd8-8979-07027d206193 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:21.691962 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaad689-b6f6-4fd8-8979-07027d206193 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:21.692445 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaad689-b6f6-4fd8-8979-07027d206193 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:21.695000 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 110/216] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:21.698852 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaad689-b6f6-4fd8-8979-07027d206193 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:21.704917 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a4b5f-b5c9-4817-b73f-c0a5e7ebedb4 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:21.756228 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:21.766266 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb3fa3-e1a5-48de-8aeb-a6071d4be662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:21.766996 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb3fa3-e1a5-48de-8aeb-a6071d4be662 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:21.767390 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb3fa3-e1a5-48de-8aeb-a6071d4be662 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:21.767743 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb3fa3-e1a5-48de-8aeb-a6071d4be662 None admin] PATH_INFO: `/v3/users/eea3d7ec7af946ed9fbdb5fdfc529756` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:21.794153 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb3fa3-e1a5-48de-8aeb-a6071d4be662 None admin] RBAC: Authorizing `identity:get_user(user_id=eea3d7ec7af946ed9fbdb5fdfc529756)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:21.797123 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb3fa3-e1a5-48de-8aeb-a6071d4be662 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:21.799603 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 107/217] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:21 2022] GET /identity/v3/users/eea3d7ec7af946ed9fbdb5fdfc529756 => generated 297 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:21.801450 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a6f72-7949-4a2f-9a23-aba7210b8136 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:21.801877 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a6f72-7949-4a2f-9a23-aba7210b8136 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:21.802169 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a6f72-7949-4a2f-9a23-aba7210b8136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:21.833033 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-866a6f72-7949-4a2f-9a23-aba7210b8136 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:21.835125 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-866a6f72-7949-4a2f-9a23-aba7210b8136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:21.923566 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaad689-b6f6-4fd8-8979-07027d206193 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:21.986462 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 108/218] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:21.987886 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a6f72-7949-4a2f-9a23-aba7210b8136 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:22.015193 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa8762-bb23-4ee4-b56a-6b84a5305f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:22.016004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa8762-bb23-4ee4-b56a-6b84a5305f62 None admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:22.016346 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa8762-bb23-4ee4-b56a-6b84a5305f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:22.016675 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa8762-bb23-4ee4-b56a-6b84a5305f62 None admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:22.017792 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa8762-bb23-4ee4-b56a-6b84a5305f62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:22.021142 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa8762-bb23-4ee4-b56a-6b84a5305f62 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:22.059540 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 111/219] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Aug 23 22:12:21 2022] POST /identity/v3/users => generated 297 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:12:22.061669 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e9183-d302-48d9-8254-72934c64c43c None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:22.062112 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e9183-d302-48d9-8254-72934c64c43c None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:22.062840 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e9183-d302-48d9-8254-72934c64c43c None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:22.066444 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 112/220] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:22.066680 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:22.072822 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b239e81-4860-4d1d-99ba-fc5c3cb967a1 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:22.073165 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b239e81-4860-4d1d-99ba-fc5c3cb967a1 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:22.073658 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b239e81-4860-4d1d-99ba-fc5c3cb967a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:22.103126 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-7b239e81-4860-4d1d-99ba-fc5c3cb967a1 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:22.105474 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-7b239e81-4860-4d1d-99ba-fc5c3cb967a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:22.199876 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a6f72-7949-4a2f-9a23-aba7210b8136 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:22.245261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 113/221] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:22.268513 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061032f-b7df-42d5-b367-cf9a3ebc0acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:22.270114 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061032f-b7df-42d5-b367-cf9a3ebc0acc None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:22.270909 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061032f-b7df-42d5-b367-cf9a3ebc0acc None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:22.271660 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061032f-b7df-42d5-b367-cf9a3ebc0acc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:22.400481 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6061032f-b7df-42d5-b367-cf9a3ebc0acc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:22.402534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6061032f-b7df-42d5-b367-cf9a3ebc0acc None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:22.462484 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:22.473318 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b239e81-4860-4d1d-99ba-fc5c3cb967a1 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:22.522305 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:22.581793 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 109/222] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:22.589452 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061032f-b7df-42d5-b367-cf9a3ebc0acc None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:22.711958 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b239e81-4860-4d1d-99ba-fc5c3cb967a1 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:22.810768 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea707b-13e2-4223-ab84-42ada04e8ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:22.812831 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea707b-13e2-4223-ab84-42ada04e8ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:22.816028 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea707b-13e2-4223-ab84-42ada04e8ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:22.821106 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061032f-b7df-42d5-b367-cf9a3ebc0acc None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:22.822311 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea707b-13e2-4223-ab84-42ada04e8ce8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:22.857609 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea707b-13e2-4223-ab84-42ada04e8ce8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:22.870133 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-4eea707b-13e2-4223-ab84-42ada04e8ce8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:12:22.870133 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:22.870133 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:22.870133 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:22.870133 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:22.870133 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:22.870133 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:22.870133 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:22.870133 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:22.870133 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:22.870133 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:22.870133 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:22.870133 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:22.870133 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:22.870133 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:22.870133 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:22.872304 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:22.872304 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:22.872304 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:22.872304 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:22.872304 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:22.872304 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:22.872304 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:22.872304 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:22.872304 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:22.872304 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:22.872304 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:22.872304 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:22.872304 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:22.872304 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:22.872304 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:22.872304 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:22.874433 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:22.874433 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:22.874433 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:22.874433 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:22.874433 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:22.874433 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:22.874433 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:22.874433 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:22.874433 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:22.874433 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:22.874433 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:12:22.874433 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:12:22.879545 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 114/223] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:12:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 409 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:22.888976 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea707b-13e2-4223-ab84-42ada04e8ce8 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:22.890841 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96919c40-d52e-4f91-b671-75e398e9f11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:22.891957 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96919c40-d52e-4f91-b671-75e398e9f11d None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:22.892424 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96919c40-d52e-4f91-b671-75e398e9f11d None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:22.892922 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96919c40-d52e-4f91-b671-75e398e9f11d None admin] PATH_INFO: `/v3/projects/20cc73f001a245c680144a956b81a15e` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:22.895161 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96919c40-d52e-4f91-b671-75e398e9f11d None admin] RBAC: Authorizing `identity:get_project(project_id=20cc73f001a245c680144a956b81a15e)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:22.897919 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96919c40-d52e-4f91-b671-75e398e9f11d None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:22.905467 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 110/224] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:22 2022] GET /identity/v3/projects/20cc73f001a245c680144a956b81a15e => generated 302 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:22.914729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96919c40-d52e-4f91-b671-75e398e9f11d None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:22.924687 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:23.080804 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:23.135935 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea707b-13e2-4223-ab84-42ada04e8ce8 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:23.176252 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96919c40-d52e-4f91-b671-75e398e9f11d None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:23.202056 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4c40c-cead-407d-b35c-5250456ef182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:23.203200 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4c40c-cead-407d-b35c-5250456ef182 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:23.204529 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4c40c-cead-407d-b35c-5250456ef182 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:23.205140 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4c40c-cead-407d-b35c-5250456ef182 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:23.227361 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe4c40c-cead-407d-b35c-5250456ef182 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:23.238268 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-5fe4c40c-cead-407d-b35c-5250456ef182 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:12:23.238268 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:23.238268 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:23.238268 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:23.238268 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:23.238268 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:23.238268 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:23.238268 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:23.238268 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:23.238268 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:23.238268 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:23.238268 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:23.238268 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:23.238268 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:23.238268 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:23.238268 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:23.240339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:23.240339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:23.240339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:23.240339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:23.240339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:23.240339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:23.240339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:23.240339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:23.240339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:23.240339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:23.240339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:23.240339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:23.240339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:23.240339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:23.240339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:23.240339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:23.242656 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:23.242656 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:23.242656 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:23.242656 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:23.242656 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:23.242656 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:23.242656 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:23.242656 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:23.242656 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:23.242656 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:23.242656 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:12:23.242656 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:12:23.244391 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182b79b-c0c2-4eb7-bf51-593dc0d4eb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:23.245619 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182b79b-c0c2-4eb7-bf51-593dc0d4eb83 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:23.246203 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182b79b-c0c2-4eb7-bf51-593dc0d4eb83 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:23.246818 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182b79b-c0c2-4eb7-bf51-593dc0d4eb83 None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:23.248247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a182b79b-c0c2-4eb7-bf51-593dc0d4eb83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:23.248491 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 115/225] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Aug 23 22:12:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:23.249166 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a182b79b-c0c2-4eb7-bf51-593dc0d4eb83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:23.250654 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a182b79b-c0c2-4eb7-bf51-593dc0d4eb83 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:23.251165 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4c40c-cead-407d-b35c-5250456ef182 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:23.269439 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 111/226] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:23.269439 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182b79b-c0c2-4eb7-bf51-593dc0d4eb83 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:23.390327 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:23.464381 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4c40c-cead-407d-b35c-5250456ef182 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:23.465465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182b79b-c0c2-4eb7-bf51-593dc0d4eb83 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:23.534443 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d6a0b-a181-4fcf-9b5a-a38a73fc8459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:23.536182 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d6a0b-a181-4fcf-9b5a-a38a73fc8459 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:23.536739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d6a0b-a181-4fcf-9b5a-a38a73fc8459 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:23.537212 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d6a0b-a181-4fcf-9b5a-a38a73fc8459 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:23.538219 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d6a0b-a181-4fcf-9b5a-a38a73fc8459 None admin] RBAC: Adding query filter params (role.id=eabf42a0387a47218c5ce577dd65f61c, scope.project.id=20cc73f001a245c680144a956b81a15e, user.id=eea3d7ec7af946ed9fbdb5fdfc529756) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:23.538690 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d6a0b-a181-4fcf-9b5a-a38a73fc8459 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:23.541076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d6a0b-a181-4fcf-9b5a-a38a73fc8459 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:23.542893 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231d6c1-fffc-41a3-8692-f1ddea09e808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:23.544081 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231d6c1-fffc-41a3-8692-f1ddea09e808 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:23.544351 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:23.544807 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231d6c1-fffc-41a3-8692-f1ddea09e808 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:23.546233 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231d6c1-fffc-41a3-8692-f1ddea09e808 None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:23.547859 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231d6c1-fffc-41a3-8692-f1ddea09e808 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:23.549410 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231d6c1-fffc-41a3-8692-f1ddea09e808 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:23.552110 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231d6c1-fffc-41a3-8692-f1ddea09e808 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:23.554520 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 116/227] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:12:23 2022] GET /identity/v3/role_assignments?user.id=eea3d7ec7af946ed9fbdb5fdfc529756&scope.project.id=20cc73f001a245c680144a956b81a15e&role.id=eabf42a0387a47218c5ce577dd65f61c => generated 259 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:23.557169 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d6a0b-a181-4fcf-9b5a-a38a73fc8459 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:23.594534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 112/228] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:12:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:23.603580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231d6c1-fffc-41a3-8692-f1ddea09e808 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:23.879155 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d6a0b-a181-4fcf-9b5a-a38a73fc8459 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:23.952730 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231d6c1-fffc-41a3-8692-f1ddea09e808 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:23.976421 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639bdada-c824-4c50-8902-0e6080201e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:23.978197 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bdada-c824-4c50-8902-0e6080201e31 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:23.979161 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bdada-c824-4c50-8902-0e6080201e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:23.980059 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bdada-c824-4c50-8902-0e6080201e31 None admin] PATH_INFO: `/v3/users/e23a452ca033413cb81310b4f12ab72f` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:23.983703 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639bdada-c824-4c50-8902-0e6080201e31 None admin] RBAC: Authorizing `identity:get_user(user_id=e23a452ca033413cb81310b4f12ab72f)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:23.986917 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639bdada-c824-4c50-8902-0e6080201e31 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:23.995833 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 117/229] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:23 2022] GET /identity/v3/users/e23a452ca033413cb81310b4f12ab72f => generated 283 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:24.003728 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639bdada-c824-4c50-8902-0e6080201e31 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:24.034212 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:24.072412 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ce100-53fe-4a18-a84c-e84deda0d367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:24.073583 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ce100-53fe-4a18-a84c-e84deda0d367 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:24.074094 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ce100-53fe-4a18-a84c-e84deda0d367 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:24.074605 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ce100-53fe-4a18-a84c-e84deda0d367 None admin] PATH_INFO: `/v3/users/e23a452ca033413cb81310b4f12ab72f` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:24.082199 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ce100-53fe-4a18-a84c-e84deda0d367 None admin] RBAC: Authorizing `identity:get_user(user_id=e23a452ca033413cb81310b4f12ab72f)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:24.085384 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ce100-53fe-4a18-a84c-e84deda0d367 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:24.088889 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 113/230] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:23 2022] GET /identity/v3/users/e23a452ca033413cb81310b4f12ab72f => generated 283 bytes in 486 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:24.126817 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ce100-53fe-4a18-a84c-e84deda0d367 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:24.211432 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:24.276738 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639bdada-c824-4c50-8902-0e6080201e31 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:24.334899 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7eace0-2758-42da-b32f-1d9116369390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:24.336053 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7eace0-2758-42da-b32f-1d9116369390 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:24.336621 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7eace0-2758-42da-b32f-1d9116369390 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:24.337151 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7eace0-2758-42da-b32f-1d9116369390 None admin] PATH_INFO: `/v3/projects/20cc73f001a245c680144a956b81a15e` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:24.339023 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7eace0-2758-42da-b32f-1d9116369390 None admin] RBAC: Authorizing `identity:get_project(project_id=20cc73f001a245c680144a956b81a15e)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:24.341439 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7eace0-2758-42da-b32f-1d9116369390 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:24.344134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 118/231] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:24 2022] GET /identity/v3/projects/20cc73f001a245c680144a956b81a15e => generated 302 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:24.355483 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7eace0-2758-42da-b32f-1d9116369390 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:24.509039 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7eace0-2758-42da-b32f-1d9116369390 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:24.565422 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5cefa-44d8-4321-b37d-972ded07ba91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:24.567180 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5cefa-44d8-4321-b37d-972ded07ba91 None admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:24.568043 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5cefa-44d8-4321-b37d-972ded07ba91 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:24.568862 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5cefa-44d8-4321-b37d-972ded07ba91 None admin] PATH_INFO: `/v3/projects/20cc73f001a245c680144a956b81a15e/users/e23a452ca033413cb81310b4f12ab72f/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:24.573560 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab5cefa-44d8-4321-b37d-972ded07ba91 None admin] RBAC: Authorizing `identity:create_grant(project_id=20cc73f001a245c680144a956b81a15e, user_id=e23a452ca033413cb81310b4f12ab72f, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:24.577324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab5cefa-44d8-4321-b37d-972ded07ba91 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:24.585860 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:24.594034 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ce100-53fe-4a18-a84c-e84deda0d367 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:24.611878 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 119/232] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Aug 23 22:12:24 2022] PUT /identity/v3/projects/20cc73f001a245c680144a956b81a15e/users/e23a452ca033413cb81310b4f12ab72f/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:12:24.663306 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed30fb-a9c6-479e-8eba-62da81b6050c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:24.664767 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed30fb-a9c6-479e-8eba-62da81b6050c None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:24.665426 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed30fb-a9c6-479e-8eba-62da81b6050c None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:24.666193 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed30fb-a9c6-479e-8eba-62da81b6050c None admin] PATH_INFO: `/v3/projects/20cc73f001a245c680144a956b81a15e` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:24.668794 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed30fb-a9c6-479e-8eba-62da81b6050c None admin] RBAC: Authorizing `identity:get_project(project_id=20cc73f001a245c680144a956b81a15e)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:24.670926 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed30fb-a9c6-479e-8eba-62da81b6050c None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:24.673574 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 114/233] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:24 2022] GET /identity/v3/projects/20cc73f001a245c680144a956b81a15e => generated 302 bytes in 548 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:24.682778 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5cefa-44d8-4321-b37d-972ded07ba91 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:24.868606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5cefa-44d8-4321-b37d-972ded07ba91 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:24.917510 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898739c0-7953-4a16-bb8c-b865ae8e52fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:24.918254 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898739c0-7953-4a16-bb8c-b865ae8e52fe None admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:24.918612 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898739c0-7953-4a16-bb8c-b865ae8e52fe None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:24.918880 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898739c0-7953-4a16-bb8c-b865ae8e52fe None admin] PATH_INFO: `/v3/projects/20cc73f001a245c680144a956b81a15e/users/e23a452ca033413cb81310b4f12ab72f/roles/a0449d430ec54adcabb96193af2f7cd5` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:24.921883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898739c0-7953-4a16-bb8c-b865ae8e52fe None admin] RBAC: Authorizing `identity:create_grant(project_id=20cc73f001a245c680144a956b81a15e, user_id=e23a452ca033413cb81310b4f12ab72f, role_id=a0449d430ec54adcabb96193af2f7cd5)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:24.923538 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898739c0-7953-4a16-bb8c-b865ae8e52fe None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:24.945027 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 120/234] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Aug 23 22:12:24 2022] PUT /identity/v3/projects/20cc73f001a245c680144a956b81a15e/users/e23a452ca033413cb81310b4f12ab72f/roles/a0449d430ec54adcabb96193af2f7cd5 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:12:25.632734 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686eff2-5bfa-4653-8401-e828b0c86141 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:25.634400 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686eff2-5bfa-4653-8401-e828b0c86141 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:25.635210 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686eff2-5bfa-4653-8401-e828b0c86141 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:25.638739 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 115/235] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:25.645731 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230621c0-965d-4ec7-8766-fdee936dbe26 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:25.647157 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230621c0-965d-4ec7-8766-fdee936dbe26 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:25.647873 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230621c0-965d-4ec7-8766-fdee936dbe26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:25.690616 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-230621c0-965d-4ec7-8766-fdee936dbe26 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:25.693421 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-230621c0-965d-4ec7-8766-fdee936dbe26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:25.844201 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:25.883236 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 121/236] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:12:25.930763 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974ebe0-68e4-4590-a7c8-4c004ac2d905 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:25.931049 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974ebe0-68e4-4590-a7c8-4c004ac2d905 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:25.931352 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974ebe0-68e4-4590-a7c8-4c004ac2d905 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:25.933318 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 116/237] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:12:25.942770 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d41da6-0b5c-4826-aa92-7a32d0e17134 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:25.943259 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d41da6-0b5c-4826-aa92-7a32d0e17134 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:25.943730 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d41da6-0b5c-4826-aa92-7a32d0e17134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:25.986270 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-a2d41da6-0b5c-4826-aa92-7a32d0e17134 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:25.988427 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-a2d41da6-0b5c-4826-aa92-7a32d0e17134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:26.160084 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 122/238] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:26.504336 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974ebe0-68e4-4590-a7c8-4c004ac2d905 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:26.646676 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d41da6-0b5c-4826-aa92-7a32d0e17134 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:26.671247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:26.767191 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974ebe0-68e4-4590-a7c8-4c004ac2d905 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:26.816002 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830b7d3-3895-41df-bbce-cff8da33e35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:26.816702 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830b7d3-3895-41df-bbce-cff8da33e35e None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:26.816989 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830b7d3-3895-41df-bbce-cff8da33e35e None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:26.817263 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830b7d3-3895-41df-bbce-cff8da33e35e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:26.831513 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830b7d3-3895-41df-bbce-cff8da33e35e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:26.837031 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-9830b7d3-3895-41df-bbce-cff8da33e35e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:12:26.837031 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:26.837031 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:26.837031 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:26.837031 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:26.837031 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:26.837031 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:26.837031 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:26.837031 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:26.837031 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:26.837031 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:26.837031 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:26.837031 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:26.837031 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:26.837031 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:26.837031 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:26.838616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:26.838616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:26.838616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:26.838616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:26.838616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:26.838616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:26.838616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:26.838616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:26.838616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:26.838616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:26.838616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:26.838616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:26.838616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:26.838616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:26.838616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:26.838616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:26.840141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:26.840141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:26.840141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:26.840141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:26.840141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:26.840141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:26.840141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:26.840141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:26.840141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:26.840141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:26.840141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:12:26.840141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:12:26.840141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 117/239] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:12:26.840141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3b7fa-5b3f-4b71-aa92-561785de5792 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:26.843148 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3b7fa-5b3f-4b71-aa92-561785de5792 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:26.843148 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3b7fa-5b3f-4b71-aa92-561785de5792 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:26.843148 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 118/240] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:26.851645 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3b7fa-5b3f-4b71-aa92-561785de5792 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:26.861892 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d41da6-0b5c-4826-aa92-7a32d0e17134 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:26.886410 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:26.923590 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f174c1-887b-43c0-8719-27f995b3fc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:26.925137 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f174c1-887b-43c0-8719-27f995b3fc07 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:26.925542 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f174c1-887b-43c0-8719-27f995b3fc07 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:26.925788 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f174c1-887b-43c0-8719-27f995b3fc07 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:26.928023 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f174c1-887b-43c0-8719-27f995b3fc07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:26.930136 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f174c1-887b-43c0-8719-27f995b3fc07 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:26.933940 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 123/241] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:26.936190 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b7aa9-9e21-4321-a223-2d56fccb8df5 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:26.936190 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b7aa9-9e21-4321-a223-2d56fccb8df5 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:26.936570 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b7aa9-9e21-4321-a223-2d56fccb8df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:26.963234 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-085b7aa9-9e21-4321-a223-2d56fccb8df5 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:26.964772 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-085b7aa9-9e21-4321-a223-2d56fccb8df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:27.029650 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3b7fa-5b3f-4b71-aa92-561785de5792 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:27.065219 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:27.082716 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f4edc-e866-4b73-bc50-c2686fc3d482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:27.083943 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f4edc-e866-4b73-bc50-c2686fc3d482 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:27.084247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f4edc-e866-4b73-bc50-c2686fc3d482 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:27.084515 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f4edc-e866-4b73-bc50-c2686fc3d482 None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:27.085430 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f4edc-e866-4b73-bc50-c2686fc3d482 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:27.085867 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f4edc-e866-4b73-bc50-c2686fc3d482 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:27.087278 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f4edc-e866-4b73-bc50-c2686fc3d482 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:27.098378 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 124/242] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:27.099302 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b7aa9-9e21-4321-a223-2d56fccb8df5 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:27.134268 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 119/243] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:27.157802 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f4edc-e866-4b73-bc50-c2686fc3d482 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:27.237877 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b7aa9-9e21-4321-a223-2d56fccb8df5 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:27.255698 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:27.281304 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558d615-1717-408a-9077-3ec3c5405be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:27.282003 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558d615-1717-408a-9077-3ec3c5405be4 None admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:27.282259 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558d615-1717-408a-9077-3ec3c5405be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:27.282552 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558d615-1717-408a-9077-3ec3c5405be4 None admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:27.283301 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2558d615-1717-408a-9077-3ec3c5405be4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:27.284782 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2558d615-1717-408a-9077-3ec3c5405be4 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:27.313299 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 125/244] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Aug 23 22:12:27 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:12:27.501090 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f4edc-e866-4b73-bc50-c2686fc3d482 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:27.604815 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedb7cc-3792-43e9-a069-ef06e358a494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:27.606123 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedb7cc-3792-43e9-a069-ef06e358a494 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:27.607865 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedb7cc-3792-43e9-a069-ef06e358a494 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:27.608584 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedb7cc-3792-43e9-a069-ef06e358a494 None admin] PATH_INFO: `/v3/users/e2ce613950f342398f000c74ab7e3c5a` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:27.647939 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fedb7cc-3792-43e9-a069-ef06e358a494 None admin] RBAC: Authorizing `identity:get_user(user_id=e2ce613950f342398f000c74ab7e3c5a)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:27.649653 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fedb7cc-3792-43e9-a069-ef06e358a494 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:27.651756 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 120/245] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:27 2022] GET /identity/v3/users/e2ce613950f342398f000c74ab7e3c5a => generated 297 bytes in 495 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:27.661200 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558d615-1717-408a-9077-3ec3c5405be4 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:27.827629 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558d615-1717-408a-9077-3ec3c5405be4 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:27.891035 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d681f7-a987-4efb-8487-62a60659039f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:27.891951 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d681f7-a987-4efb-8487-62a60659039f None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:27.892426 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d681f7-a987-4efb-8487-62a60659039f None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:27.892889 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d681f7-a987-4efb-8487-62a60659039f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:27.910807 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedb7cc-3792-43e9-a069-ef06e358a494 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:27.986457 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:28.010396 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:28.060434 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d681f7-a987-4efb-8487-62a60659039f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:28.063966 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d681f7-a987-4efb-8487-62a60659039f None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:28.127645 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedb7cc-3792-43e9-a069-ef06e358a494 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:28.199383 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f991a-7051-458b-a187-cddb204eccb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:28.200943 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f991a-7051-458b-a187-cddb204eccb3 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:28.201657 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f991a-7051-458b-a187-cddb204eccb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:28.202280 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f991a-7051-458b-a187-cddb204eccb3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:28.219584 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f991a-7051-458b-a187-cddb204eccb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:28.227636 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-340f991a-7051-458b-a187-cddb204eccb3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:28.227636 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:28.227636 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:28.227636 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:28.227636 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:28.227636 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:28.227636 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:28.227636 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:28.227636 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:28.227636 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:28.227636 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:28.227636 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:28.227636 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:28.227636 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:28.227636 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:28.227636 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:28.229212 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:28.229212 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:28.229212 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:28.229212 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:28.229212 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:28.229212 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:28.229212 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:28.229212 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:28.229212 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:28.229212 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:28.229212 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:28.229212 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:28.229212 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:28.229212 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:28.229212 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:28.229212 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:28.231313 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:28.231313 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:28.231313 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:28.231313 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:28.231313 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:28.231313 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:28.231313 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:28.231313 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:28.231313 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:28.231313 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:28.231313 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:28.231313 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:12:28.231313 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 121/246] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:28.231313 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea3d07-3aa2-4d71-90ed-95290a9c64e7 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:28.233587 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea3d07-3aa2-4d71-90ed-95290a9c64e7 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:28.233587 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea3d07-3aa2-4d71-90ed-95290a9c64e7 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:28.237538 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 122/247] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:28.237538 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3813273-8093-4aca-bcfd-ff8065525024 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:28.237538 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3813273-8093-4aca-bcfd-ff8065525024 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:28.237538 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3813273-8093-4aca-bcfd-ff8065525024 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:28.239634 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 123/248] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:28.244256 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06697939-f6e8-4785-9a20-5a4ff56ad134 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:28.244920 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06697939-f6e8-4785-9a20-5a4ff56ad134 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:28.245620 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06697939-f6e8-4785-9a20-5a4ff56ad134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:28.246033 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 126/249] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:28.254785 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf96fc-82ff-45c6-9828-5076a55d25a0 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:28.255065 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf96fc-82ff-45c6-9828-5076a55d25a0 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:28.255363 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf96fc-82ff-45c6-9828-5076a55d25a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:28.277467 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-06697939-f6e8-4785-9a20-5a4ff56ad134 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:28.279699 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-06697939-f6e8-4785-9a20-5a4ff56ad134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:28.280846 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-c0bf96fc-82ff-45c6-9828-5076a55d25a0 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:28.282213 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-c0bf96fc-82ff-45c6-9828-5076a55d25a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:28.397534 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:28.407275 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 124/250] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:12:28.408898 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06697939-f6e8-4785-9a20-5a4ff56ad134 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:28.411208 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 127/251] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:28.412304 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf96fc-82ff-45c6-9828-5076a55d25a0 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:28.525907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:28.586776 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf96fc-82ff-45c6-9828-5076a55d25a0 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:28.660221 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42451139-e472-4f27-b233-9fee5c85cf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:28.661251 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42451139-e472-4f27-b233-9fee5c85cf33 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:28.662337 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42451139-e472-4f27-b233-9fee5c85cf33 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:28.662811 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42451139-e472-4f27-b233-9fee5c85cf33 None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:28.663725 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42451139-e472-4f27-b233-9fee5c85cf33 None admin] RBAC: Adding query filter params (name=member) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:28.664209 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42451139-e472-4f27-b233-9fee5c85cf33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:28.665998 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42451139-e472-4f27-b233-9fee5c85cf33 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:28.680182 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 128/252] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:28.688292 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42451139-e472-4f27-b233-9fee5c85cf33 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:28.808931 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:28.813387 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06697939-f6e8-4785-9a20-5a4ff56ad134 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:28.888793 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45170260-f0ce-46d4-967a-023e47c49afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:28.889475 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45170260-f0ce-46d4-967a-023e47c49afc None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:28.889756 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45170260-f0ce-46d4-967a-023e47c49afc None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:28.890026 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45170260-f0ce-46d4-967a-023e47c49afc None admin] PATH_INFO: `/v3/projects/20cc73f001a245c680144a956b81a15e` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:28.892474 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45170260-f0ce-46d4-967a-023e47c49afc None admin] RBAC: Authorizing `identity:get_project(project_id=20cc73f001a245c680144a956b81a15e)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:28.894041 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45170260-f0ce-46d4-967a-023e47c49afc None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:28.897035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 125/253] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:28 2022] GET /identity/v3/projects/20cc73f001a245c680144a956b81a15e => generated 302 bytes in 489 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:28.907289 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45170260-f0ce-46d4-967a-023e47c49afc None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:28.914583 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42451139-e472-4f27-b233-9fee5c85cf33 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:29.017010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d1891-cda1-4767-995d-df3850a3a79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:29.018735 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d1891-cda1-4767-995d-df3850a3a79d None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:29.019373 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d1891-cda1-4767-995d-df3850a3a79d None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:29.019908 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d1891-cda1-4767-995d-df3850a3a79d None admin] PATH_INFO: `/v3/users/eea3d7ec7af946ed9fbdb5fdfc529756` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:29.021899 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d1891-cda1-4767-995d-df3850a3a79d None admin] RBAC: Authorizing `identity:get_user(user_id=eea3d7ec7af946ed9fbdb5fdfc529756)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:29.025546 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d1891-cda1-4767-995d-df3850a3a79d None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:29.030341 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 129/254] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:28 2022] GET /identity/v3/users/eea3d7ec7af946ed9fbdb5fdfc529756 => generated 297 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:29.032897 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d1891-cda1-4767-995d-df3850a3a79d None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:29.118300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:29.121412 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45170260-f0ce-46d4-967a-023e47c49afc None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:29.162533 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cd576-ea84-43e3-af88-a28058904734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:29.163460 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cd576-ea84-43e3-af88-a28058904734 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:29.163998 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cd576-ea84-43e3-af88-a28058904734 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:29.164415 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cd576-ea84-43e3-af88-a28058904734 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:29.165326 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59cd576-ea84-43e3-af88-a28058904734 None admin] RBAC: Adding query filter params (role.id=6eb34cd17388449f9099dd83fb076032, scope.project.id=20cc73f001a245c680144a956b81a15e, user.id=e2ce613950f342398f000c74ab7e3c5a) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:29.165811 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59cd576-ea84-43e3-af88-a28058904734 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:29.167457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59cd576-ea84-43e3-af88-a28058904734 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:29.181518 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 126/255] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:12:28 2022] GET /identity/v3/role_assignments?user.id=e2ce613950f342398f000c74ab7e3c5a&scope.project.id=20cc73f001a245c680144a956b81a15e&role.id=6eb34cd17388449f9099dd83fb076032 => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:29.182837 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cd576-ea84-43e3-af88-a28058904734 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:29.257408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d1891-cda1-4767-995d-df3850a3a79d None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:29.314186 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:29.347522 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168a8be-f15b-430f-9723-f915e47f0f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:29.348647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168a8be-f15b-430f-9723-f915e47f0f7a None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:29.349191 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168a8be-f15b-430f-9723-f915e47f0f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:29.349838 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168a8be-f15b-430f-9723-f915e47f0f7a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:29.365919 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cd576-ea84-43e3-af88-a28058904734 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:29.389406 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168a8be-f15b-430f-9723-f915e47f0f7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:29.395568 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-6168a8be-f15b-430f-9723-f915e47f0f7a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:12:29.395568 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:29.395568 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:29.395568 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:29.395568 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:29.395568 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:29.395568 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:29.395568 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:29.395568 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:29.395568 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:29.395568 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:29.395568 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:29.395568 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:29.395568 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:29.395568 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:29.395568 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:29.397159 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:29.397159 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:29.397159 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:29.397159 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:29.397159 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:29.397159 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:29.397159 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:29.397159 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:29.397159 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:29.397159 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:29.397159 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:29.397159 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:29.397159 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:29.397159 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:29.397159 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:29.397159 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:29.398643 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:29.398643 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:29.398643 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:29.398643 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:29.398643 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:29.398643 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:29.398643 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:29.398643 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:29.398643 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:29.398643 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:29.398643 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:12:29.398643 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:12:29.406309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 130/256] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Aug 23 22:12:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:29.407309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168a8be-f15b-430f-9723-f915e47f0f7a None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:29.451629 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e3dfb-2380-447a-93e0-64bf261fbb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:29.452296 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e3dfb-2380-447a-93e0-64bf261fbb58 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:29.452573 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e3dfb-2380-447a-93e0-64bf261fbb58 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:29.452842 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e3dfb-2380-447a-93e0-64bf261fbb58 None admin] PATH_INFO: `/v3/projects/20cc73f001a245c680144a956b81a15e` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:29.457891 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e3dfb-2380-447a-93e0-64bf261fbb58 None admin] RBAC: Authorizing `identity:get_project(project_id=20cc73f001a245c680144a956b81a15e)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:29.459526 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e3dfb-2380-447a-93e0-64bf261fbb58 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:29.462124 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 127/257] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:29 2022] GET /identity/v3/projects/20cc73f001a245c680144a956b81a15e => generated 302 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:29.463277 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e3dfb-2380-447a-93e0-64bf261fbb58 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:29.509724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:29.607483 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e3dfb-2380-447a-93e0-64bf261fbb58 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:29.669481 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050243ef-615b-4d20-8ceb-594281414b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:29.670051 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050243ef-615b-4d20-8ceb-594281414b45 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:29.670351 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050243ef-615b-4d20-8ceb-594281414b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:29.670613 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050243ef-615b-4d20-8ceb-594281414b45 None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:29.671403 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050243ef-615b-4d20-8ceb-594281414b45 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:29.671803 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050243ef-615b-4d20-8ceb-594281414b45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:29.673779 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050243ef-615b-4d20-8ceb-594281414b45 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:29.690273 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 128/258] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:12:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:29.696427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050243ef-615b-4d20-8ceb-594281414b45 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:29.697479 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168a8be-f15b-430f-9723-f915e47f0f7a None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:29.804695 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5a1b3-0ba0-4fdd-a77a-1af73ff95b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:29.805787 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5a1b3-0ba0-4fdd-a77a-1af73ff95b2a None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:29.806237 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5a1b3-0ba0-4fdd-a77a-1af73ff95b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:29.806694 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5a1b3-0ba0-4fdd-a77a-1af73ff95b2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:29.851226 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af5a1b3-0ba0-4fdd-a77a-1af73ff95b2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:29.884147 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-8af5a1b3-0ba0-4fdd-a77a-1af73ff95b2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:12:29.884147 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:29.884147 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:29.884147 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:29.884147 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:29.884147 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:29.884147 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:29.884147 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:29.884147 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:29.884147 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:29.884147 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:29.884147 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:29.884147 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:29.884147 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:29.884147 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:29.884147 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:29.885958 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:29.885958 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:29.885958 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:29.885958 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:29.885958 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:29.885958 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:29.885958 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:29.885958 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:29.885958 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:29.885958 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:29.885958 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:29.885958 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:29.885958 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:29.885958 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:29.885958 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:29.885958 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:29.887358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:29.887358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:29.887358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:29.887358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:29.887358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:29.887358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:29.887358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:29.887358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:29.887358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:29.887358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:29.887358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:12:29.887358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:12:29.893032 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 131/259] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:12:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 486 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:29.895016 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5a1b3-0ba0-4fdd-a77a-1af73ff95b2a None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:29.929736 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:29.939970 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050243ef-615b-4d20-8ceb-594281414b45 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:29.983016 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18298ea6-5fde-4982-8f02-42dbcb9f5b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:29.983714 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18298ea6-5fde-4982-8f02-42dbcb9f5b9b None admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:29.984059 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18298ea6-5fde-4982-8f02-42dbcb9f5b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:29.984383 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18298ea6-5fde-4982-8f02-42dbcb9f5b9b None admin] PATH_INFO: `/v3/projects/20cc73f001a245c680144a956b81a15e/users/eea3d7ec7af946ed9fbdb5fdfc529756/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:29.986774 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18298ea6-5fde-4982-8f02-42dbcb9f5b9b None admin] RBAC: Authorizing `identity:create_grant(project_id=20cc73f001a245c680144a956b81a15e, user_id=eea3d7ec7af946ed9fbdb5fdfc529756, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:29.989390 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18298ea6-5fde-4982-8f02-42dbcb9f5b9b None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:30.032478 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 129/260] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Aug 23 22:12:29 2022] PUT /identity/v3/projects/20cc73f001a245c680144a956b81a15e/users/eea3d7ec7af946ed9fbdb5fdfc529756/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:12:30.033527 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18298ea6-5fde-4982-8f02-42dbcb9f5b9b None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:30.034136 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:30.140997 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5a1b3-0ba0-4fdd-a77a-1af73ff95b2a None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:30.209086 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23efd79c-26eb-46e9-bddf-d91f12465e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:30.209939 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efd79c-26eb-46e9-bddf-d91f12465e29 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:30.210332 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efd79c-26eb-46e9-bddf-d91f12465e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:30.210717 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efd79c-26eb-46e9-bddf-d91f12465e29 None admin] PATH_INFO: `/v3/users/e23a452ca033413cb81310b4f12ab72f` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:30.212409 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23efd79c-26eb-46e9-bddf-d91f12465e29 None admin] RBAC: Authorizing `identity:get_user(user_id=e23a452ca033413cb81310b4f12ab72f)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:30.215005 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23efd79c-26eb-46e9-bddf-d91f12465e29 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:30.219142 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 132/261] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:29 2022] GET /identity/v3/users/e23a452ca033413cb81310b4f12ab72f => generated 283 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:30.227332 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23efd79c-26eb-46e9-bddf-d91f12465e29 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:30.240057 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18298ea6-5fde-4982-8f02-42dbcb9f5b9b None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:30.280431 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411666eb-0aed-4e5e-8e42-c6908fb1f39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:30.281110 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411666eb-0aed-4e5e-8e42-c6908fb1f39c None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:30.281425 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411666eb-0aed-4e5e-8e42-c6908fb1f39c None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:30.281733 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411666eb-0aed-4e5e-8e42-c6908fb1f39c None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:30.282642 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411666eb-0aed-4e5e-8e42-c6908fb1f39c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:30.282954 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411666eb-0aed-4e5e-8e42-c6908fb1f39c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:30.284487 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411666eb-0aed-4e5e-8e42-c6908fb1f39c None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:30.295480 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 130/262] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:30.306672 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411666eb-0aed-4e5e-8e42-c6908fb1f39c None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:30.355450 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:30.456276 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23efd79c-26eb-46e9-bddf-d91f12465e29 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:30.486051 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:30.501315 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd9a32-c9a1-4cfa-af6d-e1eb30f716fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:30.502372 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd9a32-c9a1-4cfa-af6d-e1eb30f716fd None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:30.502682 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd9a32-c9a1-4cfa-af6d-e1eb30f716fd None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:30.503728 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd9a32-c9a1-4cfa-af6d-e1eb30f716fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:30.564607 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411666eb-0aed-4e5e-8e42-c6908fb1f39c None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:30.595976 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd9a32-c9a1-4cfa-af6d-e1eb30f716fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:30.597614 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd9a32-c9a1-4cfa-af6d-e1eb30f716fd None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:30.691620 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70783f33-a98f-450a-82c9-daf2c91e596d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:30.692291 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70783f33-a98f-450a-82c9-daf2c91e596d None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:30.692569 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70783f33-a98f-450a-82c9-daf2c91e596d None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:30.692847 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70783f33-a98f-450a-82c9-daf2c91e596d None admin] PATH_INFO: `/v3/users/e23a452ca033413cb81310b4f12ab72f` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:30.698261 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70783f33-a98f-450a-82c9-daf2c91e596d None admin] RBAC: Authorizing `identity:get_user(user_id=e23a452ca033413cb81310b4f12ab72f)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:30.699841 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70783f33-a98f-450a-82c9-daf2c91e596d None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:30.703013 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 131/263] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:30 2022] GET /identity/v3/users/e23a452ca033413cb81310b4f12ab72f => generated 283 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:30.726479 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70783f33-a98f-450a-82c9-daf2c91e596d None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:30.735843 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 133/264] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:30.745410 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd9a32-c9a1-4cfa-af6d-e1eb30f716fd None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:30.805884 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:30.871819 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd9a32-c9a1-4cfa-af6d-e1eb30f716fd None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:30.900524 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:30.915283 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866b328-87c8-45df-a970-628d0527b4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:30.915941 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866b328-87c8-45df-a970-628d0527b4ad None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:30.916221 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866b328-87c8-45df-a970-628d0527b4ad None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:30.916493 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866b328-87c8-45df-a970-628d0527b4ad None admin] PATH_INFO: `/v3/projects/20cc73f001a245c680144a956b81a15e` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:30.918003 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866b328-87c8-45df-a970-628d0527b4ad None admin] RBAC: Authorizing `identity:get_project(project_id=20cc73f001a245c680144a956b81a15e)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:30.925400 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866b328-87c8-45df-a970-628d0527b4ad None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:30.925400 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 134/265] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:30 2022] GET /identity/v3/projects/20cc73f001a245c680144a956b81a15e => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:30.929018 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866b328-87c8-45df-a970-628d0527b4ad None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:30.941056 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70783f33-a98f-450a-82c9-daf2c91e596d None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:31.046313 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16529db2-0fe5-4c74-bafe-e737c144bf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:31.046921 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16529db2-0fe5-4c74-bafe-e737c144bf28 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:31.047212 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16529db2-0fe5-4c74-bafe-e737c144bf28 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:31.047496 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16529db2-0fe5-4c74-bafe-e737c144bf28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:31.121174 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:31.146631 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866b328-87c8-45df-a970-628d0527b4ad None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:31.219548 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16529db2-0fe5-4c74-bafe-e737c144bf28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:31.223731 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16529db2-0fe5-4c74-bafe-e737c144bf28 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:31.269899 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98190333-b92d-4383-8695-bc6f9cec92fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:31.270715 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98190333-b92d-4383-8695-bc6f9cec92fd None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:31.271218 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98190333-b92d-4383-8695-bc6f9cec92fd None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:31.271707 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98190333-b92d-4383-8695-bc6f9cec92fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:31.273084 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98190333-b92d-4383-8695-bc6f9cec92fd None admin] RBAC: Adding query filter params (role.id=a0449d430ec54adcabb96193af2f7cd5, scope.project.id=20cc73f001a245c680144a956b81a15e, user.id=e23a452ca033413cb81310b4f12ab72f) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:31.273672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98190333-b92d-4383-8695-bc6f9cec92fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:31.276203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98190333-b92d-4383-8695-bc6f9cec92fd None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:31.306067 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 135/266] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:12:30 2022] GET /identity/v3/role_assignments?user.id=e23a452ca033413cb81310b4f12ab72f&scope.project.id=20cc73f001a245c680144a956b81a15e&role.id=a0449d430ec54adcabb96193af2f7cd5 => generated 608 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:31.309073 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ad973-c944-48f7-8fcd-ff2990b48e97 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:31.314777 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ad973-c944-48f7-8fcd-ff2990b48e97 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:31.318419 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ad973-c944-48f7-8fcd-ff2990b48e97 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:31.323615 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 136/267] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:31 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:31.331440 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb7c3c-8f73-4f08-8f1f-5a93a20dcee7 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:31.332435 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb7c3c-8f73-4f08-8f1f-5a93a20dcee7 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:31.333266 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb7c3c-8f73-4f08-8f1f-5a93a20dcee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:31.388365 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-15fb7c3c-8f73-4f08-8f1f-5a93a20dcee7 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:31.389903 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-15fb7c3c-8f73-4f08-8f1f-5a93a20dcee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:31.493821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:31.541468 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 132/268] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 815 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:31.545497 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38489367-e9b7-441c-8b7f-766ab4be920b None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:31.546457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38489367-e9b7-441c-8b7f-766ab4be920b None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:31.547299 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38489367-e9b7-441c-8b7f-766ab4be920b None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:31.551504 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 133/269] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:31.554089 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38489367-e9b7-441c-8b7f-766ab4be920b None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:31.610062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 137/270] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:12:31.613588 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5320ced-93ec-4e2f-97a6-d459d1decf6e None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:31.614380 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5320ced-93ec-4e2f-97a6-d459d1decf6e None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:31.615322 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5320ced-93ec-4e2f-97a6-d459d1decf6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:31.666717 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-d5320ced-93ec-4e2f-97a6-d459d1decf6e None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:31.668088 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-d5320ced-93ec-4e2f-97a6-d459d1decf6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:31.852262 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 138/271] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:31.906619 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38489367-e9b7-441c-8b7f-766ab4be920b None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:31.964927 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5320ced-93ec-4e2f-97a6-d459d1decf6e None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:31.993154 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:32.038185 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d683a4-c588-4df4-9137-3f92b22b067d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:32.039815 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d683a4-c588-4df4-9137-3f92b22b067d None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:32.040620 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d683a4-c588-4df4-9137-3f92b22b067d None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:32.041416 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d683a4-c588-4df4-9137-3f92b22b067d None admin] PATH_INFO: `/v3/projects/20cc73f001a245c680144a956b81a15e` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:32.046234 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d683a4-c588-4df4-9137-3f92b22b067d None admin] RBAC: Authorizing `identity:get_project(project_id=20cc73f001a245c680144a956b81a15e)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:32.049987 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d683a4-c588-4df4-9137-3f92b22b067d None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:32.054047 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 134/272] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:31 2022] GET /identity/v3/projects/20cc73f001a245c680144a956b81a15e => generated 302 bytes in 501 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:32.082621 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d683a4-c588-4df4-9137-3f92b22b067d None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:32.164637 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5320ced-93ec-4e2f-97a6-d459d1decf6e None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:32.240033 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc4b6f-e0a1-4ac3-b036-8d664c5fa499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:32.241173 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc4b6f-e0a1-4ac3-b036-8d664c5fa499 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:32.241849 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc4b6f-e0a1-4ac3-b036-8d664c5fa499 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:32.242490 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc4b6f-e0a1-4ac3-b036-8d664c5fa499 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:32.252198 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:32.269753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc4b6f-e0a1-4ac3-b036-8d664c5fa499 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:32.281211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-6acc4b6f-e0a1-4ac3-b036-8d664c5fa499 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:32.281211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:32.281211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:32.281211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:32.281211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:32.281211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:32.281211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:32.281211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:32.281211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:32.281211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:32.281211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:32.281211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:32.281211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:32.281211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:32.281211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:32.281211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:32.283203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:32.283203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:32.283203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:32.283203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:32.283203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:32.283203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:32.283203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:32.283203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:32.283203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:32.283203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:32.283203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:32.283203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:32.283203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:32.283203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:32.283203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:32.283203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:32.285035 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:32.285035 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:32.285035 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:32.285035 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:32.285035 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:32.285035 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:32.285035 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:32.285035 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:32.285035 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:32.285035 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:32.285035 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:32.285035 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:12:32.288640 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 139/273] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:12:32.290496 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc4b6f-e0a1-4ac3-b036-8d664c5fa499 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:32.332214 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d683a4-c588-4df4-9137-3f92b22b067d None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:32.399810 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d5b9c-bc18-4e4b-9de6-25b68510b0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:32.400546 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d5b9c-bc18-4e4b-9de6-25b68510b0d5 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:32.400996 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d5b9c-bc18-4e4b-9de6-25b68510b0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:32.401262 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d5b9c-bc18-4e4b-9de6-25b68510b0d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:32.402869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d5b9c-bc18-4e4b-9de6-25b68510b0d5 None admin] RBAC: Adding query filter params (role.id=e806ce849cf34b92979b5524f3ea9ff6, scope.project.id=20cc73f001a245c680144a956b81a15e, user.id=e23a452ca033413cb81310b4f12ab72f) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:32.402869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d5b9c-bc18-4e4b-9de6-25b68510b0d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:32.404744 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d5b9c-bc18-4e4b-9de6-25b68510b0d5 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:32.415520 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 135/274] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:12:32 2022] GET /identity/v3/role_assignments?user.id=e23a452ca033413cb81310b4f12ab72f&scope.project.id=20cc73f001a245c680144a956b81a15e&role.id=e806ce849cf34b92979b5524f3ea9ff6 => generated 608 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:32.416086 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d5b9c-bc18-4e4b-9de6-25b68510b0d5 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:32.470347 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:32.524326 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc4b6f-e0a1-4ac3-b036-8d664c5fa499 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:32.599419 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade37c3-d033-45ee-bcdc-eaee6e0910aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:32.603032 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade37c3-d033-45ee-bcdc-eaee6e0910aa None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:32.603539 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade37c3-d033-45ee-bcdc-eaee6e0910aa None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:32.606099 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade37c3-d033-45ee-bcdc-eaee6e0910aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:32.608255 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade37c3-d033-45ee-bcdc-eaee6e0910aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:32.609966 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade37c3-d033-45ee-bcdc-eaee6e0910aa None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:32.612000 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 140/275] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:32.619705 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade37c3-d033-45ee-bcdc-eaee6e0910aa None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:32.667216 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d5b9c-bc18-4e4b-9de6-25b68510b0d5 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:32.690531 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:32.718201 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f896ae-3614-49cc-b44e-f6ee60ba8567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:32.719097 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f896ae-3614-49cc-b44e-f6ee60ba8567 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:32.719532 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f896ae-3614-49cc-b44e-f6ee60ba8567 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:32.719980 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f896ae-3614-49cc-b44e-f6ee60ba8567 None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:32.720836 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f896ae-3614-49cc-b44e-f6ee60ba8567 None admin] RBAC: Adding query filter params (name=member) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:32.721294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f896ae-3614-49cc-b44e-f6ee60ba8567 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:32.722956 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f896ae-3614-49cc-b44e-f6ee60ba8567 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:32.741522 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 136/276] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:32.753407 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f896ae-3614-49cc-b44e-f6ee60ba8567 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:32.892792 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade37c3-d033-45ee-bcdc-eaee6e0910aa None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:32.951319 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3c4b7-c8c7-4f5f-b2b6-43e70c53c041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:32.951831 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3c4b7-c8c7-4f5f-b2b6-43e70c53c041 None admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:32.952268 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3c4b7-c8c7-4f5f-b2b6-43e70c53c041 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:32.952610 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3c4b7-c8c7-4f5f-b2b6-43e70c53c041 None admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:32.952759 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f896ae-3614-49cc-b44e-f6ee60ba8567 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:32.953428 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3c4b7-c8c7-4f5f-b2b6-43e70c53c041 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:32.955113 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3c4b7-c8c7-4f5f-b2b6-43e70c53c041 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:32.967010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:33.001017 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 141/277] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Aug 23 22:12:32 2022] POST /identity/v3/users => generated 293 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:12:33.063811 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a837c88-d3ec-4aed-8828-51d7997a1887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:33.065603 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a837c88-d3ec-4aed-8828-51d7997a1887 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:33.066377 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a837c88-d3ec-4aed-8828-51d7997a1887 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:33.067072 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a837c88-d3ec-4aed-8828-51d7997a1887 None admin] PATH_INFO: `/v3/users/be758a743219445b96453eea968636a2` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:33.100622 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a837c88-d3ec-4aed-8828-51d7997a1887 None admin] RBAC: Authorizing `identity:get_user(user_id=be758a743219445b96453eea968636a2)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:33.104388 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a837c88-d3ec-4aed-8828-51d7997a1887 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:33.108866 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 137/278] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:32 2022] GET /identity/v3/users/be758a743219445b96453eea968636a2 => generated 293 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:33.119278 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3c4b7-c8c7-4f5f-b2b6-43e70c53c041 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:33.246395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bbc84-f9d5-4e93-9ada-06c3f4458981 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:33.247847 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bbc84-f9d5-4e93-9ada-06c3f4458981 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:33.248843 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bbc84-f9d5-4e93-9ada-06c3f4458981 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:33.252260 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 138/279] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:33.258287 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9ca21-272b-4469-bff4-441105c0c8bf None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:33.258800 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9ca21-272b-4469-bff4-441105c0c8bf None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:33.259292 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9ca21-272b-4469-bff4-441105c0c8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:33.281930 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3c4b7-c8c7-4f5f-b2b6-43e70c53c041 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:33.296804 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-04d9ca21-272b-4469-bff4-441105c0c8bf None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:33.298218 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-04d9ca21-272b-4469-bff4-441105c0c8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:33.346267 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:33.356944 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dc6c3-3b96-4133-b772-a01403668c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:33.357635 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dc6c3-3b96-4133-b772-a01403668c64 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:33.357917 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dc6c3-3b96-4133-b772-a01403668c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:33.358187 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dc6c3-3b96-4133-b772-a01403668c64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:33.358949 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16dc6c3-3b96-4133-b772-a01403668c64 None admin] RBAC: Adding query filter params (role.id=eabf42a0387a47218c5ce577dd65f61c, user.id=be758a743219445b96453eea968636a2, scope.system=all) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:33.359320 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16dc6c3-3b96-4133-b772-a01403668c64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:33.360885 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16dc6c3-3b96-4133-b772-a01403668c64 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:33.368874 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 142/280] 10.222.0.77 () {56 vars in 1308 bytes} [Tue Aug 23 22:12:33 2022] GET /identity/v3/role_assignments?user.id=be758a743219445b96453eea968636a2&scope.system=all&role.id=eabf42a0387a47218c5ce577dd65f61c => generated 226 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:33.370300 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce193a-311d-483f-b5d3-233f71d939fe None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:33.370570 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce193a-311d-483f-b5d3-233f71d939fe None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:33.370926 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce193a-311d-483f-b5d3-233f71d939fe None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:33.373099 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 143/281] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:33.384119 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1e0d5-f728-4326-9494-c8ff955210c6 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:33.384423 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1e0d5-f728-4326-9494-c8ff955210c6 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:33.384752 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1e0d5-f728-4326-9494-c8ff955210c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:33.405014 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 139/282] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:12:33.408071 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-75a1e0d5-f728-4326-9494-c8ff955210c6 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:33.409335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-75a1e0d5-f728-4326-9494-c8ff955210c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:33.501220 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:33.524140 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 144/283] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:12:33.810908 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9ca21-272b-4469-bff4-441105c0c8bf None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:33.883354 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1e0d5-f728-4326-9494-c8ff955210c6 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:33.941674 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9ca21-272b-4469-bff4-441105c0c8bf None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:34.009360 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0719db-61a7-4ae0-8b52-4ededbc00379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:34.010436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0719db-61a7-4ae0-8b52-4ededbc00379 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:34.010994 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0719db-61a7-4ae0-8b52-4ededbc00379 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:34.011556 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0719db-61a7-4ae0-8b52-4ededbc00379 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:34.033118 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0719db-61a7-4ae0-8b52-4ededbc00379 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:34.043118 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-0d0719db-61a7-4ae0-8b52-4ededbc00379 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:12:34.043118 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:34.043118 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:34.043118 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:34.043118 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:34.043118 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:34.043118 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:34.043118 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:34.043118 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:34.043118 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:34.043118 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:34.043118 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:34.043118 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:34.043118 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:34.043118 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:34.043118 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:34.044924 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:34.044924 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:34.044924 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:34.044924 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:34.044924 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:34.044924 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:34.044924 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:34.044924 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:34.044924 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:34.044924 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:34.044924 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:34.044924 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:34.044924 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:34.044924 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:34.044924 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:34.044924 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:34.046300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:34.046300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:34.046300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:34.046300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:34.046300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:34.046300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:34.046300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:34.046300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:34.046300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:34.046300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:34.046300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:12:34.046300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:12:34.046300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 140/284] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:34.059340 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0719db-61a7-4ae0-8b52-4ededbc00379 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:34.118997 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:34.175615 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1e0d5-f728-4326-9494-c8ff955210c6 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:34.264887 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0719db-61a7-4ae0-8b52-4ededbc00379 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:34.274192 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a2761-0b6f-4f69-b176-d750a189fae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:34.274854 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a2761-0b6f-4f69-b176-d750a189fae5 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:34.275142 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a2761-0b6f-4f69-b176-d750a189fae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:34.275421 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a2761-0b6f-4f69-b176-d750a189fae5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:34.314499 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a2761-0b6f-4f69-b176-d750a189fae5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:34.319790 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-011a2761-0b6f-4f69-b176-d750a189fae5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:34.319790 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:34.319790 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:34.319790 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:34.319790 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:34.319790 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:34.319790 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:34.319790 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:34.319790 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:34.319790 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:34.319790 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:34.319790 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:34.319790 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:34.319790 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:34.319790 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:34.319790 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:34.321596 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:34.321596 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:34.321596 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:34.321596 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:34.321596 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:34.321596 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:34.321596 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:34.321596 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:34.321596 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:34.321596 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:34.321596 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:34.321596 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:34.321596 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:34.321596 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:34.321596 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:34.321596 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:34.323216 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:34.323216 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:34.323216 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:34.323216 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:34.323216 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:34.323216 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:34.323216 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:34.323216 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:34.323216 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:34.323216 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:34.323216 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:34.323216 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:12:34.327589 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 145/285] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 441 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:12:34.333079 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e7846-f49c-41b2-95f2-c38c900b89b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:34.333309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a2761-0b6f-4f69-b176-d750a189fae5 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:34.334802 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e7846-f49c-41b2-95f2-c38c900b89b7 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:34.335567 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e7846-f49c-41b2-95f2-c38c900b89b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:34.336299 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e7846-f49c-41b2-95f2-c38c900b89b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:34.337848 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e7846-f49c-41b2-95f2-c38c900b89b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:34.338733 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e7846-f49c-41b2-95f2-c38c900b89b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:34.342466 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e7846-f49c-41b2-95f2-c38c900b89b7 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:34.368795 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 141/286] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:34.379581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e7846-f49c-41b2-95f2-c38c900b89b7 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:34.432092 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:34.573985 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a2761-0b6f-4f69-b176-d750a189fae5 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:34.644848 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:34.655181 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b710405-b61d-4e06-b5af-25dfcc61699e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:34.655832 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b710405-b61d-4e06-b5af-25dfcc61699e None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:34.656115 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b710405-b61d-4e06-b5af-25dfcc61699e None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:34.656391 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b710405-b61d-4e06-b5af-25dfcc61699e None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:34.657102 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b710405-b61d-4e06-b5af-25dfcc61699e None admin] RBAC: Adding query filter params (name=member) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:34.657431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b710405-b61d-4e06-b5af-25dfcc61699e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:34.658855 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b710405-b61d-4e06-b5af-25dfcc61699e None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:34.677263 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e7846-f49c-41b2-95f2-c38c900b89b7 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:34.682598 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 146/287] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:34.685220 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b710405-b61d-4e06-b5af-25dfcc61699e None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:34.754420 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1591a5-8cb7-4374-9164-def53e62b7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:34.755140 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1591a5-8cb7-4374-9164-def53e62b7de None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:34.755432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1591a5-8cb7-4374-9164-def53e62b7de None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:34.755715 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1591a5-8cb7-4374-9164-def53e62b7de None admin] PATH_INFO: `/v3/users/e2ce613950f342398f000c74ab7e3c5a` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:34.758482 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1591a5-8cb7-4374-9164-def53e62b7de None admin] RBAC: Authorizing `identity:get_user(user_id=e2ce613950f342398f000c74ab7e3c5a)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:34.759969 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1591a5-8cb7-4374-9164-def53e62b7de None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:34.761678 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 142/288] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:34 2022] GET /identity/v3/users/e2ce613950f342398f000c74ab7e3c5a => generated 297 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:34.771766 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1591a5-8cb7-4374-9164-def53e62b7de None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:34.892251 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b710405-b61d-4e06-b5af-25dfcc61699e None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:34.902763 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:34.972216 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce638b3b-2307-4816-9b06-4e111c6ae188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:34.973278 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce638b3b-2307-4816-9b06-4e111c6ae188 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:34.976323 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1591a5-8cb7-4374-9164-def53e62b7de None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:34.982523 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce638b3b-2307-4816-9b06-4e111c6ae188 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:34.983022 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce638b3b-2307-4816-9b06-4e111c6ae188 None admin] PATH_INFO: `/v3/users/eea3d7ec7af946ed9fbdb5fdfc529756` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:34.985302 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce638b3b-2307-4816-9b06-4e111c6ae188 None admin] RBAC: Authorizing `identity:get_user(user_id=eea3d7ec7af946ed9fbdb5fdfc529756)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:34.988297 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce638b3b-2307-4816-9b06-4e111c6ae188 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:34.998202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 147/289] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:34 2022] GET /identity/v3/users/eea3d7ec7af946ed9fbdb5fdfc529756 => generated 297 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:35.004606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce638b3b-2307-4816-9b06-4e111c6ae188 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:35.031096 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a81876-85ba-4da6-b136-3a909004c188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:35.031812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a81876-85ba-4da6-b136-3a909004c188 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:35.037395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a81876-85ba-4da6-b136-3a909004c188 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:35.037395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a81876-85ba-4da6-b136-3a909004c188 None admin] PATH_INFO: `/v3/projects/20cc73f001a245c680144a956b81a15e` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:35.037395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a81876-85ba-4da6-b136-3a909004c188 None admin] RBAC: Authorizing `identity:get_project(project_id=20cc73f001a245c680144a956b81a15e)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:35.037395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a81876-85ba-4da6-b136-3a909004c188 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:35.037395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 143/290] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:34 2022] GET /identity/v3/projects/20cc73f001a245c680144a956b81a15e => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:35.048767 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a81876-85ba-4da6-b136-3a909004c188 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:35.135808 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:35.226573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce638b3b-2307-4816-9b06-4e111c6ae188 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:35.280523 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d988718-b0ae-444f-b2c1-a8046d21ff1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:35.281552 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d988718-b0ae-444f-b2c1-a8046d21ff1d None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:35.281965 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d988718-b0ae-444f-b2c1-a8046d21ff1d None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:35.282369 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d988718-b0ae-444f-b2c1-a8046d21ff1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:35.417164 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a81876-85ba-4da6-b136-3a909004c188 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:35.453600 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:35.523518 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d988718-b0ae-444f-b2c1-a8046d21ff1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:35.527676 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d988718-b0ae-444f-b2c1-a8046d21ff1d None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:35.538831 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ea7fd-07d8-4ac7-af8b-75fa39449e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:35.539949 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ea7fd-07d8-4ac7-af8b-75fa39449e4f None admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:35.540435 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ea7fd-07d8-4ac7-af8b-75fa39449e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:35.540915 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ea7fd-07d8-4ac7-af8b-75fa39449e4f None admin] PATH_INFO: `/v3/projects/20cc73f001a245c680144a956b81a15e/users/e2ce613950f342398f000c74ab7e3c5a/roles/6eb34cd17388449f9099dd83fb076032` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:35.553997 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ea7fd-07d8-4ac7-af8b-75fa39449e4f None admin] RBAC: Authorizing `identity:create_grant(project_id=20cc73f001a245c680144a956b81a15e, user_id=e2ce613950f342398f000c74ab7e3c5a, role_id=6eb34cd17388449f9099dd83fb076032)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:35.556829 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ea7fd-07d8-4ac7-af8b-75fa39449e4f None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:35.589151 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 144/291] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Aug 23 22:12:35 2022] PUT /identity/v3/projects/20cc73f001a245c680144a956b81a15e/users/e2ce613950f342398f000c74ab7e3c5a/roles/6eb34cd17388449f9099dd83fb076032 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:12:35.792147 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 148/292] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 788 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 22:12:35.799556 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ea7fd-07d8-4ac7-af8b-75fa39449e4f None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:36.008988 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:36.043056 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ea7fd-07d8-4ac7-af8b-75fa39449e4f None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:36.093850 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fcc0d4-0047-486c-8bc0-0823b0e1bca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:36.094545 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fcc0d4-0047-486c-8bc0-0823b0e1bca7 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:36.094827 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fcc0d4-0047-486c-8bc0-0823b0e1bca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:36.095150 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fcc0d4-0047-486c-8bc0-0823b0e1bca7 None admin] PATH_INFO: `/v3/projects/20cc73f001a245c680144a956b81a15e` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:36.096346 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fcc0d4-0047-486c-8bc0-0823b0e1bca7 None admin] RBAC: Authorizing `identity:get_project(project_id=20cc73f001a245c680144a956b81a15e)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:36.097828 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fcc0d4-0047-486c-8bc0-0823b0e1bca7 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:36.099812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 145/293] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:35 2022] GET /identity/v3/projects/20cc73f001a245c680144a956b81a15e => generated 302 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:36.106100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d988718-b0ae-444f-b2c1-a8046d21ff1d None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:36.252446 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:36.274322 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78684f61-28d2-41cb-96ee-5d83749ab164 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:36.274784 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78684f61-28d2-41cb-96ee-5d83749ab164 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:36.275200 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78684f61-28d2-41cb-96ee-5d83749ab164 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:36.277804 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 146/294] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:12:36.287240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf5246-bd33-4376-a93e-1ef6b7f8b01a None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:36.287801 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf5246-bd33-4376-a93e-1ef6b7f8b01a None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:36.288258 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf5246-bd33-4376-a93e-1ef6b7f8b01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:36.303699 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d988718-b0ae-444f-b2c1-a8046d21ff1d None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:36.328466 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-eabf5246-bd33-4376-a93e-1ef6b7f8b01a None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:36.331798 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-eabf5246-bd33-4376-a93e-1ef6b7f8b01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:36.396281 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2558fca-f203-4179-970f-7cbd28185bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:36.397396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2558fca-f203-4179-970f-7cbd28185bf8 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:36.397882 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2558fca-f203-4179-970f-7cbd28185bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:36.398354 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2558fca-f203-4179-970f-7cbd28185bf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:36.400019 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2558fca-f203-4179-970f-7cbd28185bf8 None admin] RBAC: Adding query filter params (role.id=eabf42a0387a47218c5ce577dd65f61c, scope.project.id=20cc73f001a245c680144a956b81a15e, user.id=eea3d7ec7af946ed9fbdb5fdfc529756) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:36.400344 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2558fca-f203-4179-970f-7cbd28185bf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:36.403862 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2558fca-f203-4179-970f-7cbd28185bf8 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:36.429641 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 149/295] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:12:36 2022] GET /identity/v3/role_assignments?user.id=eea3d7ec7af946ed9fbdb5fdfc529756&scope.project.id=20cc73f001a245c680144a956b81a15e&role.id=eabf42a0387a47218c5ce577dd65f61c => generated 608 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:36.484704 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 147/296] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:36.523773 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fe4fd-f9bb-4544-85f9-9dee43b45062 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:36.524287 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fe4fd-f9bb-4544-85f9-9dee43b45062 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:36.524761 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fe4fd-f9bb-4544-85f9-9dee43b45062 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:36.527586 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 150/297] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:36.547835 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d8ab7-527a-4278-b71c-b13bd46b805c None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:36.548520 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d8ab7-527a-4278-b71c-b13bd46b805c None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:36.549064 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d8ab7-527a-4278-b71c-b13bd46b805c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:36.572469 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-399d8ab7-527a-4278-b71c-b13bd46b805c None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:36.574390 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-399d8ab7-527a-4278-b71c-b13bd46b805c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:36.591284 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0377ff-39d0-46a9-b58a-6333bc9f1e1b None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:36.591727 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0377ff-39d0-46a9-b58a-6333bc9f1e1b None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:36.592216 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0377ff-39d0-46a9-b58a-6333bc9f1e1b None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:36.595070 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 151/298] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:12:36.620404 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2128335-859b-42af-b6a1-1c5d463509a5 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:36.620902 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2128335-859b-42af-b6a1-1c5d463509a5 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:36.621441 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2128335-859b-42af-b6a1-1c5d463509a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:36.666824 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 148/299] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:36.691104 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-b2128335-859b-42af-b6a1-1c5d463509a5 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:36.693187 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-b2128335-859b-42af-b6a1-1c5d463509a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:36.846107 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 152/300] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:36.905748 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d8ab7-527a-4278-b71c-b13bd46b805c None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:36.923645 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:37.052610 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d8ab7-527a-4278-b71c-b13bd46b805c None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:37.057171 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2128335-859b-42af-b6a1-1c5d463509a5 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:37.109941 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ef3e9-efaf-4c08-a9f8-845bacac7179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:37.110589 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ef3e9-efaf-4c08-a9f8-845bacac7179 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:37.110874 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ef3e9-efaf-4c08-a9f8-845bacac7179 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:37.111153 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ef3e9-efaf-4c08-a9f8-845bacac7179 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:37.126303 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ef3e9-efaf-4c08-a9f8-845bacac7179 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:37.131843 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-1c3ef3e9-efaf-4c08-a9f8-845bacac7179 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:12:37.131843 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:37.131843 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:37.131843 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:37.131843 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:37.131843 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:37.131843 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:37.131843 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:37.131843 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:37.131843 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:37.131843 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:37.131843 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:37.131843 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:37.131843 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:37.131843 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:37.131843 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:37.133617 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:37.133617 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:37.133617 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:37.133617 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:37.133617 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:37.133617 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:37.133617 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:37.133617 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:37.133617 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:37.133617 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:37.133617 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:37.133617 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:37.133617 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:37.133617 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:37.133617 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:37.133617 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:37.135196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:37.135196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:37.135196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:37.135196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:37.135196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:37.135196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:37.135196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:37.135196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:37.135196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:37.135196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:37.135196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:12:37.135196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:12:37.135196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 149/301] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:37.140974 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ef3e9-efaf-4c08-a9f8-845bacac7179 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:37.163265 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:37.209097 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2128335-859b-42af-b6a1-1c5d463509a5 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:37.257497 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63395dac-c7bf-4056-8932-151a231ea685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:37.258844 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63395dac-c7bf-4056-8932-151a231ea685 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:37.259072 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:37.259303 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63395dac-c7bf-4056-8932-151a231ea685 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:37.259303 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63395dac-c7bf-4056-8932-151a231ea685 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:37.265413 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63395dac-c7bf-4056-8932-151a231ea685 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:37.265413 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63395dac-c7bf-4056-8932-151a231ea685 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:37.266063 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 153/302] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:37.272574 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63395dac-c7bf-4056-8932-151a231ea685 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:37.310987 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ef3e9-efaf-4c08-a9f8-845bacac7179 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:37.373857 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6f20e-1d8f-4622-bb78-be516c954b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:37.374413 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6f20e-1d8f-4622-bb78-be516c954b4d None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:37.374769 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6f20e-1d8f-4622-bb78-be516c954b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:37.375053 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6f20e-1d8f-4622-bb78-be516c954b4d None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:37.375983 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6f20e-1d8f-4622-bb78-be516c954b4d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:37.376300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6f20e-1d8f-4622-bb78-be516c954b4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:37.378020 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6f20e-1d8f-4622-bb78-be516c954b4d None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:37.399363 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 150/303] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:37.404907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6f20e-1d8f-4622-bb78-be516c954b4d None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:37.468382 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63395dac-c7bf-4056-8932-151a231ea685 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:37.533089 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095c729-c3ee-42ed-be37-5207dd8743cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:37.533924 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095c729-c3ee-42ed-be37-5207dd8743cd None admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:37.534288 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095c729-c3ee-42ed-be37-5207dd8743cd None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:37.534773 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095c729-c3ee-42ed-be37-5207dd8743cd None admin] PATH_INFO: `/v3/groups` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:37.535850 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095c729-c3ee-42ed-be37-5207dd8743cd None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:37.537772 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095c729-c3ee-42ed-be37-5207dd8743cd None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:37.552945 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6f20e-1d8f-4622-bb78-be516c954b4d None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:37.556394 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:37.574842 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 154/304] 10.222.0.77 () {60 vars in 1134 bytes} [Tue Aug 23 22:12:37 2022] POST /identity/v3/groups => generated 229 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:12:37.577331 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095c729-c3ee-42ed-be37-5207dd8743cd None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:37.635579 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5962b-2414-46ac-900b-2cb3c09645b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:37.637041 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5962b-2414-46ac-900b-2cb3c09645b1 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:37.638279 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5962b-2414-46ac-900b-2cb3c09645b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:37.638869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5962b-2414-46ac-900b-2cb3c09645b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:37.642596 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:37.658046 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5962b-2414-46ac-900b-2cb3c09645b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:37.664643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-99d5962b-2414-46ac-900b-2cb3c09645b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:37.664643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:37.664643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:37.664643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:37.664643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:37.664643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:37.664643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:37.664643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:37.664643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:37.664643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:37.664643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:37.664643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:37.664643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:37.664643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:37.664643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:37.664643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:37.666216 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:37.666216 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:37.666216 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:37.666216 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:37.666216 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:37.666216 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:37.666216 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:37.666216 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:37.666216 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:37.666216 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:37.666216 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:37.666216 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:37.666216 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:37.666216 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:37.666216 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:37.666216 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:37.667880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:37.667880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:37.667880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:37.667880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:37.667880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:37.667880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:37.667880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:37.667880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:37.667880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:37.667880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:37.667880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:37.667880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:12:37.667880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 151/305] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:37.678831 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5962b-2414-46ac-900b-2cb3c09645b1 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:37.794450 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095c729-c3ee-42ed-be37-5207dd8743cd None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:37.849210 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e195612-3aad-400a-b13b-8016a29050d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:37.850397 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e195612-3aad-400a-b13b-8016a29050d4 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:37.851092 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e195612-3aad-400a-b13b-8016a29050d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:37.851377 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e195612-3aad-400a-b13b-8016a29050d4 None admin] PATH_INFO: `/v3/users/2c540bd6e26b4dffa320a0576f029623` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:37.852605 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5962b-2414-46ac-900b-2cb3c09645b1 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:37.882303 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e195612-3aad-400a-b13b-8016a29050d4 None admin] RBAC: Authorizing `identity:get_user(user_id=2c540bd6e26b4dffa320a0576f029623)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:37.886187 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e195612-3aad-400a-b13b-8016a29050d4 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:37.890561 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 155/306] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:37 2022] GET /identity/v3/users/2c540bd6e26b4dffa320a0576f029623 => generated 293 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:37.894256 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e63358-04bb-4833-b75d-d9a9fb950a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:37.895299 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e63358-04bb-4833-b75d-d9a9fb950a19 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:37.896969 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e195612-3aad-400a-b13b-8016a29050d4 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:37.898360 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e63358-04bb-4833-b75d-d9a9fb950a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:37.899774 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e63358-04bb-4833-b75d-d9a9fb950a19 None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:37.900803 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e63358-04bb-4833-b75d-d9a9fb950a19 None admin] RBAC: Adding query filter params (name=member) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:37.901357 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e63358-04bb-4833-b75d-d9a9fb950a19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:37.902971 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e63358-04bb-4833-b75d-d9a9fb950a19 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:37.913304 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 152/307] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:37.924117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e63358-04bb-4833-b75d-d9a9fb950a19 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:37.973769 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:37.990406 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:38.034468 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e195612-3aad-400a-b13b-8016a29050d4 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:38.050715 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e63358-04bb-4833-b75d-d9a9fb950a19 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:38.075689 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4939740-1c63-4172-981e-142499598c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:38.076469 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4939740-1c63-4172-981e-142499598c68 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:38.076825 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4939740-1c63-4172-981e-142499598c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:38.077130 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4939740-1c63-4172-981e-142499598c68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:38.077997 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4939740-1c63-4172-981e-142499598c68 None admin] RBAC: Adding query filter params (role.id=6eb34cd17388449f9099dd83fb076032, user.id=2c540bd6e26b4dffa320a0576f029623, scope.system=all) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:38.078854 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4939740-1c63-4172-981e-142499598c68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:38.079875 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4939740-1c63-4172-981e-142499598c68 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:38.086582 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 156/308] 10.222.0.77 () {56 vars in 1308 bytes} [Tue Aug 23 22:12:37 2022] GET /identity/v3/role_assignments?user.id=2c540bd6e26b4dffa320a0576f029623&scope.system=all&role.id=6eb34cd17388449f9099dd83fb076032 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:38.095839 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f6cf49-988f-40b2-94fb-65582e6db261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:38.097124 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6cf49-988f-40b2-94fb-65582e6db261 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:38.097595 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6cf49-988f-40b2-94fb-65582e6db261 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:38.098023 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6cf49-988f-40b2-94fb-65582e6db261 None admin] PATH_INFO: `/v3/users/be758a743219445b96453eea968636a2` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:38.099611 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f6cf49-988f-40b2-94fb-65582e6db261 None admin] RBAC: Authorizing `identity:get_user(user_id=be758a743219445b96453eea968636a2)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:38.101409 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f6cf49-988f-40b2-94fb-65582e6db261 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:38.103752 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 153/309] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:37 2022] GET /identity/v3/users/be758a743219445b96453eea968636a2 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:38.110514 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4939740-1c63-4172-981e-142499598c68 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:38.252986 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4939740-1c63-4172-981e-142499598c68 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:38.288481 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:38.312122 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e29f8-9f34-4b5f-be30-2246a1d1dc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:38.313622 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e29f8-9f34-4b5f-be30-2246a1d1dc27 None admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:38.314148 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e29f8-9f34-4b5f-be30-2246a1d1dc27 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:38.314633 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e29f8-9f34-4b5f-be30-2246a1d1dc27 None admin] PATH_INFO: `/v3/system/users/be758a743219445b96453eea968636a2/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:38.317272 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e29f8-9f34-4b5f-be30-2246a1d1dc27 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=be758a743219445b96453eea968636a2, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:38.319889 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e29f8-9f34-4b5f-be30-2246a1d1dc27 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:38.332809 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 157/310] 10.222.0.77 () {58 vars in 1334 bytes} [Tue Aug 23 22:12:38 2022] PUT /identity/v3/system/users/be758a743219445b96453eea968636a2/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:12:38.650499 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b8a3d-c094-418f-83bc-79da50296266 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:38.650842 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b8a3d-c094-418f-83bc-79da50296266 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:38.651018 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b8a3d-c094-418f-83bc-79da50296266 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:38.652775 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 154/311] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:38.659922 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077c52f-bd06-4a59-be98-95c5d2282a25 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:38.660353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077c52f-bd06-4a59-be98-95c5d2282a25 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:38.660505 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077c52f-bd06-4a59-be98-95c5d2282a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:38.685738 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-c077c52f-bd06-4a59-be98-95c5d2282a25 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:38.688166 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-c077c52f-bd06-4a59-be98-95c5d2282a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:38.801212 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 158/312] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:39.322903 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b8a3d-c094-418f-83bc-79da50296266 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:39.519000 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b8a3d-c094-418f-83bc-79da50296266 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:39.559971 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:39.578135 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc66946-caed-4390-86fc-d54133f64d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:39.578749 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc66946-caed-4390-86fc-d54133f64d74 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:39.579034 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc66946-caed-4390-86fc-d54133f64d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:39.579311 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc66946-caed-4390-86fc-d54133f64d74 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:39.593067 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc66946-caed-4390-86fc-d54133f64d74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:39.599863 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-4fc66946-caed-4390-86fc-d54133f64d74 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:12:39.599863 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:39.599863 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:39.599863 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:39.599863 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:39.599863 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:39.599863 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:39.599863 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:39.599863 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:39.599863 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:39.599863 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:39.599863 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:39.599863 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:39.599863 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:39.599863 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:39.599863 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:39.600881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:39.600881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:39.600881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:39.600881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:39.600881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:39.600881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:39.600881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:39.600881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:39.600881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:39.600881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:39.600881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:39.600881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:39.600881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:39.600881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:39.600881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:39.600881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:39.601865 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:39.601865 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:39.601865 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:39.601865 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:39.601865 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:39.601865 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:39.601865 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:39.601865 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:39.601865 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:39.601865 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:39.601865 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:12:39.601865 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:12:39.601865 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 155/313] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:39.616228 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077c52f-bd06-4a59-be98-95c5d2282a25 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:39.768735 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077c52f-bd06-4a59-be98-95c5d2282a25 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:39.789359 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:39.819732 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7701397-e963-4fe3-8064-8615cfe22519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:39.820505 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7701397-e963-4fe3-8064-8615cfe22519 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:39.820790 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7701397-e963-4fe3-8064-8615cfe22519 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:39.821099 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7701397-e963-4fe3-8064-8615cfe22519 None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:39.821961 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7701397-e963-4fe3-8064-8615cfe22519 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:39.822302 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7701397-e963-4fe3-8064-8615cfe22519 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:39.823860 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7701397-e963-4fe3-8064-8615cfe22519 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:39.834692 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 159/314] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:39.842552 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc66946-caed-4390-86fc-d54133f64d74 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:39.978936 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc66946-caed-4390-86fc-d54133f64d74 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:40.024279 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76466e7-1b26-4f81-89f2-2ba5a9480db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:40.024918 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76466e7-1b26-4f81-89f2-2ba5a9480db6 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:40.025214 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76466e7-1b26-4f81-89f2-2ba5a9480db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:40.025502 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76466e7-1b26-4f81-89f2-2ba5a9480db6 None admin] PATH_INFO: `/v3/users/e2ce613950f342398f000c74ab7e3c5a` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:40.026802 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76466e7-1b26-4f81-89f2-2ba5a9480db6 None admin] RBAC: Authorizing `identity:get_user(user_id=e2ce613950f342398f000c74ab7e3c5a)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:40.028310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76466e7-1b26-4f81-89f2-2ba5a9480db6 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:40.030358 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 156/315] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:39 2022] GET /identity/v3/users/e2ce613950f342398f000c74ab7e3c5a => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:40.039347 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7701397-e963-4fe3-8064-8615cfe22519 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:40.217016 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7701397-e963-4fe3-8064-8615cfe22519 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:40.261713 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a54e5-014f-437a-a010-b8352035fd0e None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:40.262005 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a54e5-014f-437a-a010-b8352035fd0e None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:40.262288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a54e5-014f-437a-a010-b8352035fd0e None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:40.268385 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 157/316] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:40.268606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e094c-1504-4080-a597-17ca1dbfca4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:40.269494 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e094c-1504-4080-a597-17ca1dbfca4a None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:40.269941 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e094c-1504-4080-a597-17ca1dbfca4a None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:40.270384 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e094c-1504-4080-a597-17ca1dbfca4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:40.270748 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30bcd9-5700-4c4d-96d0-b21ba74447d8 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:40.271139 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30bcd9-5700-4c4d-96d0-b21ba74447d8 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:40.271514 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30bcd9-5700-4c4d-96d0-b21ba74447d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:40.306424 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-3c30bcd9-5700-4c4d-96d0-b21ba74447d8 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:40.308652 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-3c30bcd9-5700-4c4d-96d0-b21ba74447d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:40.346187 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:40.386223 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:40.389560 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e094c-1504-4080-a597-17ca1dbfca4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:40.392644 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e094c-1504-4080-a597-17ca1dbfca4a None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:40.414400 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 158/317] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:40.539180 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 160/318] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:40.546721 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30bcd9-5700-4c4d-96d0-b21ba74447d8 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:40.681417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30bcd9-5700-4c4d-96d0-b21ba74447d8 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:40.699171 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade610da-a5b6-4b47-8ef2-1d036b27055a None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:40.699696 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade610da-a5b6-4b47-8ef2-1d036b27055a None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:40.699963 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade610da-a5b6-4b47-8ef2-1d036b27055a None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:40.701821 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 161/319] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:12:40.708342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc4b62-58ec-43a1-a5b2-61a3d08d3227 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:40.708695 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc4b62-58ec-43a1-a5b2-61a3d08d3227 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:40.708926 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc4b62-58ec-43a1-a5b2-61a3d08d3227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:40.738341 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-7bfc4b62-58ec-43a1-a5b2-61a3d08d3227 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:40.739726 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24162637-c2de-4612-8602-31da4680141f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:40.740388 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24162637-c2de-4612-8602-31da4680141f None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:40.740635 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-7bfc4b62-58ec-43a1-a5b2-61a3d08d3227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:40.740742 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24162637-c2de-4612-8602-31da4680141f None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:40.740920 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24162637-c2de-4612-8602-31da4680141f None admin] PATH_INFO: `/v3/projects/20cc73f001a245c680144a956b81a15e` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:40.742131 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24162637-c2de-4612-8602-31da4680141f None admin] RBAC: Authorizing `identity:get_project(project_id=20cc73f001a245c680144a956b81a15e)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:40.743578 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24162637-c2de-4612-8602-31da4680141f None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:40.745729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 159/320] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:40 2022] GET /identity/v3/projects/20cc73f001a245c680144a956b81a15e => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:40.747930 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24162637-c2de-4612-8602-31da4680141f None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:40.832912 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:40.843750 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 162/321] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:40.844817 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc4b62-58ec-43a1-a5b2-61a3d08d3227 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:40.854137 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:40.914147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24162637-c2de-4612-8602-31da4680141f None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:40.955598 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630b015-abd6-48df-b71f-72c7aca5744c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:40.956247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630b015-abd6-48df-b71f-72c7aca5744c None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:40.956531 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630b015-abd6-48df-b71f-72c7aca5744c None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:40.956844 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630b015-abd6-48df-b71f-72c7aca5744c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:40.958298 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a630b015-abd6-48df-b71f-72c7aca5744c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:40.959968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a630b015-abd6-48df-b71f-72c7aca5744c None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:40.961854 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 160/322] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:40.969089 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae7973-216e-4d0d-ae7c-b5c4065ba979 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:40.969424 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae7973-216e-4d0d-ae7c-b5c4065ba979 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:40.969739 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae7973-216e-4d0d-ae7c-b5c4065ba979 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:40.971273 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 161/323] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:40 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:40.972615 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae7973-216e-4d0d-ae7c-b5c4065ba979 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:41.000195 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc4b62-58ec-43a1-a5b2-61a3d08d3227 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:41.047193 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078dfcda-9c47-42bf-9255-d7841375d705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:41.048347 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078dfcda-9c47-42bf-9255-d7841375d705 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:41.048957 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078dfcda-9c47-42bf-9255-d7841375d705 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:41.049309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078dfcda-9c47-42bf-9255-d7841375d705 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:41.050104 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078dfcda-9c47-42bf-9255-d7841375d705 None admin] RBAC: Adding query filter params (role.id=6eb34cd17388449f9099dd83fb076032, scope.project.id=20cc73f001a245c680144a956b81a15e, user.id=e2ce613950f342398f000c74ab7e3c5a) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:41.050391 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078dfcda-9c47-42bf-9255-d7841375d705 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:41.052108 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078dfcda-9c47-42bf-9255-d7841375d705 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:41.065420 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 163/324] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:12:40 2022] GET /identity/v3/role_assignments?user.id=e2ce613950f342398f000c74ab7e3c5a&scope.project.id=20cc73f001a245c680144a956b81a15e&role.id=6eb34cd17388449f9099dd83fb076032 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:41.065420 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8211ab-1b01-4789-9921-17e41e350dc3 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:41.065420 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8211ab-1b01-4789-9921-17e41e350dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:41.065420 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8211ab-1b01-4789-9921-17e41e350dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:41.102561 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-2c8211ab-1b01-4789-9921-17e41e350dc3 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:41.104300 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-2c8211ab-1b01-4789-9921-17e41e350dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:41.116413 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae7973-216e-4d0d-ae7c-b5c4065ba979 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:41.144427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:41.168598 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d5324-46f4-4def-8753-c9a2938ce985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:41.169861 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d5324-46f4-4def-8753-c9a2938ce985 None admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:41.170006 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d5324-46f4-4def-8753-c9a2938ce985 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:41.170208 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d5324-46f4-4def-8753-c9a2938ce985 None admin] PATH_INFO: `/v3/groups` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:41.170844 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d5324-46f4-4def-8753-c9a2938ce985 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:41.172450 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d5324-46f4-4def-8753-c9a2938ce985 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:41.198194 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 162/325] 10.222.0.77 () {60 vars in 1134 bytes} [Tue Aug 23 22:12:40 2022] POST /identity/v3/groups => generated 226 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:12:41.199510 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d5324-46f4-4def-8753-c9a2938ce985 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:41.221915 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 164/326] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:41.233504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:41.357052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d5324-46f4-4def-8753-c9a2938ce985 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:41.420976 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae85be5-5ea3-4496-9561-b0cf6d2bd6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:41.422182 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae85be5-5ea3-4496-9561-b0cf6d2bd6d3 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:41.422796 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae85be5-5ea3-4496-9561-b0cf6d2bd6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:41.423225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae85be5-5ea3-4496-9561-b0cf6d2bd6d3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:41.440036 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae85be5-5ea3-4496-9561-b0cf6d2bd6d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:41.449028 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-9ae85be5-5ea3-4496-9561-b0cf6d2bd6d3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:12:41.449028 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:41.449028 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:41.449028 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:41.449028 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:41.449028 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:41.449028 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:41.449028 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:41.449028 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:41.449028 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:41.449028 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:41.449028 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:41.449028 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:41.449028 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:41.449028 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:41.449028 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:41.450861 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:41.450861 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:41.450861 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:41.450861 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:41.450861 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:41.450861 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:41.450861 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:41.450861 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:41.450861 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:41.450861 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:41.450861 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:41.450861 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:41.450861 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:41.450861 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:41.450861 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:41.450861 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:41.451925 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:41.451925 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:41.451925 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:41.451925 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:41.451925 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:41.451925 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:41.451925 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:41.451925 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:41.451925 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:41.451925 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:41.451925 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:12:41.451925 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:12:41.451925 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 163/327] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:41.460625 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8211ab-1b01-4789-9921-17e41e350dc3 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:41.533520 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae85be5-5ea3-4496-9561-b0cf6d2bd6d3 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:41.603885 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:41.651596 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8211ab-1b01-4789-9921-17e41e350dc3 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:41.721199 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae85be5-5ea3-4496-9561-b0cf6d2bd6d3 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:41.728458 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6235736-580d-4316-9a8c-7636ff31b299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:41.735104 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6235736-580d-4316-9a8c-7636ff31b299 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:41.735480 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6235736-580d-4316-9a8c-7636ff31b299 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:41.735726 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6235736-580d-4316-9a8c-7636ff31b299 None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:41.736540 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6235736-580d-4316-9a8c-7636ff31b299 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:41.736893 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6235736-580d-4316-9a8c-7636ff31b299 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:41.738574 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6235736-580d-4316-9a8c-7636ff31b299 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:41.754684 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 165/328] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:41.761751 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6235736-580d-4316-9a8c-7636ff31b299 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:41.782006 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ab69e-ea47-4e97-b0a9-07637a7c4010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:41.783033 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ab69e-ea47-4e97-b0a9-07637a7c4010 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:41.783491 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ab69e-ea47-4e97-b0a9-07637a7c4010 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:41.783971 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ab69e-ea47-4e97-b0a9-07637a7c4010 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:41.797444 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ab69e-ea47-4e97-b0a9-07637a7c4010 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:41.803644 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-6f7ab69e-ea47-4e97-b0a9-07637a7c4010 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:41.803644 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:41.803644 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:41.803644 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:41.803644 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:41.803644 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:41.803644 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:41.803644 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:41.803644 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:41.803644 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:41.803644 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:41.803644 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:41.803644 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:41.803644 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:41.803644 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:41.803644 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:41.804591 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:41.804591 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:41.804591 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:41.804591 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:41.804591 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:41.804591 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:41.804591 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:41.804591 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:41.804591 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:41.804591 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:41.804591 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:41.804591 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:41.804591 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:41.804591 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:41.804591 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:41.804591 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:41.805431 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:41.805431 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:41.805431 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:41.805431 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:41.805431 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:41.805431 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:41.805431 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:41.805431 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:41.805431 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:41.805431 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:41.805431 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:41.805431 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:12:41.807713 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 164/329] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:12:41.817204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ab69e-ea47-4e97-b0a9-07637a7c4010 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:41.932528 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:41.940695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:41.946421 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ab69e-ea47-4e97-b0a9-07637a7c4010 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:41.964705 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6235736-580d-4316-9a8c-7636ff31b299 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:41.988549 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f8fc5-83da-470c-9832-d4a9bd43e0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:41.989175 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f8fc5-83da-470c-9832-d4a9bd43e0ea None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:41.989498 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f8fc5-83da-470c-9832-d4a9bd43e0ea None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:41.989776 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f8fc5-83da-470c-9832-d4a9bd43e0ea None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:41.990569 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f8fc5-83da-470c-9832-d4a9bd43e0ea None admin] RBAC: Adding query filter params (name=member) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:41.990884 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f8fc5-83da-470c-9832-d4a9bd43e0ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:41.992301 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f8fc5-83da-470c-9832-d4a9bd43e0ea None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:42.004182 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 165/330] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:42.006575 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5f730-bb46-4d3f-ac3c-5d3c63581671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:42.007373 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5f730-bb46-4d3f-ac3c-5d3c63581671 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:42.007725 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5f730-bb46-4d3f-ac3c-5d3c63581671 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:42.008086 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5f730-bb46-4d3f-ac3c-5d3c63581671 None admin] PATH_INFO: `/v3/users/2c540bd6e26b4dffa320a0576f029623` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:42.009345 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5f730-bb46-4d3f-ac3c-5d3c63581671 None admin] RBAC: Authorizing `identity:get_user(user_id=2c540bd6e26b4dffa320a0576f029623)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:42.010904 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5f730-bb46-4d3f-ac3c-5d3c63581671 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:42.013570 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 166/331] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:41 2022] GET /identity/v3/users/2c540bd6e26b4dffa320a0576f029623 => generated 293 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:42.014460 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f8fc5-83da-470c-9832-d4a9bd43e0ea None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:42.022275 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5f730-bb46-4d3f-ac3c-5d3c63581671 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:42.145878 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f8fc5-83da-470c-9832-d4a9bd43e0ea None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:42.156342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5f730-bb46-4d3f-ac3c-5d3c63581671 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:42.193707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b37292-005c-43c2-ba9a-5d72e61055af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:42.194358 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b37292-005c-43c2-ba9a-5d72e61055af None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:42.194637 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b37292-005c-43c2-ba9a-5d72e61055af None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:42.194917 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b37292-005c-43c2-ba9a-5d72e61055af None admin] PATH_INFO: `/v3/users/be758a743219445b96453eea968636a2` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:42.196388 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b37292-005c-43c2-ba9a-5d72e61055af None admin] RBAC: Authorizing `identity:get_user(user_id=be758a743219445b96453eea968636a2)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:42.198154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b37292-005c-43c2-ba9a-5d72e61055af None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:42.201514 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 166/332] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:42 2022] GET /identity/v3/users/be758a743219445b96453eea968636a2 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:42.201652 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:42.208931 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b37292-005c-43c2-ba9a-5d72e61055af None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:42.209958 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68112c-986f-4003-aa38-075831ad2cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:42.210879 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68112c-986f-4003-aa38-075831ad2cb5 None admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:42.211383 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68112c-986f-4003-aa38-075831ad2cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:42.212027 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68112c-986f-4003-aa38-075831ad2cb5 None admin] PATH_INFO: `/v3/system/users/2c540bd6e26b4dffa320a0576f029623/roles/6eb34cd17388449f9099dd83fb076032` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:42.213922 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68112c-986f-4003-aa38-075831ad2cb5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2c540bd6e26b4dffa320a0576f029623, role_id=6eb34cd17388449f9099dd83fb076032)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:42.216252 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68112c-986f-4003-aa38-075831ad2cb5 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:42.227289 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 167/333] 10.222.0.77 () {58 vars in 1334 bytes} [Tue Aug 23 22:12:42 2022] PUT /identity/v3/system/users/2c540bd6e26b4dffa320a0576f029623/roles/6eb34cd17388449f9099dd83fb076032 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:12:42.268791 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:42.427041 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b37292-005c-43c2-ba9a-5d72e61055af None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:42.485799 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42181ba9-d0f9-4d77-ac4a-3ac54d6fe326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:42.486800 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42181ba9-d0f9-4d77-ac4a-3ac54d6fe326 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:42.487361 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42181ba9-d0f9-4d77-ac4a-3ac54d6fe326 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:42.487835 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42181ba9-d0f9-4d77-ac4a-3ac54d6fe326 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:42.488808 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42181ba9-d0f9-4d77-ac4a-3ac54d6fe326 None admin] RBAC: Adding query filter params (role.id=eabf42a0387a47218c5ce577dd65f61c, user.id=be758a743219445b96453eea968636a2, scope.system=all) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:42.489334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42181ba9-d0f9-4d77-ac4a-3ac54d6fe326 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:42.491037 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42181ba9-d0f9-4d77-ac4a-3ac54d6fe326 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:42.510825 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 167/334] 10.222.0.77 () {56 vars in 1308 bytes} [Tue Aug 23 22:12:42 2022] GET /identity/v3/role_assignments?user.id=be758a743219445b96453eea968636a2&scope.system=all&role.id=eabf42a0387a47218c5ce577dd65f61c => generated 510 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:43.980698 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82e0b2-72a7-43e3-81c7-77bae61303e2 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:43.981767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82e0b2-72a7-43e3-81c7-77bae61303e2 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:43.982331 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82e0b2-72a7-43e3-81c7-77bae61303e2 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:43.984440 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 168/335] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:43.991472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2652eb-876d-408e-925a-0648464067b9 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:43.992390 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2652eb-876d-408e-925a-0648464067b9 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:43.992872 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2652eb-876d-408e-925a-0648464067b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:44.018176 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-7d2652eb-876d-408e-925a-0648464067b9 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:44.019747 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-7d2652eb-876d-408e-925a-0648464067b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:44.133127 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 168/336] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:44.533467 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe683d-82f8-4558-bb90-5ffefa58438a None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:44.534623 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe683d-82f8-4558-bb90-5ffefa58438a None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:44.535391 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe683d-82f8-4558-bb90-5ffefa58438a None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:44.538691 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 169/337] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:44.544848 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecebb3-0eb3-40b0-9b38-57fbca4df631 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:44.545213 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecebb3-0eb3-40b0-9b38-57fbca4df631 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:44.545531 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecebb3-0eb3-40b0-9b38-57fbca4df631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:44.568322 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-f0ecebb3-0eb3-40b0-9b38-57fbca4df631 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:44.569608 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-f0ecebb3-0eb3-40b0-9b38-57fbca4df631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:44.584564 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:44.665502 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 169/338] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:12:44.991870 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe683d-82f8-4558-bb90-5ffefa58438a None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:45.052433 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecebb3-0eb3-40b0-9b38-57fbca4df631 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:45.223155 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe683d-82f8-4558-bb90-5ffefa58438a None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:45.299789 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53fd07-d19a-46ce-8454-72351e1b3919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:45.300445 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53fd07-d19a-46ce-8454-72351e1b3919 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:45.300746 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53fd07-d19a-46ce-8454-72351e1b3919 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:45.301080 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53fd07-d19a-46ce-8454-72351e1b3919 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:45.325882 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecebb3-0eb3-40b0-9b38-57fbca4df631 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:45.329543 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53fd07-d19a-46ce-8454-72351e1b3919 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:45.342950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-af53fd07-d19a-46ce-8454-72351e1b3919 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:12:45.342950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:45.342950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:45.342950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:45.342950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:45.342950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:45.342950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:45.342950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:45.342950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:45.342950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:45.342950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:45.342950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:45.342950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:45.342950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:45.342950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:45.342950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:45.344142 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:45.344142 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:45.344142 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:45.344142 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:45.344142 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:45.344142 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:45.344142 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:45.344142 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:45.344142 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:45.344142 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:45.344142 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:45.344142 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:45.344142 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:45.344142 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:45.344142 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:45.344142 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:45.345496 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:45.345496 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:45.345496 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:45.345496 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:45.345496 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:45.345496 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:45.345496 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:45.345496 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:45.345496 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:45.345496 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:45.345496 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:12:45.345496 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:12:45.345496 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 170/339] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Aug 23 22:12:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:45.346577 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee34110-bd64-44d5-8ed3-39b026d87931 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:45.346577 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee34110-bd64-44d5-8ed3-39b026d87931 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:45.346577 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee34110-bd64-44d5-8ed3-39b026d87931 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:45.347908 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 171/340] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:45.355522 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72eabc-b7ab-4c85-83cd-96b73730d26f None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:45.355862 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72eabc-b7ab-4c85-83cd-96b73730d26f None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:45.357156 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72eabc-b7ab-4c85-83cd-96b73730d26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:45.405298 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2d4f8-5961-438f-aaaa-78b3c6a5d459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:45.406441 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2d4f8-5961-438f-aaaa-78b3c6a5d459 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:45.406890 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2d4f8-5961-438f-aaaa-78b3c6a5d459 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:45.407223 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2d4f8-5961-438f-aaaa-78b3c6a5d459 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:45.412542 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-6e72eabc-b7ab-4c85-83cd-96b73730d26f None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:45.414053 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-6e72eabc-b7ab-4c85-83cd-96b73730d26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:45.438408 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2d4f8-5961-438f-aaaa-78b3c6a5d459 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:45.443310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-25a2d4f8-5961-438f-aaaa-78b3c6a5d459 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:45.443310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:45.443310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:45.443310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:45.443310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:45.443310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:45.443310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:45.443310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:45.443310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:45.443310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:45.443310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:45.443310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:45.443310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:45.443310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:45.443310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:45.443310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:45.444812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:45.444812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:45.444812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:45.444812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:45.444812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:45.444812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:45.444812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:45.444812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:45.444812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:45.444812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:45.444812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:45.444812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:45.444812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:45.444812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:45.444812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:45.444812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:45.446950 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:45.446950 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:45.446950 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:45.446950 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:45.446950 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:45.446950 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:45.446950 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:45.446950 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:45.446950 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:45.446950 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:45.446950 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:45.446950 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:12:45.446950 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 170/341] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:45.449909 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2d4f8-5961-438f-aaaa-78b3c6a5d459 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:45.470667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:45.526866 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:45.594013 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 172/342] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:45.595898 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72eabc-b7ab-4c85-83cd-96b73730d26f None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:45.784670 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2d4f8-5961-438f-aaaa-78b3c6a5d459 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:45.872570 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cebe035-a534-487f-96a3-ae23dfa5358d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:45.873113 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebe035-a534-487f-96a3-ae23dfa5358d None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:45.873434 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebe035-a534-487f-96a3-ae23dfa5358d None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:45.873941 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebe035-a534-487f-96a3-ae23dfa5358d None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:45.875072 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cebe035-a534-487f-96a3-ae23dfa5358d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:45.875380 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cebe035-a534-487f-96a3-ae23dfa5358d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:45.877079 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cebe035-a534-487f-96a3-ae23dfa5358d None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:45.890794 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72eabc-b7ab-4c85-83cd-96b73730d26f None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:45.895955 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 171/343] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:12:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:45.897323 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb1c70-01a2-48fc-a83a-79f609a3190b None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:45.897650 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb1c70-01a2-48fc-a83a-79f609a3190b None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:45.897933 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb1c70-01a2-48fc-a83a-79f609a3190b None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:45.899520 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 172/344] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:45.910258 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb1c70-01a2-48fc-a83a-79f609a3190b None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:45.943186 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a4392-5592-4ae0-8e2a-348a59fe262d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:45.944010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a4392-5592-4ae0-8e2a-348a59fe262d None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:45.944400 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a4392-5592-4ae0-8e2a-348a59fe262d None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:45.944832 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a4392-5592-4ae0-8e2a-348a59fe262d None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:45.945852 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a4392-5592-4ae0-8e2a-348a59fe262d None admin] RBAC: Adding query filter params (name=member) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:45.948049 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a4392-5592-4ae0-8e2a-348a59fe262d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:45.951226 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a4392-5592-4ae0-8e2a-348a59fe262d None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:45.975957 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 173/345] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:45.979496 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade66410-e4d1-4538-a1e4-7d8f557f65aa None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:45.979805 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade66410-e4d1-4538-a1e4-7d8f557f65aa None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:45.980109 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade66410-e4d1-4538-a1e4-7d8f557f65aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:46.019216 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-ade66410-e4d1-4538-a1e4-7d8f557f65aa None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:46.020468 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-ade66410-e4d1-4538-a1e4-7d8f557f65aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:46.061214 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:46.129287 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:46.151502 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb1c70-01a2-48fc-a83a-79f609a3190b None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:46.187368 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 174/346] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:46.189175 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade66410-e4d1-4538-a1e4-7d8f557f65aa None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:46.208698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6ca09-53f0-405c-9326-55d64f64a644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:46.209882 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6ca09-53f0-405c-9326-55d64f64a644 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:46.210575 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6ca09-53f0-405c-9326-55d64f64a644 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:46.211106 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6ca09-53f0-405c-9326-55d64f64a644 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:46.300053 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da6ca09-53f0-405c-9326-55d64f64a644 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:46.302186 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da6ca09-53f0-405c-9326-55d64f64a644 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:46.390419 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:46.441329 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 173/347] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:46.443070 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6ca09-53f0-405c-9326-55d64f64a644 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:46.486437 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade66410-e4d1-4538-a1e4-7d8f557f65aa None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:46.558744 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7b57b-04a8-4c62-98d7-a725d78867bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:46.559009 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7b57b-04a8-4c62-98d7-a725d78867bc None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:46.559871 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7b57b-04a8-4c62-98d7-a725d78867bc None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:46.560212 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7b57b-04a8-4c62-98d7-a725d78867bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:46.603847 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6ca09-53f0-405c-9326-55d64f64a644 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:46.649855 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:46.670258 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70793863-57b1-449d-bf1b-4871cb1823cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:46.670989 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70793863-57b1-449d-bf1b-4871cb1823cb None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:46.671299 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70793863-57b1-449d-bf1b-4871cb1823cb None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:46.671575 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70793863-57b1-449d-bf1b-4871cb1823cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:46.689650 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70793863-57b1-449d-bf1b-4871cb1823cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:46.694699 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-70793863-57b1-449d-bf1b-4871cb1823cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:46.694699 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:46.694699 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:46.694699 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:46.694699 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:46.694699 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:46.694699 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:46.694699 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:46.694699 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:46.694699 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:46.694699 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:46.694699 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:46.694699 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:46.694699 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:46.694699 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:46.694699 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:46.695659 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:46.695659 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:46.695659 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:46.695659 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:46.695659 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:46.695659 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:46.695659 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:46.695659 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:46.695659 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:46.695659 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:46.695659 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:46.695659 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:46.695659 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:46.695659 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:46.695659 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:46.695659 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:46.696564 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:46.696564 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:46.696564 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:46.696564 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:46.696564 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:46.696564 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:46.696564 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:46.696564 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:46.696564 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:46.696564 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:46.696564 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:46.696564 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:12:46.696564 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 174/348] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:46.702994 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70793863-57b1-449d-bf1b-4871cb1823cb None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:46.705993 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7b57b-04a8-4c62-98d7-a725d78867bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:46.707499 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7b57b-04a8-4c62-98d7-a725d78867bc None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:46.788997 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:46.945224 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70793863-57b1-449d-bf1b-4871cb1823cb None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:46.949662 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 175/349] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 762 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:46.951810 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7b57b-04a8-4c62-98d7-a725d78867bc None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:47.011053 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ce4f2-f196-4e60-bfc7-b572b2c0a7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:47.011945 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ce4f2-f196-4e60-bfc7-b572b2c0a7b9 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:47.012952 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ce4f2-f196-4e60-bfc7-b572b2c0a7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:47.013980 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ce4f2-f196-4e60-bfc7-b572b2c0a7b9 None admin] PATH_INFO: `/v3/projects/60a5733a3c634efca6df17f66d53c587` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:47.016079 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ce4f2-f196-4e60-bfc7-b572b2c0a7b9 None admin] RBAC: Authorizing `identity:get_project(project_id=60a5733a3c634efca6df17f66d53c587)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:47.018208 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ce4f2-f196-4e60-bfc7-b572b2c0a7b9 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:47.021476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 175/350] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:46 2022] GET /identity/v3/projects/60a5733a3c634efca6df17f66d53c587 => generated 298 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:47.023294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ce4f2-f196-4e60-bfc7-b572b2c0a7b9 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:47.085648 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:47.125488 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7b57b-04a8-4c62-98d7-a725d78867bc None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:47.182439 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a73d6-f5d4-4e82-9bd3-c1622d6a465d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:47.183816 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a73d6-f5d4-4e82-9bd3-c1622d6a465d None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:47.184342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a73d6-f5d4-4e82-9bd3-c1622d6a465d None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:47.185252 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a73d6-f5d4-4e82-9bd3-c1622d6a465d None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:47.188360 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a73d6-f5d4-4e82-9bd3-c1622d6a465d None admin] RBAC: Adding query filter params (name=member) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:47.189655 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a73d6-f5d4-4e82-9bd3-c1622d6a465d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:47.192854 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a73d6-f5d4-4e82-9bd3-c1622d6a465d None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:47.195209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:47.207740 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ce4f2-f196-4e60-bfc7-b572b2c0a7b9 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:47.213419 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 176/351] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:47.213419 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7738ea3-ab7b-40cd-b443-a3e8008dbafd None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:47.213419 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7738ea3-ab7b-40cd-b443-a3e8008dbafd None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:47.213419 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7738ea3-ab7b-40cd-b443-a3e8008dbafd None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:47.213802 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 177/352] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:47.215113 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c11a65-df26-4468-b0e5-b7af16f3d8b2 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:47.219652 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c11a65-df26-4468-b0e5-b7af16f3d8b2 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:47.220249 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c11a65-df26-4468-b0e5-b7af16f3d8b2 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:47.223802 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 178/353] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:47 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:47.225630 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c11a65-df26-4468-b0e5-b7af16f3d8b2 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:47.266085 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b1967-e341-4327-aa0c-1cfe402a2b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:47.266910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b1967-e341-4327-aa0c-1cfe402a2b26 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:47.267335 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b1967-e341-4327-aa0c-1cfe402a2b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:47.267712 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b1967-e341-4327-aa0c-1cfe402a2b26 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:47.281766 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b1967-e341-4327-aa0c-1cfe402a2b26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:47.287494 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-d50b1967-e341-4327-aa0c-1cfe402a2b26 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:12:47.287494 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:47.287494 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:47.287494 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:47.287494 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:47.287494 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:47.287494 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:47.287494 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:47.287494 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:47.287494 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:47.287494 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:47.287494 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:47.287494 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:47.287494 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:47.287494 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:47.287494 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:47.288427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:47.288427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:47.288427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:47.288427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:47.288427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:47.288427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:47.288427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:47.288427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:47.288427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:47.288427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:47.288427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:47.288427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:47.288427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:47.288427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:47.288427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:47.288427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:47.289209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:47.289209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:47.289209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:47.289209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:47.289209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:47.289209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:47.289209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:47.289209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:47.289209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:47.289209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:47.289209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:12:47.289209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:12:47.291280 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 176/354] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:47.291280 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b1967-e341-4327-aa0c-1cfe402a2b26 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:47.425931 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c11a65-df26-4468-b0e5-b7af16f3d8b2 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:47.469127 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b1967-e341-4327-aa0c-1cfe402a2b26 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:47.484488 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc96c2a-6691-4716-8633-9b10fbe4e64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:47.485219 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc96c2a-6691-4716-8633-9b10fbe4e64a None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:47.485592 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc96c2a-6691-4716-8633-9b10fbe4e64a None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:47.490231 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc96c2a-6691-4716-8633-9b10fbe4e64a None admin] PATH_INFO: `/v3/projects/60a5733a3c634efca6df17f66d53c587` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:47.490231 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc96c2a-6691-4716-8633-9b10fbe4e64a None admin] RBAC: Authorizing `identity:get_project(project_id=60a5733a3c634efca6df17f66d53c587)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:47.490434 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc96c2a-6691-4716-8633-9b10fbe4e64a None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:47.495834 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 179/355] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:47 2022] GET /identity/v3/projects/60a5733a3c634efca6df17f66d53c587 => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:47.495834 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc96c2a-6691-4716-8633-9b10fbe4e64a None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:47.511114 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:47.538609 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61245f-da9b-49eb-b2a0-6225c9da51de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:47.539444 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61245f-da9b-49eb-b2a0-6225c9da51de None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:47.539914 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61245f-da9b-49eb-b2a0-6225c9da51de None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:47.540257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61245f-da9b-49eb-b2a0-6225c9da51de None admin] PATH_INFO: `/v3/groups/fd003810f62e4df6a40a9449d3b4e35f` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:47.555764 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61245f-da9b-49eb-b2a0-6225c9da51de None admin] RBAC: Authorizing `identity:get_group(group_id=fd003810f62e4df6a40a9449d3b4e35f)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:47.558812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61245f-da9b-49eb-b2a0-6225c9da51de None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:47.565443 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 177/356] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Aug 23 22:12:47 2022] GET /identity/v3/groups/fd003810f62e4df6a40a9449d3b4e35f => generated 226 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:47.565443 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8ce7b-33ad-4ea4-a761-b8a984ace63b None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:47.567464 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8ce7b-33ad-4ea4-a761-b8a984ace63b None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:47.570930 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8ce7b-33ad-4ea4-a761-b8a984ace63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:47.603035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-11f8ce7b-33ad-4ea4-a761-b8a984ace63b None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:47.604709 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-11f8ce7b-33ad-4ea4-a761-b8a984ace63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:47.633220 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:47.682656 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc96c2a-6691-4716-8633-9b10fbe4e64a None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:47.712885 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 178/357] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:47.715569 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8aecd6-1053-42aa-a2a6-350c6fdff0d5 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:47.716277 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8aecd6-1053-42aa-a2a6-350c6fdff0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:47.716783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8aecd6-1053-42aa-a2a6-350c6fdff0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:47.756837 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d589e0-d9f0-4c4f-8aeb-d87475b1dc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:47.757948 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d589e0-d9f0-4c4f-8aeb-d87475b1dc76 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:47.758420 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d589e0-d9f0-4c4f-8aeb-d87475b1dc76 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:47.758709 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-1e8aecd6-1053-42aa-a2a6-350c6fdff0d5 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:47.759250 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d589e0-d9f0-4c4f-8aeb-d87475b1dc76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:47.760702 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-1e8aecd6-1053-42aa-a2a6-350c6fdff0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:47.883660 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d589e0-d9f0-4c4f-8aeb-d87475b1dc76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:47.884143 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 179/358] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:47.884748 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8aecd6-1053-42aa-a2a6-350c6fdff0d5 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:47.885301 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d589e0-d9f0-4c4f-8aeb-d87475b1dc76 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:47.898771 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:48.039990 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:48.063382 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 180/359] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:48.064477 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d589e0-d9f0-4c4f-8aeb-d87475b1dc76 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:48.079691 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8aecd6-1053-42aa-a2a6-350c6fdff0d5 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:48.147707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b05103-a6ac-492a-aed3-c22b281fd200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:48.147707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b05103-a6ac-492a-aed3-c22b281fd200 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:48.147707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b05103-a6ac-492a-aed3-c22b281fd200 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:48.147707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b05103-a6ac-492a-aed3-c22b281fd200 None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:48.151187 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b05103-a6ac-492a-aed3-c22b281fd200 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:48.151187 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b05103-a6ac-492a-aed3-c22b281fd200 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:48.151187 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b05103-a6ac-492a-aed3-c22b281fd200 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:48.167129 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 180/360] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:48.168103 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b05103-a6ac-492a-aed3-c22b281fd200 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:48.258089 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d589e0-d9f0-4c4f-8aeb-d87475b1dc76 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:48.272097 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:48.313599 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5c318-371c-4530-9c90-b386dca2ce91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:48.315081 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5c318-371c-4530-9c90-b386dca2ce91 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:48.315465 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5c318-371c-4530-9c90-b386dca2ce91 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:48.315828 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5c318-371c-4530-9c90-b386dca2ce91 None admin] PATH_INFO: `/v3/groups/fd003810f62e4df6a40a9449d3b4e35f` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:48.317253 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5c318-371c-4530-9c90-b386dca2ce91 None admin] RBAC: Authorizing `identity:get_group(group_id=fd003810f62e4df6a40a9449d3b4e35f)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:48.318947 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5c318-371c-4530-9c90-b386dca2ce91 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:48.320838 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 181/361] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Aug 23 22:12:48 2022] GET /identity/v3/groups/fd003810f62e4df6a40a9449d3b4e35f => generated 226 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:48.321785 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5c318-371c-4530-9c90-b386dca2ce91 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:48.343980 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b05103-a6ac-492a-aed3-c22b281fd200 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:48.395033 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a264e-b025-49d0-910c-0b69b4918eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:48.395824 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a264e-b025-49d0-910c-0b69b4918eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:48.396211 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a264e-b025-49d0-910c-0b69b4918eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:48.396773 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a264e-b025-49d0-910c-0b69b4918eb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:48.397765 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a264e-b025-49d0-910c-0b69b4918eb4 None admin] RBAC: Adding query filter params (group.id=fd003810f62e4df6a40a9449d3b4e35f, role.id=a0449d430ec54adcabb96193af2f7cd5, scope.project.id=60a5733a3c634efca6df17f66d53c587) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:48.398215 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a264e-b025-49d0-910c-0b69b4918eb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:48.404839 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a264e-b025-49d0-910c-0b69b4918eb4 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:48.413620 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 181/362] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Aug 23 22:12:48 2022] GET /identity/v3/role_assignments?group.id=fd003810f62e4df6a40a9449d3b4e35f&scope.project.id=60a5733a3c634efca6df17f66d53c587&role.id=a0449d430ec54adcabb96193af2f7cd5 => generated 260 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:48.415288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a264e-b025-49d0-910c-0b69b4918eb4 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:48.433610 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:48.500901 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5c318-371c-4530-9c90-b386dca2ce91 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:48.566994 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c667203-ebf4-4e49-8bda-89065c2a41d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:48.567709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c667203-ebf4-4e49-8bda-89065c2a41d9 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:48.568016 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c667203-ebf4-4e49-8bda-89065c2a41d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:48.568421 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c667203-ebf4-4e49-8bda-89065c2a41d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:48.586258 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c667203-ebf4-4e49-8bda-89065c2a41d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:48.591719 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a264e-b025-49d0-910c-0b69b4918eb4 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:48.594680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-5c667203-ebf4-4e49-8bda-89065c2a41d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:12:48.594680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:48.594680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:48.594680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:48.594680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:48.594680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:48.594680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:48.594680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:48.594680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:48.594680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:48.594680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:48.594680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:48.594680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:48.594680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:48.594680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:48.594680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:48.595850 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:48.595850 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:48.595850 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:48.595850 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:48.595850 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:48.595850 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:48.595850 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:48.595850 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:48.595850 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:48.595850 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:48.595850 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:48.595850 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:48.595850 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:48.595850 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:48.595850 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:48.595850 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:48.597269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:48.597269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:48.597269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:48.597269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:48.597269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:48.597269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:48.597269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:48.597269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:48.597269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:48.597269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:48.597269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:12:48.597269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:12:48.597269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 182/363] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Aug 23 22:12:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:48.598257 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c667203-ebf4-4e49-8bda-89065c2a41d9 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:48.649122 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a9af2-830d-40f0-9612-242cf3dacc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:48.650225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a9af2-830d-40f0-9612-242cf3dacc6d None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:48.650764 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a9af2-830d-40f0-9612-242cf3dacc6d None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:48.651044 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a9af2-830d-40f0-9612-242cf3dacc6d None admin] PATH_INFO: `/v3/projects/20cc73f001a245c680144a956b81a15e` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:48.651385 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:48.652588 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a9af2-830d-40f0-9612-242cf3dacc6d None admin] RBAC: Authorizing `identity:get_project(project_id=20cc73f001a245c680144a956b81a15e)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:48.657192 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a9af2-830d-40f0-9612-242cf3dacc6d None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:48.659823 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 182/364] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:48 2022] GET /identity/v3/projects/20cc73f001a245c680144a956b81a15e => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:48.665520 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a9af2-830d-40f0-9612-242cf3dacc6d None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:48.771264 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c667203-ebf4-4e49-8bda-89065c2a41d9 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:48.823570 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:48.839446 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235acce-8f82-4573-a9ed-ac2246b677e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:48.840106 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235acce-8f82-4573-a9ed-ac2246b677e9 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:48.840589 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235acce-8f82-4573-a9ed-ac2246b677e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:48.841604 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235acce-8f82-4573-a9ed-ac2246b677e9 None admin] PATH_INFO: `/v3/users/2c540bd6e26b4dffa320a0576f029623` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:48.843175 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235acce-8f82-4573-a9ed-ac2246b677e9 None admin] RBAC: Authorizing `identity:get_user(user_id=2c540bd6e26b4dffa320a0576f029623)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:48.844655 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235acce-8f82-4573-a9ed-ac2246b677e9 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:48.846731 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 183/365] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:48 2022] GET /identity/v3/users/2c540bd6e26b4dffa320a0576f029623 => generated 293 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:48.847568 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235acce-8f82-4573-a9ed-ac2246b677e9 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:48.864607 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a9af2-830d-40f0-9612-242cf3dacc6d None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:48.914298 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c551b-425e-47e7-bf25-3413b9d5eed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:48.915078 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c551b-425e-47e7-bf25-3413b9d5eed6 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:48.915518 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c551b-425e-47e7-bf25-3413b9d5eed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:48.915789 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c551b-425e-47e7-bf25-3413b9d5eed6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:48.929665 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c551b-425e-47e7-bf25-3413b9d5eed6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:48.935331 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-323c551b-425e-47e7-bf25-3413b9d5eed6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:12:48.935331 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:48.935331 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:48.935331 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:48.935331 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:48.935331 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:48.935331 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:48.935331 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:48.935331 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:48.935331 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:48.935331 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:48.935331 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:48.935331 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:48.935331 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:48.935331 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:48.935331 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:48.936820 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:48.936820 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:48.936820 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:48.936820 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:48.936820 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:48.936820 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:48.936820 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:48.936820 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:48.936820 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:48.936820 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:48.936820 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:48.936820 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:48.936820 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:48.936820 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:48.936820 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:48.936820 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:48.938667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:48.938667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:48.938667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:48.938667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:48.938667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:48.938667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:48.938667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:48.938667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:48.938667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:48.938667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:48.938667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:12:48.938667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:12:48.938667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 183/366] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:12:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:48.938667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c551b-425e-47e7-bf25-3413b9d5eed6 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:49.015277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235acce-8f82-4573-a9ed-ac2246b677e9 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:49.017338 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:49.069193 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1406d-21ca-4e0f-a519-74bb828e31a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:49.070218 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1406d-21ca-4e0f-a519-74bb828e31a8 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:49.070703 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1406d-21ca-4e0f-a519-74bb828e31a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:49.071151 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1406d-21ca-4e0f-a519-74bb828e31a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:49.072504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1406d-21ca-4e0f-a519-74bb828e31a8 None admin] RBAC: Adding query filter params (group.id=fd003810f62e4df6a40a9449d3b4e35f, role.id=eabf42a0387a47218c5ce577dd65f61c, scope.project.id=60a5733a3c634efca6df17f66d53c587) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:49.073054 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1406d-21ca-4e0f-a519-74bb828e31a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:49.076384 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1406d-21ca-4e0f-a519-74bb828e31a8 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:49.097415 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 184/367] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Aug 23 22:12:48 2022] GET /identity/v3/role_assignments?group.id=fd003810f62e4df6a40a9449d3b4e35f&scope.project.id=60a5733a3c634efca6df17f66d53c587&role.id=eabf42a0387a47218c5ce577dd65f61c => generated 260 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:49.097415 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1406d-21ca-4e0f-a519-74bb828e31a8 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:49.104210 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c551b-425e-47e7-bf25-3413b9d5eed6 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:49.164125 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d8fdd-0d72-459c-8f21-e494770e07ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:49.164898 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d8fdd-0d72-459c-8f21-e494770e07ba None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:49.165294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d8fdd-0d72-459c-8f21-e494770e07ba None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:49.165708 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d8fdd-0d72-459c-8f21-e494770e07ba None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:49.167450 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d8fdd-0d72-459c-8f21-e494770e07ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:49.167839 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d8fdd-0d72-459c-8f21-e494770e07ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:49.170924 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d8fdd-0d72-459c-8f21-e494770e07ba None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:49.173584 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:49.185877 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 184/368] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:12:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:49.186799 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d8fdd-0d72-459c-8f21-e494770e07ba None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:49.275517 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1406d-21ca-4e0f-a519-74bb828e31a8 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:49.331479 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a27cac-ad60-49f6-b7e2-a0f1fb082186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:49.332743 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a27cac-ad60-49f6-b7e2-a0f1fb082186 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:49.334959 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a27cac-ad60-49f6-b7e2-a0f1fb082186 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:49.335455 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a27cac-ad60-49f6-b7e2-a0f1fb082186 None admin] PATH_INFO: `/v3/groups/fd003810f62e4df6a40a9449d3b4e35f` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:49.337732 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a27cac-ad60-49f6-b7e2-a0f1fb082186 None admin] RBAC: Authorizing `identity:get_group(group_id=fd003810f62e4df6a40a9449d3b4e35f)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:49.339211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a27cac-ad60-49f6-b7e2-a0f1fb082186 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:49.346808 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 185/369] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Aug 23 22:12:49 2022] GET /identity/v3/groups/fd003810f62e4df6a40a9449d3b4e35f => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:49.347800 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a27cac-ad60-49f6-b7e2-a0f1fb082186 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:49.349735 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d8fdd-0d72-459c-8f21-e494770e07ba None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:49.394907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922707c-2b4a-4619-ad9b-6ec8a70b69d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:49.395958 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922707c-2b4a-4619-ad9b-6ec8a70b69d6 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:49.396309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:49.396634 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922707c-2b4a-4619-ad9b-6ec8a70b69d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:49.397408 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922707c-2b4a-4619-ad9b-6ec8a70b69d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:49.399402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922707c-2b4a-4619-ad9b-6ec8a70b69d6 None admin] RBAC: Adding query filter params (role.id=6eb34cd17388449f9099dd83fb076032, user.id=2c540bd6e26b4dffa320a0576f029623, scope.system=all) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:49.399937 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922707c-2b4a-4619-ad9b-6ec8a70b69d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:49.401714 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922707c-2b4a-4619-ad9b-6ec8a70b69d6 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:49.421866 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 185/370] 10.222.0.77 () {56 vars in 1308 bytes} [Tue Aug 23 22:12:49 2022] GET /identity/v3/role_assignments?user.id=2c540bd6e26b4dffa320a0576f029623&scope.system=all&role.id=6eb34cd17388449f9099dd83fb076032 => generated 510 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:49.423039 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922707c-2b4a-4619-ad9b-6ec8a70b69d6 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:49.534440 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:49.549202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a27cac-ad60-49f6-b7e2-a0f1fb082186 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:49.594520 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33713310-5385-42f6-8589-0e58194c7e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:49.595149 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33713310-5385-42f6-8589-0e58194c7e89 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:49.595463 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33713310-5385-42f6-8589-0e58194c7e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:49.595726 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33713310-5385-42f6-8589-0e58194c7e89 None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:49.596442 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33713310-5385-42f6-8589-0e58194c7e89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:49.596753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33713310-5385-42f6-8589-0e58194c7e89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:49.598212 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33713310-5385-42f6-8589-0e58194c7e89 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:49.621471 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 186/371] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:49.622742 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33713310-5385-42f6-8589-0e58194c7e89 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:49.645869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922707c-2b4a-4619-ad9b-6ec8a70b69d6 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:49.740645 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae49ad6-4442-4b3e-acd9-50886087aecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:49.742103 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae49ad6-4442-4b3e-acd9-50886087aecd None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:49.742884 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae49ad6-4442-4b3e-acd9-50886087aecd None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:49.744329 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae49ad6-4442-4b3e-acd9-50886087aecd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:49.845909 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:49.862943 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33713310-5385-42f6-8589-0e58194c7e89 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:49.894627 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae49ad6-4442-4b3e-acd9-50886087aecd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:49.896482 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae49ad6-4442-4b3e-acd9-50886087aecd None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:49.961960 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1ba5f-406f-4dff-af64-3a28e953fee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:49.963210 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1ba5f-406f-4dff-af64-3a28e953fee0 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:49.963699 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1ba5f-406f-4dff-af64-3a28e953fee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:49.964174 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1ba5f-406f-4dff-af64-3a28e953fee0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:49.966076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1ba5f-406f-4dff-af64-3a28e953fee0 None admin] RBAC: Adding query filter params (group.id=fd003810f62e4df6a40a9449d3b4e35f, role.id=eabf42a0387a47218c5ce577dd65f61c, scope.project.id=20cc73f001a245c680144a956b81a15e) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:49.966592 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1ba5f-406f-4dff-af64-3a28e953fee0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:49.967130 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:49.971785 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1ba5f-406f-4dff-af64-3a28e953fee0 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:49.984411 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 187/372] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Aug 23 22:12:49 2022] GET /identity/v3/role_assignments?group.id=fd003810f62e4df6a40a9449d3b4e35f&scope.project.id=20cc73f001a245c680144a956b81a15e&role.id=eabf42a0387a47218c5ce577dd65f61c => generated 260 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:49.985992 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1ba5f-406f-4dff-af64-3a28e953fee0 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:50.026300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 186/373] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:50.036075 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae49ad6-4442-4b3e-acd9-50886087aecd None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:50.173405 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae49ad6-4442-4b3e-acd9-50886087aecd None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:50.214649 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1ba5f-406f-4dff-af64-3a28e953fee0 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:50.221448 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58abd7b-f3c8-47de-a9da-6e0e1f2ca361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:50.222115 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58abd7b-f3c8-47de-a9da-6e0e1f2ca361 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:50.222400 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58abd7b-f3c8-47de-a9da-6e0e1f2ca361 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:50.222675 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58abd7b-f3c8-47de-a9da-6e0e1f2ca361 None admin] PATH_INFO: `/v3/projects/20cc73f001a245c680144a956b81a15e` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:50.223900 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58abd7b-f3c8-47de-a9da-6e0e1f2ca361 None admin] RBAC: Authorizing `identity:get_project(project_id=20cc73f001a245c680144a956b81a15e)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:50.225487 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58abd7b-f3c8-47de-a9da-6e0e1f2ca361 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:50.227508 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 187/374] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:50 2022] GET /identity/v3/projects/20cc73f001a245c680144a956b81a15e => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:50.235045 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58abd7b-f3c8-47de-a9da-6e0e1f2ca361 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:50.263681 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:50.287167 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd931bb8-80d9-452a-941f-4fde7881d640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:50.288208 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd931bb8-80d9-452a-941f-4fde7881d640 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:50.288653 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd931bb8-80d9-452a-941f-4fde7881d640 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:50.289108 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd931bb8-80d9-452a-941f-4fde7881d640 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:50.348590 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:50.357779 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58abd7b-f3c8-47de-a9da-6e0e1f2ca361 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:50.415752 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b420b0f-03f1-4d0e-bfc5-1204a9eaca62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:50.416861 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b420b0f-03f1-4d0e-bfc5-1204a9eaca62 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:50.417470 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b420b0f-03f1-4d0e-bfc5-1204a9eaca62 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:50.418036 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b420b0f-03f1-4d0e-bfc5-1204a9eaca62 None admin] PATH_INFO: `/v3/groups/fd003810f62e4df6a40a9449d3b4e35f` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:50.422857 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b420b0f-03f1-4d0e-bfc5-1204a9eaca62 None admin] RBAC: Authorizing `identity:get_group(group_id=fd003810f62e4df6a40a9449d3b4e35f)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:50.424868 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b420b0f-03f1-4d0e-bfc5-1204a9eaca62 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:50.428669 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 188/375] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Aug 23 22:12:50 2022] GET /identity/v3/groups/fd003810f62e4df6a40a9449d3b4e35f => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:50.432780 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b420b0f-03f1-4d0e-bfc5-1204a9eaca62 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:50.445981 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd931bb8-80d9-452a-941f-4fde7881d640 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:50.448823 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd931bb8-80d9-452a-941f-4fde7881d640 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:50.584453 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:50.612158 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b420b0f-03f1-4d0e-bfc5-1204a9eaca62 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:50.645251 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 188/376] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:50.653919 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd931bb8-80d9-452a-941f-4fde7881d640 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:50.680159 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88daaa1b-853b-4c35-8df5-6e5f2442df94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:50.681260 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daaa1b-853b-4c35-8df5-6e5f2442df94 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:50.681691 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daaa1b-853b-4c35-8df5-6e5f2442df94 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:50.682087 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daaa1b-853b-4c35-8df5-6e5f2442df94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:50.682971 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88daaa1b-853b-4c35-8df5-6e5f2442df94 None admin] RBAC: Adding query filter params (group.id=fd003810f62e4df6a40a9449d3b4e35f, role.id=a0449d430ec54adcabb96193af2f7cd5, scope.project.id=20cc73f001a245c680144a956b81a15e) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:50.683362 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88daaa1b-853b-4c35-8df5-6e5f2442df94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:50.688929 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88daaa1b-853b-4c35-8df5-6e5f2442df94 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:50.698946 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 189/377] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Aug 23 22:12:50 2022] GET /identity/v3/role_assignments?group.id=fd003810f62e4df6a40a9449d3b4e35f&scope.project.id=20cc73f001a245c680144a956b81a15e&role.id=a0449d430ec54adcabb96193af2f7cd5 => generated 260 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:50.798846 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:50.882888 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd931bb8-80d9-452a-941f-4fde7881d640 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:50.946791 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b072f-6952-4789-bcab-98658c30516b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:50.947385 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b072f-6952-4789-bcab-98658c30516b None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:50.947717 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b072f-6952-4789-bcab-98658c30516b None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:50.948045 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b072f-6952-4789-bcab-98658c30516b None admin] PATH_INFO: `/v3/projects/dad9b8e962404742bf84b26f82ffb671` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:50.950436 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b072f-6952-4789-bcab-98658c30516b None admin] RBAC: Authorizing `identity:get_project(project_id=dad9b8e962404742bf84b26f82ffb671)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:50.952467 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b072f-6952-4789-bcab-98658c30516b None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:50.955082 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 189/378] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:50 2022] GET /identity/v3/projects/dad9b8e962404742bf84b26f82ffb671 => generated 344 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:50.961464 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88daaa1b-853b-4c35-8df5-6e5f2442df94 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:51.185176 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88daaa1b-853b-4c35-8df5-6e5f2442df94 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:51.228102 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ee99f-c989-41f8-b1ed-cc72833524e1 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:51.228557 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ee99f-c989-41f8-b1ed-cc72833524e1 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:51.229066 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ee99f-c989-41f8-b1ed-cc72833524e1 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:51.233096 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 190/379] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:51.241923 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecab7ba-2463-4ad7-9383-1cf24ec917c4 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:51.242517 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecab7ba-2463-4ad7-9383-1cf24ec917c4 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:51.243091 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecab7ba-2463-4ad7-9383-1cf24ec917c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:51.293246 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c817b-ca65-402a-8bb8-4062d2f252dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:51.295131 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c817b-ca65-402a-8bb8-4062d2f252dc None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:51.295624 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c817b-ca65-402a-8bb8-4062d2f252dc None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:51.296104 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c817b-ca65-402a-8bb8-4062d2f252dc None admin] PATH_INFO: `/v3/groups/e3c9dec2e8824c56b3dec3791b9c4029` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:51.305499 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-4ecab7ba-2463-4ad7-9383-1cf24ec917c4 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:51.306842 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-4ecab7ba-2463-4ad7-9383-1cf24ec917c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:51.307359 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c817b-ca65-402a-8bb8-4062d2f252dc None admin] RBAC: Authorizing `identity:get_group(group_id=e3c9dec2e8824c56b3dec3791b9c4029)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:51.310802 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c817b-ca65-402a-8bb8-4062d2f252dc None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:51.315092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 190/380] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Aug 23 22:12:50 2022] GET /identity/v3/groups/e3c9dec2e8824c56b3dec3791b9c4029 => generated 229 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:51.324700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c817b-ca65-402a-8bb8-4062d2f252dc None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:51.365616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:51.467918 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 191/381] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:12:51.584817 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c817b-ca65-402a-8bb8-4062d2f252dc None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:51.677696 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baeee75-9e60-4100-8070-11428e51538b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:51.679792 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baeee75-9e60-4100-8070-11428e51538b None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:51.681012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baeee75-9e60-4100-8070-11428e51538b None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:51.682008 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baeee75-9e60-4100-8070-11428e51538b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:51.684436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baeee75-9e60-4100-8070-11428e51538b None admin] RBAC: Adding query filter params (group.id=e3c9dec2e8824c56b3dec3791b9c4029, role.id=e806ce849cf34b92979b5524f3ea9ff6, scope.project.id=dad9b8e962404742bf84b26f82ffb671) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:51.685611 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baeee75-9e60-4100-8070-11428e51538b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:51.689528 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baeee75-9e60-4100-8070-11428e51538b None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:51.703659 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 191/382] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Aug 23 22:12:51 2022] GET /identity/v3/role_assignments?group.id=e3c9dec2e8824c56b3dec3791b9c4029&scope.project.id=dad9b8e962404742bf84b26f82ffb671&role.id=e806ce849cf34b92979b5524f3ea9ff6 => generated 260 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:52.001203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da29162-f024-4698-8446-77bccd54b0a5 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:52.001612 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da29162-f024-4698-8446-77bccd54b0a5 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:52.001795 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da29162-f024-4698-8446-77bccd54b0a5 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:52.003522 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 192/383] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:12:52.009639 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c3a39-5985-4628-ae3a-68da734fac2b None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:52.009973 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c3a39-5985-4628-ae3a-68da734fac2b None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:52.010273 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c3a39-5985-4628-ae3a-68da734fac2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:52.032208 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da29162-f024-4698-8446-77bccd54b0a5 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:52.032942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-ea8c3a39-5985-4628-ae3a-68da734fac2b None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:52.034251 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-ea8c3a39-5985-4628-ae3a-68da734fac2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:52.175120 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:52.187815 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 192/384] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:12:52.252451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da29162-f024-4698-8446-77bccd54b0a5 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:52.301887 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85357e03-5e57-435b-ada9-5876d4eddd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:52.302577 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85357e03-5e57-435b-ada9-5876d4eddd6e None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:52.302863 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85357e03-5e57-435b-ada9-5876d4eddd6e None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:52.303143 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85357e03-5e57-435b-ada9-5876d4eddd6e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:52.323196 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85357e03-5e57-435b-ada9-5876d4eddd6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:52.328586 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-85357e03-5e57-435b-ada9-5876d4eddd6e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:12:52.328586 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:52.328586 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:52.328586 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:52.328586 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:52.328586 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:52.328586 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:52.328586 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:52.328586 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:52.328586 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:52.328586 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:52.328586 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:52.328586 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:52.328586 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:52.328586 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:52.328586 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:52.329611 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:52.329611 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:52.329611 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:52.329611 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:52.329611 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:52.329611 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:52.329611 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:52.329611 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:52.329611 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:52.329611 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:52.329611 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:52.329611 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:52.329611 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:52.329611 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:52.329611 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:52.329611 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:52.330429 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:52.330429 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:52.330429 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:52.330429 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:52.330429 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:52.330429 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:52.330429 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:52.330429 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:52.330429 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:52.330429 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:52.330429 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:12:52.330429 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:12:52.330429 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 193/385] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Aug 23 22:12:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:12:52.336728 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c3a39-5985-4628-ae3a-68da734fac2b None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:52.370074 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:52.501812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c3a39-5985-4628-ae3a-68da734fac2b None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:52.547445 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3dc5ca-6187-4afe-82d3-827a5e01bcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:52.548166 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3dc5ca-6187-4afe-82d3-827a5e01bcad None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:52.548454 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3dc5ca-6187-4afe-82d3-827a5e01bcad None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:52.548738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3dc5ca-6187-4afe-82d3-827a5e01bcad None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:52.549653 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3dc5ca-6187-4afe-82d3-827a5e01bcad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:52.550118 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3dc5ca-6187-4afe-82d3-827a5e01bcad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:52.552136 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3dc5ca-6187-4afe-82d3-827a5e01bcad None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:52.564489 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 193/386] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:12:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:52.571235 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85357e03-5e57-435b-ada9-5876d4eddd6e None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:52.580288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3dc5ca-6187-4afe-82d3-827a5e01bcad None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:52.730004 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:52.796216 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3dc5ca-6187-4afe-82d3-827a5e01bcad None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:52.876209 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85357e03-5e57-435b-ada9-5876d4eddd6e None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:52.903625 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8254220-710a-45aa-b263-162d08dfb1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:52.904740 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8254220-710a-45aa-b263-162d08dfb1ab None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:52.907448 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8254220-710a-45aa-b263-162d08dfb1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:52.908065 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8254220-710a-45aa-b263-162d08dfb1ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:52.932260 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:52.943844 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8254220-710a-45aa-b263-162d08dfb1ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:52.953225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-d8254220-710a-45aa-b263-162d08dfb1ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:52.953225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:52.953225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:52.953225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:52.953225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:52.953225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:52.953225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:52.953225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:52.953225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:52.953225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:52.953225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:52.953225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:52.953225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:52.953225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:52.953225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:52.953225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:52.955297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:52.955297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:52.955297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:52.955297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:52.955297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:52.955297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:52.955297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:52.955297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:52.955297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:52.955297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:52.955297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:52.955297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:52.955297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:52.955297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:52.955297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:52.955297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:52.957156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:52.957156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:52.957156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:52.957156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:52.957156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:52.957156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:52.957156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:52.957156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:52.957156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:52.957156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:52.957156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:52.957156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:12:52.969504 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 194/387] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:12:52.978813 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8254220-710a-45aa-b263-162d08dfb1ab None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:53.000509 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5d11f-3e5d-4f58-b74c-c2fa3c71b266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:53.001972 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5d11f-3e5d-4f58-b74c-c2fa3c71b266 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:53.002654 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5d11f-3e5d-4f58-b74c-c2fa3c71b266 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:53.003348 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5d11f-3e5d-4f58-b74c-c2fa3c71b266 None admin] PATH_INFO: `/v3/groups/fd003810f62e4df6a40a9449d3b4e35f` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:53.005585 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5d11f-3e5d-4f58-b74c-c2fa3c71b266 None admin] RBAC: Authorizing `identity:get_group(group_id=fd003810f62e4df6a40a9449d3b4e35f)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:53.008562 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5d11f-3e5d-4f58-b74c-c2fa3c71b266 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:53.021791 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 194/388] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Aug 23 22:12:52 2022] GET /identity/v3/groups/fd003810f62e4df6a40a9449d3b4e35f => generated 226 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:53.030839 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5d11f-3e5d-4f58-b74c-c2fa3c71b266 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:53.215299 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5d11f-3e5d-4f58-b74c-c2fa3c71b266 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:53.268785 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb1465-73f3-4159-90fb-f4d2157c700b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:53.269814 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb1465-73f3-4159-90fb-f4d2157c700b None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:53.270228 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb1465-73f3-4159-90fb-f4d2157c700b None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:53.270580 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb1465-73f3-4159-90fb-f4d2157c700b None admin] PATH_INFO: `/v3/projects/60a5733a3c634efca6df17f66d53c587` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:53.275942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cb1465-73f3-4159-90fb-f4d2157c700b None admin] RBAC: Authorizing `identity:get_project(project_id=60a5733a3c634efca6df17f66d53c587)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:53.277701 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cb1465-73f3-4159-90fb-f4d2157c700b None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:53.282288 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 195/389] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:53 2022] GET /identity/v3/projects/60a5733a3c634efca6df17f66d53c587 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:53.290535 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb1465-73f3-4159-90fb-f4d2157c700b None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:53.334994 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8254220-710a-45aa-b263-162d08dfb1ab None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:53.426901 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628dd0e-e947-4d30-9f75-6af0e7d18381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:53.427960 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628dd0e-e947-4d30-9f75-6af0e7d18381 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:53.428381 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628dd0e-e947-4d30-9f75-6af0e7d18381 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:53.428668 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628dd0e-e947-4d30-9f75-6af0e7d18381 None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:53.429469 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628dd0e-e947-4d30-9f75-6af0e7d18381 None admin] RBAC: Adding query filter params (name=member) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:53.429808 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628dd0e-e947-4d30-9f75-6af0e7d18381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:53.431235 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628dd0e-e947-4d30-9f75-6af0e7d18381 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:53.441039 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:53.453449 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:53.462252 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 195/390] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 484 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:53.467355 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628dd0e-e947-4d30-9f75-6af0e7d18381 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:53.530370 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb1465-73f3-4159-90fb-f4d2157c700b None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:53.580175 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7270b6-e6cc-43dd-9170-3b418dab7d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:53.580905 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7270b6-e6cc-43dd-9170-3b418dab7d56 None admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:53.581199 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7270b6-e6cc-43dd-9170-3b418dab7d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:53.581528 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7270b6-e6cc-43dd-9170-3b418dab7d56 None admin] PATH_INFO: `/v3/projects/60a5733a3c634efca6df17f66d53c587/groups/fd003810f62e4df6a40a9449d3b4e35f/roles/a0449d430ec54adcabb96193af2f7cd5` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:53.583806 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7270b6-e6cc-43dd-9170-3b418dab7d56 None admin] RBAC: Authorizing `identity:create_grant(project_id=60a5733a3c634efca6df17f66d53c587, group_id=fd003810f62e4df6a40a9449d3b4e35f, role_id=a0449d430ec54adcabb96193af2f7cd5)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:53.585284 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7270b6-e6cc-43dd-9170-3b418dab7d56 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:53.603717 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 196/391] 10.222.0.77 () {58 vars in 1442 bytes} [Tue Aug 23 22:12:53 2022] PUT /identity/v3/projects/60a5733a3c634efca6df17f66d53c587/groups/fd003810f62e4df6a40a9449d3b4e35f/roles/a0449d430ec54adcabb96193af2f7cd5 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:12:53.605315 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e430b1b-5fce-4851-b973-13852c8c01c9 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:53.605770 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e430b1b-5fce-4851-b973-13852c8c01c9 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:53.606777 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e430b1b-5fce-4851-b973-13852c8c01c9 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:53.613799 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 197/392] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:53.613799 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c44d3-9ab9-42c4-a728-ca7db2ab6f9f None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:53.613799 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c44d3-9ab9-42c4-a728-ca7db2ab6f9f None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:53.613799 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c44d3-9ab9-42c4-a728-ca7db2ab6f9f None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:53.616358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 198/393] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:53.627015 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d0ebf-674b-42d9-8129-178be314d72d None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:53.627474 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d0ebf-674b-42d9-8129-178be314d72d None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:53.627953 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d0ebf-674b-42d9-8129-178be314d72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:53.671478 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628dd0e-e947-4d30-9f75-6af0e7d18381 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:53.679506 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-bb3d0ebf-674b-42d9-8129-178be314d72d None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:53.682115 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-bb3d0ebf-674b-42d9-8129-178be314d72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:53.721399 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09877c11-7e72-40e0-bf1c-8c1912cce9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:53.722019 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09877c11-7e72-40e0-bf1c-8c1912cce9a1 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:53.722301 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09877c11-7e72-40e0-bf1c-8c1912cce9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:53.722579 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09877c11-7e72-40e0-bf1c-8c1912cce9a1 None admin] PATH_INFO: `/v3/groups/fd003810f62e4df6a40a9449d3b4e35f` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:53.723854 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09877c11-7e72-40e0-bf1c-8c1912cce9a1 None admin] RBAC: Authorizing `identity:get_group(group_id=fd003810f62e4df6a40a9449d3b4e35f)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:53.725434 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09877c11-7e72-40e0-bf1c-8c1912cce9a1 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:53.727693 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 196/394] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Aug 23 22:12:53 2022] GET /identity/v3/groups/fd003810f62e4df6a40a9449d3b4e35f => generated 226 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:53.729083 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408cd18-0281-4090-aff6-75fde505d903 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:53.729492 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408cd18-0281-4090-aff6-75fde505d903 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:53.729759 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408cd18-0281-4090-aff6-75fde505d903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:53.754741 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-d408cd18-0281-4090-aff6-75fde505d903 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:53.756803 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-d408cd18-0281-4090-aff6-75fde505d903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:53.834732 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 199/395] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:53.835690 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d0ebf-674b-42d9-8129-178be314d72d None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:53.900425 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:53.915263 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 197/396] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:53.950546 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:54.052736 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d0ebf-674b-42d9-8129-178be314d72d None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:54.104718 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f7408-44c0-4efc-855e-73e8d86b30ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:54.105529 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f7408-44c0-4efc-855e-73e8d86b30ed None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:54.105818 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f7408-44c0-4efc-855e-73e8d86b30ed None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:54.106662 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f7408-44c0-4efc-855e-73e8d86b30ed None admin] PATH_INFO: `/v3/projects/60a5733a3c634efca6df17f66d53c587` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:54.108437 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f7408-44c0-4efc-855e-73e8d86b30ed None admin] RBAC: Authorizing `identity:get_project(project_id=60a5733a3c634efca6df17f66d53c587)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:54.109992 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f7408-44c0-4efc-855e-73e8d86b30ed None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:54.112196 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 200/397] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:53 2022] GET /identity/v3/projects/60a5733a3c634efca6df17f66d53c587 => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:54.119841 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408cd18-0281-4090-aff6-75fde505d903 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:54.270035 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f7408-44c0-4efc-855e-73e8d86b30ed None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:54.337174 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408cd18-0281-4090-aff6-75fde505d903 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:54.430764 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb3820-0f1a-43c7-a8e9-4cb204433bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:54.431586 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb3820-0f1a-43c7-a8e9-4cb204433bd9 None admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:54.431790 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb3820-0f1a-43c7-a8e9-4cb204433bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:54.432069 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb3820-0f1a-43c7-a8e9-4cb204433bd9 None admin] PATH_INFO: `/v3/projects/60a5733a3c634efca6df17f66d53c587/groups/fd003810f62e4df6a40a9449d3b4e35f/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:54.438906 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb3820-0f1a-43c7-a8e9-4cb204433bd9 None admin] RBAC: Authorizing `identity:create_grant(project_id=60a5733a3c634efca6df17f66d53c587, group_id=fd003810f62e4df6a40a9449d3b4e35f, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:54.440396 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb3820-0f1a-43c7-a8e9-4cb204433bd9 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:54.478267 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 198/398] 10.222.0.77 () {58 vars in 1442 bytes} [Tue Aug 23 22:12:54 2022] PUT /identity/v3/projects/60a5733a3c634efca6df17f66d53c587/groups/fd003810f62e4df6a40a9449d3b4e35f/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:12:54.480517 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb3820-0f1a-43c7-a8e9-4cb204433bd9 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:54.495973 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f7408-44c0-4efc-855e-73e8d86b30ed None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:54.515382 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:54.553482 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653b4df-9025-4c70-b41e-0f0ebe0e8ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:54.555556 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653b4df-9025-4c70-b41e-0f0ebe0e8ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:54.555972 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653b4df-9025-4c70-b41e-0f0ebe0e8ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:54.557020 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653b4df-9025-4c70-b41e-0f0ebe0e8ac3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:54.584194 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653b4df-9025-4c70-b41e-0f0ebe0e8ac3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:54.594633 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-4653b4df-9025-4c70-b41e-0f0ebe0e8ac3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:12:54.594633 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:54.594633 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:54.594633 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:54.594633 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:54.594633 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:54.594633 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:54.594633 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:54.594633 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:54.594633 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:54.594633 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:54.594633 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:54.594633 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:54.594633 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:54.594633 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:54.594633 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:54.596100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:54.596100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:54.596100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:54.596100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:54.596100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:54.596100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:54.596100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:54.596100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:54.596100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:54.596100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:54.596100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:54.596100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:54.596100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:54.596100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:54.596100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:54.596100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:54.597573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:54.597573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:54.597573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:54.597573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:54.597573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:54.597573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:54.597573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:54.597573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:54.597573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:54.597573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:54.597573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:12:54.597573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:12:54.597573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 201/399] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Aug 23 22:12:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:12:54.599304 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febe97a-603f-4d13-ac6c-54fb69bc9b70 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:54.599723 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febe97a-603f-4d13-ac6c-54fb69bc9b70 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:54.600017 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febe97a-603f-4d13-ac6c-54fb69bc9b70 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:54.605549 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 202/400] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:54.607955 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8febe97a-603f-4d13-ac6c-54fb69bc9b70 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:54.612057 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:54.668172 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb3820-0f1a-43c7-a8e9-4cb204433bd9 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:54.718223 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d885f-d710-4dc3-8023-211b11d08fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:54.718965 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d885f-d710-4dc3-8023-211b11d08fbd None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:54.719250 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d885f-d710-4dc3-8023-211b11d08fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:54.719524 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d885f-d710-4dc3-8023-211b11d08fbd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:54.746257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d885f-d710-4dc3-8023-211b11d08fbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:54.754179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-e36d885f-d710-4dc3-8023-211b11d08fbd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:54.754179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:54.754179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:54.754179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:54.754179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:54.754179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:54.754179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:54.754179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:54.754179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:54.754179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:54.754179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:54.754179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:54.754179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:54.754179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:54.754179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:54.754179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:54.755163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:54.755163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:54.755163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:54.755163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:54.755163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:54.755163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:54.755163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:54.755163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:54.755163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:54.755163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:54.755163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:54.755163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:54.755163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:54.755163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:54.755163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:54.755163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:54.755975 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:54.755975 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:54.755975 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:54.755975 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:54.755975 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:54.755975 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:54.755975 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:54.755975 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:54.755975 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:54.755975 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:54.755975 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:54.755975 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:12:54.761410 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 199/401] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:54.761410 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee56f60-16a0-47da-abde-fc4c82a7ca39 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:54.761410 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee56f60-16a0-47da-abde-fc4c82a7ca39 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:54.761410 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee56f60-16a0-47da-abde-fc4c82a7ca39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:54.769558 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8febe97a-603f-4d13-ac6c-54fb69bc9b70 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:54.795210 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-3ee56f60-16a0-47da-abde-fc4c82a7ca39 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:54.797073 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-3ee56f60-16a0-47da-abde-fc4c82a7ca39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:54.820320 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6717b3a-4263-4f8d-83ea-fb19dc611134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:54.820987 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6717b3a-4263-4f8d-83ea-fb19dc611134 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:54.821662 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6717b3a-4263-4f8d-83ea-fb19dc611134 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:54.821943 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6717b3a-4263-4f8d-83ea-fb19dc611134 None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:54.823078 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6717b3a-4263-4f8d-83ea-fb19dc611134 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:54.823382 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6717b3a-4263-4f8d-83ea-fb19dc611134 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:54.824988 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6717b3a-4263-4f8d-83ea-fb19dc611134 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:54.844495 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 203/402] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:12:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:54.846226 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6717b3a-4263-4f8d-83ea-fb19dc611134 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:54.883159 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 200/403] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:54.884042 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee56f60-16a0-47da-abde-fc4c82a7ca39 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:54.900991 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:54.948786 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:55.012758 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee56f60-16a0-47da-abde-fc4c82a7ca39 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:55.014647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6717b3a-4263-4f8d-83ea-fb19dc611134 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:55.066837 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce31420-79cc-4cd5-b9b7-8edeb749a26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:55.067464 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce31420-79cc-4cd5-b9b7-8edeb749a26a None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:55.067743 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce31420-79cc-4cd5-b9b7-8edeb749a26a None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:55.068013 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce31420-79cc-4cd5-b9b7-8edeb749a26a None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:55.068685 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce31420-79cc-4cd5-b9b7-8edeb749a26a None admin] RBAC: Adding query filter params (name=member) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:55.068981 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce31420-79cc-4cd5-b9b7-8edeb749a26a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:55.070494 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595c32a-f7fe-436d-badc-19689d6e0ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:55.071135 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595c32a-f7fe-436d-badc-19689d6e0ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:55.071405 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595c32a-f7fe-436d-badc-19689d6e0ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:55.071670 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595c32a-f7fe-436d-badc-19689d6e0ee3 None admin] PATH_INFO: `/v3/groups/fd003810f62e4df6a40a9449d3b4e35f` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:55.072893 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595c32a-f7fe-436d-badc-19689d6e0ee3 None admin] RBAC: Authorizing `identity:get_group(group_id=fd003810f62e4df6a40a9449d3b4e35f)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:55.074407 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595c32a-f7fe-436d-badc-19689d6e0ee3 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:55.076011 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce31420-79cc-4cd5-b9b7-8edeb749a26a None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:55.084152 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 201/404] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Aug 23 22:12:54 2022] GET /identity/v3/groups/fd003810f62e4df6a40a9449d3b4e35f => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:55.087743 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 204/405] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:55.089573 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595c32a-f7fe-436d-badc-19689d6e0ee3 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:55.099036 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce31420-79cc-4cd5-b9b7-8edeb749a26a None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:55.215914 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:55.226459 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce31420-79cc-4cd5-b9b7-8edeb749a26a None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:55.274148 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f2fdb-6090-4fa4-ae96-2951dcbbafca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:55.274827 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f2fdb-6090-4fa4-ae96-2951dcbbafca None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:55.274940 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595c32a-f7fe-436d-badc-19689d6e0ee3 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:55.275112 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f2fdb-6090-4fa4-ae96-2951dcbbafca None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:55.275395 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f2fdb-6090-4fa4-ae96-2951dcbbafca None admin] PATH_INFO: `/v3/groups/fd003810f62e4df6a40a9449d3b4e35f` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:55.276544 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f2fdb-6090-4fa4-ae96-2951dcbbafca None admin] RBAC: Authorizing `identity:get_group(group_id=fd003810f62e4df6a40a9449d3b4e35f)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:55.280003 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f2fdb-6090-4fa4-ae96-2951dcbbafca None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:55.282026 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 205/406] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Aug 23 22:12:55 2022] GET /identity/v3/groups/fd003810f62e4df6a40a9449d3b4e35f => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:55.283258 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f2fdb-6090-4fa4-ae96-2951dcbbafca None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:55.291841 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:55.317206 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5786526-b2dc-4d60-885a-214eb05dbbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:55.318109 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5786526-b2dc-4d60-885a-214eb05dbbb0 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:55.318453 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5786526-b2dc-4d60-885a-214eb05dbbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:55.318797 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5786526-b2dc-4d60-885a-214eb05dbbb0 None admin] PATH_INFO: `/v3/projects/20cc73f001a245c680144a956b81a15e` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:55.320020 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5786526-b2dc-4d60-885a-214eb05dbbb0 None admin] RBAC: Authorizing `identity:get_project(project_id=20cc73f001a245c680144a956b81a15e)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:55.321722 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5786526-b2dc-4d60-885a-214eb05dbbb0 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:55.323830 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 202/407] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:55 2022] GET /identity/v3/projects/20cc73f001a245c680144a956b81a15e => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:55.324893 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5786526-b2dc-4d60-885a-214eb05dbbb0 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:55.417478 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f2fdb-6090-4fa4-ae96-2951dcbbafca None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:55.458796 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1b9fe-084d-4e1d-9c85-07942feab3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:55.459438 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1b9fe-084d-4e1d-9c85-07942feab3e4 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:55.459716 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1b9fe-084d-4e1d-9c85-07942feab3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:55.459986 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1b9fe-084d-4e1d-9c85-07942feab3e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:55.472919 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c1b9fe-084d-4e1d-9c85-07942feab3e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:55.476839 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5786526-b2dc-4d60-885a-214eb05dbbb0 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:55.478402 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-15c1b9fe-084d-4e1d-9c85-07942feab3e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:12:55.478402 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:55.478402 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:55.478402 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:55.478402 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:55.478402 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:55.478402 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:55.478402 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:55.478402 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:55.478402 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:55.478402 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:55.478402 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:55.478402 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:55.478402 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:55.478402 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:55.478402 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:55.480617 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:55.480617 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:55.480617 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:55.480617 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:55.480617 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:55.480617 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:55.480617 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:55.480617 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:55.480617 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:55.480617 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:55.480617 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:55.480617 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:55.480617 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:55.480617 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:55.480617 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:55.480617 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:55.482823 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:55.482823 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:55.482823 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:55.482823 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:55.482823 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:55.482823 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:55.482823 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:55.482823 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:55.482823 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:55.482823 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:55.482823 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:12:55.482823 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:12:55.482823 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 206/408] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:12:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:55.482823 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1b9fe-084d-4e1d-9c85-07942feab3e4 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:55.518681 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786f6be-2f1d-4e52-be4a-f4ddfea17f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:55.519460 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786f6be-2f1d-4e52-be4a-f4ddfea17f6a None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:55.519744 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786f6be-2f1d-4e52-be4a-f4ddfea17f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:55.520018 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786f6be-2f1d-4e52-be4a-f4ddfea17f6a None admin] PATH_INFO: `/v3/projects/20cc73f001a245c680144a956b81a15e` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:55.521157 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786f6be-2f1d-4e52-be4a-f4ddfea17f6a None admin] RBAC: Authorizing `identity:get_project(project_id=20cc73f001a245c680144a956b81a15e)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:55.522897 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786f6be-2f1d-4e52-be4a-f4ddfea17f6a None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:55.525307 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 203/409] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:55 2022] GET /identity/v3/projects/20cc73f001a245c680144a956b81a15e => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:55.526120 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786f6be-2f1d-4e52-be4a-f4ddfea17f6a None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:55.539290 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:55.603242 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:55.659515 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1b9fe-084d-4e1d-9c85-07942feab3e4 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:55.683778 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786f6be-2f1d-4e52-be4a-f4ddfea17f6a None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:55.705296 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21779434-16d6-4da6-a1b6-ca2634295fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:55.707143 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21779434-16d6-4da6-a1b6-ca2634295fd9 None admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:55.707719 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21779434-16d6-4da6-a1b6-ca2634295fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:55.708204 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21779434-16d6-4da6-a1b6-ca2634295fd9 None admin] PATH_INFO: `/v3/projects/20cc73f001a245c680144a956b81a15e/groups/fd003810f62e4df6a40a9449d3b4e35f/roles/a0449d430ec54adcabb96193af2f7cd5` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:55.711800 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21779434-16d6-4da6-a1b6-ca2634295fd9 None admin] RBAC: Authorizing `identity:create_grant(project_id=20cc73f001a245c680144a956b81a15e, group_id=fd003810f62e4df6a40a9449d3b4e35f, role_id=a0449d430ec54adcabb96193af2f7cd5)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:55.714307 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21779434-16d6-4da6-a1b6-ca2634295fd9 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:55.732794 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f0e2d-6e1a-47a5-a8d7-5073f1173938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:55.733483 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f0e2d-6e1a-47a5-a8d7-5073f1173938 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:55.733816 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f0e2d-6e1a-47a5-a8d7-5073f1173938 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:55.734177 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f0e2d-6e1a-47a5-a8d7-5073f1173938 None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:55.734955 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f0e2d-6e1a-47a5-a8d7-5073f1173938 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:55.735299 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f0e2d-6e1a-47a5-a8d7-5073f1173938 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:55.735746 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 207/410] 10.222.0.77 () {58 vars in 1442 bytes} [Tue Aug 23 22:12:55 2022] PUT /identity/v3/projects/20cc73f001a245c680144a956b81a15e/groups/fd003810f62e4df6a40a9449d3b4e35f/roles/a0449d430ec54adcabb96193af2f7cd5 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:12:55.736734 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f0e2d-6e1a-47a5-a8d7-5073f1173938 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:55.737299 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21779434-16d6-4da6-a1b6-ca2634295fd9 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:55.750103 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 204/411] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:55.756701 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f0e2d-6e1a-47a5-a8d7-5073f1173938 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:55.845262 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:55.872482 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21779434-16d6-4da6-a1b6-ca2634295fd9 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:55.904225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f0e2d-6e1a-47a5-a8d7-5073f1173938 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:55.920549 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:55.921474 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49be5f-5d3a-4f20-84e4-b61e4f531f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:55.922251 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49be5f-5d3a-4f20-84e4-b61e4f531f03 None admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:55.922694 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49be5f-5d3a-4f20-84e4-b61e4f531f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:55.923094 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49be5f-5d3a-4f20-84e4-b61e4f531f03 None admin] PATH_INFO: `/v3/projects/20cc73f001a245c680144a956b81a15e/groups/fd003810f62e4df6a40a9449d3b4e35f/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:55.926274 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f49be5f-5d3a-4f20-84e4-b61e4f531f03 None admin] RBAC: Authorizing `identity:create_grant(project_id=20cc73f001a245c680144a956b81a15e, group_id=fd003810f62e4df6a40a9449d3b4e35f, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:55.935346 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f49be5f-5d3a-4f20-84e4-b61e4f531f03 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:55.957400 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d396f87-37fa-40b3-a254-b660f625ec55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:55.957400 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d396f87-37fa-40b3-a254-b660f625ec55 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:55.957400 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d396f87-37fa-40b3-a254-b660f625ec55 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:55.957400 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d396f87-37fa-40b3-a254-b660f625ec55 None admin] PATH_INFO: `/v3/groups/e3c9dec2e8824c56b3dec3791b9c4029` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:55.961407 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d396f87-37fa-40b3-a254-b660f625ec55 None admin] RBAC: Authorizing `identity:get_group(group_id=e3c9dec2e8824c56b3dec3791b9c4029)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:55.961407 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d396f87-37fa-40b3-a254-b660f625ec55 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:55.961626 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 208/412] 10.222.0.77 () {58 vars in 1442 bytes} [Tue Aug 23 22:12:55 2022] PUT /identity/v3/projects/20cc73f001a245c680144a956b81a15e/groups/fd003810f62e4df6a40a9449d3b4e35f/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:12:55.965441 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 205/413] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Aug 23 22:12:55 2022] GET /identity/v3/groups/e3c9dec2e8824c56b3dec3791b9c4029 => generated 229 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:55.969320 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49be5f-5d3a-4f20-84e4-b61e4f531f03 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:56.119740 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08551ff9-1fa4-4c0c-baaa-8389b6578fbc None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:56.120357 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08551ff9-1fa4-4c0c-baaa-8389b6578fbc None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:56.120794 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08551ff9-1fa4-4c0c-baaa-8389b6578fbc None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:56.122530 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 206/414] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:56.129208 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3848b0-823a-451d-a9ce-c94210aa40a5 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:56.129815 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3848b0-823a-451d-a9ce-c94210aa40a5 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:56.130302 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3848b0-823a-451d-a9ce-c94210aa40a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:56.176251 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-cc3848b0-823a-451d-a9ce-c94210aa40a5 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:56.181832 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-cc3848b0-823a-451d-a9ce-c94210aa40a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:56.241140 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49be5f-5d3a-4f20-84e4-b61e4f531f03 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:56.308696 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 207/415] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:56.350026 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc0853-57fe-48ae-83c3-3798f9f1057d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:56.350732 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc0853-57fe-48ae-83c3-3798f9f1057d None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:56.351017 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc0853-57fe-48ae-83c3-3798f9f1057d None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:56.351295 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc0853-57fe-48ae-83c3-3798f9f1057d None admin] PATH_INFO: `/v3/projects/dad9b8e962404742bf84b26f82ffb671` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:56.354795 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc0853-57fe-48ae-83c3-3798f9f1057d None admin] RBAC: Authorizing `identity:get_project(project_id=dad9b8e962404742bf84b26f82ffb671)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:56.358736 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc0853-57fe-48ae-83c3-3798f9f1057d None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:56.366631 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 209/416] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:55 2022] GET /identity/v3/projects/dad9b8e962404742bf84b26f82ffb671 => generated 344 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:56.372625 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3848b0-823a-451d-a9ce-c94210aa40a5 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:56.624518 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3848b0-823a-451d-a9ce-c94210aa40a5 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:56.648404 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:56.692068 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03e922-7f20-42ef-8443-44368f6b2399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:56.693051 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03e922-7f20-42ef-8443-44368f6b2399 None admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:56.693537 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03e922-7f20-42ef-8443-44368f6b2399 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:56.694022 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03e922-7f20-42ef-8443-44368f6b2399 None admin] PATH_INFO: `/v3/projects/dad9b8e962404742bf84b26f82ffb671/groups/e3c9dec2e8824c56b3dec3791b9c4029/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:56.696258 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03e922-7f20-42ef-8443-44368f6b2399 None admin] RBAC: Authorizing `identity:create_grant(project_id=dad9b8e962404742bf84b26f82ffb671, group_id=e3c9dec2e8824c56b3dec3791b9c4029, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:56.697978 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03e922-7f20-42ef-8443-44368f6b2399 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:56.723755 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 208/417] 10.222.0.77 () {58 vars in 1442 bytes} [Tue Aug 23 22:12:56 2022] PUT /identity/v3/projects/dad9b8e962404742bf84b26f82ffb671/groups/e3c9dec2e8824c56b3dec3791b9c4029/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:12:56.861081 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc0853-57fe-48ae-83c3-3798f9f1057d None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:56.879364 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:57.033599 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc0853-57fe-48ae-83c3-3798f9f1057d None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:57.100994 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d482239-27bb-47e2-bc17-3cfbaa03ef42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:57.102130 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d482239-27bb-47e2-bc17-3cfbaa03ef42 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:57.102646 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d482239-27bb-47e2-bc17-3cfbaa03ef42 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:57.103152 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d482239-27bb-47e2-bc17-3cfbaa03ef42 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:57.120487 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d482239-27bb-47e2-bc17-3cfbaa03ef42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:57.126006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-5d482239-27bb-47e2-bc17-3cfbaa03ef42 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:12:57.126006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:57.126006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:57.126006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:57.126006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:57.126006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:57.126006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:57.126006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:57.126006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:57.126006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:57.126006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:57.126006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:57.126006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:57.126006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:57.126006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:57.126006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:57.126965 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:57.126965 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:57.126965 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:57.126965 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:57.126965 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:57.126965 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:57.126965 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:57.126965 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:57.126965 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:57.126965 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:57.126965 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:57.126965 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:57.126965 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:57.126965 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:57.126965 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:57.126965 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:57.127750 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:57.127750 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:57.127750 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:57.127750 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:57.127750 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:57.127750 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:57.127750 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:57.127750 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:57.127750 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:57.127750 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:57.127750 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:12:57.127750 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:12:57.131893 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 210/418] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Aug 23 22:12:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:57.133683 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03e922-7f20-42ef-8443-44368f6b2399 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:57.156352 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2109ca-81e6-4430-b338-fa1787fa85b4 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:57.156704 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2109ca-81e6-4430-b338-fa1787fa85b4 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:57.156944 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2109ca-81e6-4430-b338-fa1787fa85b4 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:57.158650 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 211/419] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:57.164823 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b71059-8dbb-496b-8758-850bc77e93bc None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:57.164823 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b71059-8dbb-496b-8758-850bc77e93bc None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:57.165422 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b71059-8dbb-496b-8758-850bc77e93bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:57.185198 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-e3b71059-8dbb-496b-8758-850bc77e93bc None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:57.186494 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-e3b71059-8dbb-496b-8758-850bc77e93bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:57.267445 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 212/420] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:12:57.341502 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03e922-7f20-42ef-8443-44368f6b2399 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:57.395471 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356f5a8-be3e-45d9-99f2-23045fae2286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:57.396486 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356f5a8-be3e-45d9-99f2-23045fae2286 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:57.397007 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356f5a8-be3e-45d9-99f2-23045fae2286 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:57.397533 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356f5a8-be3e-45d9-99f2-23045fae2286 None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:57.398501 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356f5a8-be3e-45d9-99f2-23045fae2286 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:57.399028 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356f5a8-be3e-45d9-99f2-23045fae2286 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:57.400703 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356f5a8-be3e-45d9-99f2-23045fae2286 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:57.416402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 209/421] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:12:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:57.422427 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b71059-8dbb-496b-8758-850bc77e93bc None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:57.425152 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:57.565569 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b71059-8dbb-496b-8758-850bc77e93bc None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:57.607138 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e979b-88a8-484a-93f7-8b254896e888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:57.607776 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e979b-88a8-484a-93f7-8b254896e888 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:57.608067 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e979b-88a8-484a-93f7-8b254896e888 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:57.608341 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e979b-88a8-484a-93f7-8b254896e888 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:57.674874 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356f5a8-be3e-45d9-99f2-23045fae2286 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:57.683490 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e979b-88a8-484a-93f7-8b254896e888 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:57.684742 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e979b-88a8-484a-93f7-8b254896e888 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:57.686818 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:57.742499 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:57.816592 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 213/422] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:57.819308 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e979b-88a8-484a-93f7-8b254896e888 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:57.933803 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e979b-88a8-484a-93f7-8b254896e888 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:57.940272 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:57.977405 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527f347-3ce0-4d9a-9dbe-01538313b7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:57.978329 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527f347-3ce0-4d9a-9dbe-01538313b7f8 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:57.978768 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527f347-3ce0-4d9a-9dbe-01538313b7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:57.979201 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527f347-3ce0-4d9a-9dbe-01538313b7f8 None admin] PATH_INFO: `/v3/projects/60a5733a3c634efca6df17f66d53c587` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:57.980542 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527f347-3ce0-4d9a-9dbe-01538313b7f8 None admin] RBAC: Authorizing `identity:get_project(project_id=60a5733a3c634efca6df17f66d53c587)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:57.982227 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527f347-3ce0-4d9a-9dbe-01538313b7f8 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:57.988838 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 214/423] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:57 2022] GET /identity/v3/projects/60a5733a3c634efca6df17f66d53c587 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:57.990479 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527f347-3ce0-4d9a-9dbe-01538313b7f8 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:58.023484 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356f5a8-be3e-45d9-99f2-23045fae2286 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:58.123563 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527f347-3ce0-4d9a-9dbe-01538313b7f8 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:58.165589 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449f0ff-1c77-402b-a727-9bb3308199ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:58.166561 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449f0ff-1c77-402b-a727-9bb3308199ba None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:58.167177 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449f0ff-1c77-402b-a727-9bb3308199ba None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:58.167609 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449f0ff-1c77-402b-a727-9bb3308199ba None admin] PATH_INFO: `/v3/groups/fd003810f62e4df6a40a9449d3b4e35f` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:58.168258 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad6411-53c7-4e42-98b5-4fda127d3183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:58.169539 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad6411-53c7-4e42-98b5-4fda127d3183 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:58.169825 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad6411-53c7-4e42-98b5-4fda127d3183 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:58.170152 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad6411-53c7-4e42-98b5-4fda127d3183 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:58.170312 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449f0ff-1c77-402b-a727-9bb3308199ba None admin] RBAC: Authorizing `identity:get_group(group_id=fd003810f62e4df6a40a9449d3b4e35f)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:58.172156 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449f0ff-1c77-402b-a727-9bb3308199ba None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:58.179368 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 215/424] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Aug 23 22:12:57 2022] GET /identity/v3/groups/fd003810f62e4df6a40a9449d3b4e35f => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:58.181236 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449f0ff-1c77-402b-a727-9bb3308199ba None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:58.219817 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad6411-53c7-4e42-98b5-4fda127d3183 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:58.233183 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-d2ad6411-53c7-4e42-98b5-4fda127d3183 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:58.233183 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:58.233183 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:58.233183 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:58.233183 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:58.233183 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:58.233183 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:58.233183 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:58.233183 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:58.233183 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:58.233183 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:58.233183 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:58.233183 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:58.233183 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:58.233183 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:58.233183 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:58.234200 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:58.234200 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:58.234200 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:58.234200 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:58.234200 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:58.234200 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:58.234200 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:58.234200 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:58.234200 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:58.234200 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:58.234200 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:58.234200 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:58.234200 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:58.234200 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:58.234200 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:58.234200 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:58.235242 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:58.235242 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:58.235242 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:58.235242 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:58.235242 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:58.235242 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:58.235242 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:58.235242 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:58.235242 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:58.235242 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:58.235242 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:58.235242 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:12:58.235242 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 210/425] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 560 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:12:58.240387 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:58.246514 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad6411-53c7-4e42-98b5-4fda127d3183 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:58.312665 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449f0ff-1c77-402b-a727-9bb3308199ba None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:58.353447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216dd4f6-7bf7-4e18-81e5-bcb878cc29d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:58.354436 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216dd4f6-7bf7-4e18-81e5-bcb878cc29d9 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:58.354861 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216dd4f6-7bf7-4e18-81e5-bcb878cc29d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:58.355278 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216dd4f6-7bf7-4e18-81e5-bcb878cc29d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:58.356827 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216dd4f6-7bf7-4e18-81e5-bcb878cc29d9 None admin] RBAC: Adding query filter params (group.id=fd003810f62e4df6a40a9449d3b4e35f, role.id=a0449d430ec54adcabb96193af2f7cd5, scope.project.id=60a5733a3c634efca6df17f66d53c587) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:58.357303 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216dd4f6-7bf7-4e18-81e5-bcb878cc29d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:58.359142 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216dd4f6-7bf7-4e18-81e5-bcb878cc29d9 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:58.373622 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 216/426] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Aug 23 22:12:58 2022] GET /identity/v3/role_assignments?group.id=fd003810f62e4df6a40a9449d3b4e35f&scope.project.id=60a5733a3c634efca6df17f66d53c587&role.id=a0449d430ec54adcabb96193af2f7cd5 => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:58.489041 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b1413-5d5b-4145-b361-a54a2d2045f3 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:58.489607 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b1413-5d5b-4145-b361-a54a2d2045f3 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:58.490032 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b1413-5d5b-4145-b361-a54a2d2045f3 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:58.491698 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 217/427] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:12:58.501720 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767b365-e4be-4108-8c4a-f503fb29bf4e None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:58.502592 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:58.502824 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767b365-e4be-4108-8c4a-f503fb29bf4e None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:58.503310 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767b365-e4be-4108-8c4a-f503fb29bf4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:58.516565 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad6411-53c7-4e42-98b5-4fda127d3183 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:58.544041 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-b767b365-e4be-4108-8c4a-f503fb29bf4e None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:58.545320 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-b767b365-e4be-4108-8c4a-f503fb29bf4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:58.578156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a13ff6-1b06-467d-9752-a3d4b6e64185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:58.579291 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a13ff6-1b06-467d-9752-a3d4b6e64185 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:58.579605 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a13ff6-1b06-467d-9752-a3d4b6e64185 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:58.579849 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a13ff6-1b06-467d-9752-a3d4b6e64185 None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:58.580511 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a13ff6-1b06-467d-9752-a3d4b6e64185 None admin] RBAC: Adding query filter params (name=member) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:58.580852 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a13ff6-1b06-467d-9752-a3d4b6e64185 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:58.582279 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a13ff6-1b06-467d-9752-a3d4b6e64185 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:58.594735 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 211/428] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:58.609565 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a13ff6-1b06-467d-9752-a3d4b6e64185 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:58.700026 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 218/429] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:58.702342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548cbe2-331e-4d20-bab5-817346b4749e None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:58.702685 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548cbe2-331e-4d20-bab5-817346b4749e None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:58.702923 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548cbe2-331e-4d20-bab5-817346b4749e None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:58.704530 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 219/430] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:58.711364 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31facd00-186f-42f8-8e2b-92fcb14f182b None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:58.711540 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31facd00-186f-42f8-8e2b-92fcb14f182b None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:58.711787 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31facd00-186f-42f8-8e2b-92fcb14f182b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:58.740612 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-31facd00-186f-42f8-8e2b-92fcb14f182b None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:58.741826 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-31facd00-186f-42f8-8e2b-92fcb14f182b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:58.764643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a13ff6-1b06-467d-9752-a3d4b6e64185 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:58.784083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:58.807568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831bb98-cdbb-4422-859a-17f4debfe3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:58.808556 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831bb98-cdbb-4422-859a-17f4debfe3a2 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:58.809986 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831bb98-cdbb-4422-859a-17f4debfe3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:58.810505 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831bb98-cdbb-4422-859a-17f4debfe3a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:58.839767 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:58.851511 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 220/431] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:58.936833 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831bb98-cdbb-4422-859a-17f4debfe3a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:58.940395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831bb98-cdbb-4422-859a-17f4debfe3a2 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:59.124045 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31facd00-186f-42f8-8e2b-92fcb14f182b None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:59.144100 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 212/432] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 22:12:59.145446 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831bb98-cdbb-4422-859a-17f4debfe3a2 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:59.223830 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:59.264208 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31facd00-186f-42f8-8e2b-92fcb14f182b None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:59.284789 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831bb98-cdbb-4422-859a-17f4debfe3a2 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:59.307750 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6eadc8-073c-426b-973d-bd241e941920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:59.308296 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6eadc8-073c-426b-973d-bd241e941920 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:59.308584 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6eadc8-073c-426b-973d-bd241e941920 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:59.308882 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6eadc8-073c-426b-973d-bd241e941920 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:59.321545 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6eadc8-073c-426b-973d-bd241e941920 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:59.326448 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-fb6eadc8-073c-426b-973d-bd241e941920 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:59.326448 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:59.326448 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:59.326448 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:59.326448 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:59.326448 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:59.326448 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:59.326448 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:59.326448 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:59.326448 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:59.326448 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:59.326448 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:59.326448 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:59.326448 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:59.326448 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:59.326448 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:59.327372 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:59.327372 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:59.327372 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:59.327372 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:59.327372 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:59.327372 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:59.327372 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:59.327372 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:59.327372 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:59.327372 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:59.327372 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:59.327372 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:59.327372 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:59.327372 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:59.327372 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:59.327372 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:59.330162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:59.330162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:59.330162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:59.330162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:59.330162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:59.330162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:59.330162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:59.330162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:59.330162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:59.330162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:59.330162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:59.330162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:12:59.330162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 221/433] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:59.331702 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7686d4e-db46-4287-a943-37b423b5c8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:59.331795 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6eadc8-073c-426b-973d-bd241e941920 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:59.331862 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7686d4e-db46-4287-a943-37b423b5c8cc None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:59.331862 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7686d4e-db46-4287-a943-37b423b5c8cc None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:59.331862 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7686d4e-db46-4287-a943-37b423b5c8cc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:59.344852 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7686d4e-db46-4287-a943-37b423b5c8cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:59.350367 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-a7686d4e-db46-4287-a943-37b423b5c8cc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:12:59.350367 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:59.350367 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:59.350367 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:59.350367 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:59.350367 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:59.350367 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:59.350367 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:59.350367 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:59.350367 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:59.350367 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:59.350367 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:59.350367 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:59.350367 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:59.350367 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:59.350367 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:59.351308 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:59.351308 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:59.351308 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:59.351308 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:59.351308 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:59.351308 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:59.351308 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:59.351308 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:59.351308 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:59.351308 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:59.351308 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:59.351308 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:59.351308 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:59.351308 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:59.351308 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:59.351308 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:59.352376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:59.352376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:59.352376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:59.352376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:59.352376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:59.352376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:59.352376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:59.352376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:59.352376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:59.352376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:59.352376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:12:59.352376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:12:59.352376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 213/434] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Aug 23 22:12:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:59.354167 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7686d4e-db46-4287-a943-37b423b5c8cc None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:59.369942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:59.488163 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6eadc8-073c-426b-973d-bd241e941920 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:59.504920 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7686d4e-db46-4287-a943-37b423b5c8cc None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:59.524255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:59.542551 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483786c8-2998-471b-94f5-d968c307ce5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:59.543201 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483786c8-2998-471b-94f5-d968c307ce5e None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:59.544001 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483786c8-2998-471b-94f5-d968c307ce5e None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:59.544275 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483786c8-2998-471b-94f5-d968c307ce5e None admin] PATH_INFO: `/v3/projects/60a5733a3c634efca6df17f66d53c587` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:59.545720 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483786c8-2998-471b-94f5-d968c307ce5e None admin] RBAC: Authorizing `identity:get_project(project_id=60a5733a3c634efca6df17f66d53c587)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:59.547772 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483786c8-2998-471b-94f5-d968c307ce5e None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:59.549305 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 222/435] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:59 2022] GET /identity/v3/projects/60a5733a3c634efca6df17f66d53c587 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:59.554818 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483786c8-2998-471b-94f5-d968c307ce5e None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:59.566573 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907efd5-4933-4c8f-9a86-425aeb797725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:59.567495 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907efd5-4933-4c8f-9a86-425aeb797725 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:59.567918 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907efd5-4933-4c8f-9a86-425aeb797725 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:59.568313 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907efd5-4933-4c8f-9a86-425aeb797725 None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:59.569064 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d907efd5-4933-4c8f-9a86-425aeb797725 None admin] RBAC: Adding query filter params (name=member) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:59.569488 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d907efd5-4933-4c8f-9a86-425aeb797725 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:59.571206 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d907efd5-4933-4c8f-9a86-425aeb797725 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:59.583610 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 214/436] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:59.584623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907efd5-4933-4c8f-9a86-425aeb797725 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:59.684684 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:59.697187 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483786c8-2998-471b-94f5-d968c307ce5e None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:59.724704 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907efd5-4933-4c8f-9a86-425aeb797725 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:59.751637 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17796c96-d68f-47dd-a81f-6f978cc145fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:59.752244 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17796c96-d68f-47dd-a81f-6f978cc145fa None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:59.752567 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17796c96-d68f-47dd-a81f-6f978cc145fa None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:59.752787 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17796c96-d68f-47dd-a81f-6f978cc145fa None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:59.753677 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17796c96-d68f-47dd-a81f-6f978cc145fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:59.753809 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17796c96-d68f-47dd-a81f-6f978cc145fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:59.755151 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17796c96-d68f-47dd-a81f-6f978cc145fa None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:59.763739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 223/437] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:12:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:59.764576 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17796c96-d68f-47dd-a81f-6f978cc145fa None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:59.771163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9f76d-b47b-404f-8815-f7643e3ec4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:59.771827 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9f76d-b47b-404f-8815-f7643e3ec4e4 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:59.772106 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9f76d-b47b-404f-8815-f7643e3ec4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:59.772385 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9f76d-b47b-404f-8815-f7643e3ec4e4 None admin] PATH_INFO: `/v3/groups/fd003810f62e4df6a40a9449d3b4e35f` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:59.773796 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9f76d-b47b-404f-8815-f7643e3ec4e4 None admin] RBAC: Authorizing `identity:get_group(group_id=fd003810f62e4df6a40a9449d3b4e35f)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:59.776138 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9f76d-b47b-404f-8815-f7643e3ec4e4 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:59.778855 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 215/438] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Aug 23 22:12:59 2022] GET /identity/v3/groups/fd003810f62e4df6a40a9449d3b4e35f => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:59.780162 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830fa61-6873-4a55-b48b-3d33bb25cf67 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:59.780456 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830fa61-6873-4a55-b48b-3d33bb25cf67 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:59.780733 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830fa61-6873-4a55-b48b-3d33bb25cf67 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:59.782028 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 216/439] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:59.782750 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830fa61-6873-4a55-b48b-3d33bb25cf67 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:59.839784 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:59.882368 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17796c96-d68f-47dd-a81f-6f978cc145fa None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:59.911686 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830fa61-6873-4a55-b48b-3d33bb25cf67 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:59.919261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c7988-eaed-4b69-a01f-5cc59177c927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:59.919997 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c7988-eaed-4b69-a01f-5cc59177c927 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:59.920286 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c7988-eaed-4b69-a01f-5cc59177c927 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:59.920557 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c7988-eaed-4b69-a01f-5cc59177c927 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:59.951063 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:59.960335 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf279f-79fb-4874-a5ca-e21833b1b15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:59.960962 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf279f-79fb-4874-a5ca-e21833b1b15b None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:59.961240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf279f-79fb-4874-a5ca-e21833b1b15b None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:59.961538 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf279f-79fb-4874-a5ca-e21833b1b15b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:00.010122 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c7988-eaed-4b69-a01f-5cc59177c927 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:00.011508 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c7988-eaed-4b69-a01f-5cc59177c927 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:00.040700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf279f-79fb-4874-a5ca-e21833b1b15b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:00.042198 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf279f-79fb-4874-a5ca-e21833b1b15b None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:00.095907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:00.135135 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 224/440] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:13:00.135926 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c7988-eaed-4b69-a01f-5cc59177c927 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:00.163424 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 217/441] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:13:00.164690 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98567bd-35b2-4734-abe6-62bfe3bc9877 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:00.166217 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98567bd-35b2-4734-abe6-62bfe3bc9877 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:00.166217 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98567bd-35b2-4734-abe6-62bfe3bc9877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:00.186666 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-a98567bd-35b2-4734-abe6-62bfe3bc9877 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:00.189226 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-a98567bd-35b2-4734-abe6-62bfe3bc9877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:00.201255 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:00.253846 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c7988-eaed-4b69-a01f-5cc59177c927 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:00.275813 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 218/442] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:13:00.276580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98567bd-35b2-4734-abe6-62bfe3bc9877 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:00.302330 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc044c-9fc4-477e-ab59-82bc6b601297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:00.303075 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc044c-9fc4-477e-ab59-82bc6b601297 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:00.303419 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc044c-9fc4-477e-ab59-82bc6b601297 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:00.303694 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc044c-9fc4-477e-ab59-82bc6b601297 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:00.304423 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc044c-9fc4-477e-ab59-82bc6b601297 None admin] RBAC: Adding query filter params (group.id=fd003810f62e4df6a40a9449d3b4e35f, role.id=eabf42a0387a47218c5ce577dd65f61c, scope.project.id=60a5733a3c634efca6df17f66d53c587) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:00.304725 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc044c-9fc4-477e-ab59-82bc6b601297 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:00.306572 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc044c-9fc4-477e-ab59-82bc6b601297 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:00.317457 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 225/443] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Aug 23 22:13:00 2022] GET /identity/v3/role_assignments?group.id=fd003810f62e4df6a40a9449d3b4e35f&scope.project.id=60a5733a3c634efca6df17f66d53c587&role.id=eabf42a0387a47218c5ce577dd65f61c => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:00.317457 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc044c-9fc4-477e-ab59-82bc6b601297 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:00.400312 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:00.452698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98567bd-35b2-4734-abe6-62bfe3bc9877 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:00.486719 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc044c-9fc4-477e-ab59-82bc6b601297 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:00.499623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff97e9d-2f85-4042-88f7-eb9a45c51258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:00.501139 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff97e9d-2f85-4042-88f7-eb9a45c51258 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:00.501937 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff97e9d-2f85-4042-88f7-eb9a45c51258 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:00.502612 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff97e9d-2f85-4042-88f7-eb9a45c51258 None admin] PATH_INFO: `/v3/projects/20cc73f001a245c680144a956b81a15e` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:00.504951 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff97e9d-2f85-4042-88f7-eb9a45c51258 None admin] RBAC: Authorizing `identity:get_project(project_id=20cc73f001a245c680144a956b81a15e)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:00.509121 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff97e9d-2f85-4042-88f7-eb9a45c51258 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:00.513266 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:00.513968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 219/444] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:13:00 2022] GET /identity/v3/projects/20cc73f001a245c680144a956b81a15e => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:00.518206 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff97e9d-2f85-4042-88f7-eb9a45c51258 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:00.539530 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab72a5-4c2f-4b45-a82a-780b2536ca7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:00.540799 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab72a5-4c2f-4b45-a82a-780b2536ca7a None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:00.541289 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab72a5-4c2f-4b45-a82a-780b2536ca7a None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:00.541821 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab72a5-4c2f-4b45-a82a-780b2536ca7a None admin] PATH_INFO: `/v3/projects/20cc73f001a245c680144a956b81a15e` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:00.543249 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab72a5-4c2f-4b45-a82a-780b2536ca7a None admin] RBAC: Authorizing `identity:get_project(project_id=20cc73f001a245c680144a956b81a15e)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:00.546711 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab72a5-4c2f-4b45-a82a-780b2536ca7a None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:00.548378 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 226/445] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:13:00 2022] GET /identity/v3/projects/20cc73f001a245c680144a956b81a15e => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:00.554628 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab72a5-4c2f-4b45-a82a-780b2536ca7a None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:00.672930 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff97e9d-2f85-4042-88f7-eb9a45c51258 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:00.707872 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab72a5-4c2f-4b45-a82a-780b2536ca7a None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:00.718992 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39864c8-8094-47c0-94a8-f8d96e1edfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:00.719866 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39864c8-8094-47c0-94a8-f8d96e1edfed None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:00.720303 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39864c8-8094-47c0-94a8-f8d96e1edfed None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:00.720589 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39864c8-8094-47c0-94a8-f8d96e1edfed None admin] PATH_INFO: `/v3/groups/fd003810f62e4df6a40a9449d3b4e35f` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:00.722531 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39864c8-8094-47c0-94a8-f8d96e1edfed None admin] RBAC: Authorizing `identity:get_group(group_id=fd003810f62e4df6a40a9449d3b4e35f)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:00.723342 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39864c8-8094-47c0-94a8-f8d96e1edfed None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:00.725155 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 220/446] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Aug 23 22:13:00 2022] GET /identity/v3/groups/fd003810f62e4df6a40a9449d3b4e35f => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:00.726066 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39864c8-8094-47c0-94a8-f8d96e1edfed None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:00.738812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:00.765852 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f27522-1139-4908-85f0-fda6a0c47d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:00.766165 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f27522-1139-4908-85f0-fda6a0c47d7a None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:00.766466 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f27522-1139-4908-85f0-fda6a0c47d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:00.766804 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f27522-1139-4908-85f0-fda6a0c47d7a None admin] PATH_INFO: `/v3/groups/fd003810f62e4df6a40a9449d3b4e35f` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:00.768116 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f27522-1139-4908-85f0-fda6a0c47d7a None admin] RBAC: Authorizing `identity:get_group(group_id=fd003810f62e4df6a40a9449d3b4e35f)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:00.769726 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f27522-1139-4908-85f0-fda6a0c47d7a None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:00.771598 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 227/447] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Aug 23 22:13:00 2022] GET /identity/v3/groups/fd003810f62e4df6a40a9449d3b4e35f => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:13:00.773385 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f27522-1139-4908-85f0-fda6a0c47d7a None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:00.853895 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:00.890481 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39864c8-8094-47c0-94a8-f8d96e1edfed None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:00.933098 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f27522-1139-4908-85f0-fda6a0c47d7a None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:00.943947 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b2f1b-76f2-4322-b49a-e4de62bb6994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:00.944613 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b2f1b-76f2-4322-b49a-e4de62bb6994 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:00.945044 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b2f1b-76f2-4322-b49a-e4de62bb6994 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:00.945147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b2f1b-76f2-4322-b49a-e4de62bb6994 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:00.959608 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b2f1b-76f2-4322-b49a-e4de62bb6994 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:13:00.964562 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-9e6b2f1b-76f2-4322-b49a-e4de62bb6994 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:13:00.964562 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:00.964562 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:00.964562 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:00.964562 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:00.964562 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:00.964562 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:00.964562 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:00.964562 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:00.964562 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:00.964562 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:00.964562 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:00.964562 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:13:00.964562 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:13:00.964562 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:13:00.964562 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:13:00.966177 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:13:00.966177 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:13:00.966177 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:13:00.966177 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:13:00.966177 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:00.966177 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:00.966177 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:00.966177 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:00.966177 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:00.966177 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:00.966177 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:00.966177 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:00.966177 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:00.966177 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:00.966177 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:00.966177 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:00.967703 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:00.967703 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:00.967703 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:00.967703 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:00.967703 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:13:00.967703 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:13:00.967703 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:13:00.967703 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:13:00.967703 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:13:00.967703 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:13:00.967703 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:13:00.967703 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:00.967703 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 221/448] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:13:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:00.967703 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b2f1b-76f2-4322-b49a-e4de62bb6994 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:00.998174 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c56bba-2ad7-447f-9e04-f805d815f2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:00.998811 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c56bba-2ad7-447f-9e04-f805d815f2e5 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:00.999118 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c56bba-2ad7-447f-9e04-f805d815f2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:00.999386 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c56bba-2ad7-447f-9e04-f805d815f2e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:01.000135 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c56bba-2ad7-447f-9e04-f805d815f2e5 None admin] RBAC: Adding query filter params (group.id=fd003810f62e4df6a40a9449d3b4e35f, role.id=eabf42a0387a47218c5ce577dd65f61c, scope.project.id=20cc73f001a245c680144a956b81a15e) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:01.000443 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c56bba-2ad7-447f-9e04-f805d815f2e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:01.002012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c56bba-2ad7-447f-9e04-f805d815f2e5 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:01.010942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 228/449] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Aug 23 22:13:00 2022] GET /identity/v3/role_assignments?group.id=fd003810f62e4df6a40a9449d3b4e35f&scope.project.id=20cc73f001a245c680144a956b81a15e&role.id=eabf42a0387a47218c5ce577dd65f61c => generated 611 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:01.011167 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c56bba-2ad7-447f-9e04-f805d815f2e5 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:01.079345 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:01.138072 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b2f1b-76f2-4322-b49a-e4de62bb6994 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:01.182857 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c56bba-2ad7-447f-9e04-f805d815f2e5 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:01.193020 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d60389-b32c-4911-adde-7464740acfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:01.193778 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d60389-b32c-4911-adde-7464740acfb6 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:01.194113 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d60389-b32c-4911-adde-7464740acfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:01.194546 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d60389-b32c-4911-adde-7464740acfb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:01.195726 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d60389-b32c-4911-adde-7464740acfb6 None admin] RBAC: Adding query filter params (group.id=fd003810f62e4df6a40a9449d3b4e35f, role.id=a0449d430ec54adcabb96193af2f7cd5, scope.project.id=20cc73f001a245c680144a956b81a15e) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:01.196044 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d60389-b32c-4911-adde-7464740acfb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:01.198975 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d60389-b32c-4911-adde-7464740acfb6 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:01.208258 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 222/450] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Aug 23 22:13:00 2022] GET /identity/v3/role_assignments?group.id=fd003810f62e4df6a40a9449d3b4e35f&scope.project.id=20cc73f001a245c680144a956b81a15e&role.id=a0449d430ec54adcabb96193af2f7cd5 => generated 611 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:01.208898 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:01.240670 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ead3f-3a43-49d4-85e9-e2dc3bf19a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:01.242120 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ead3f-3a43-49d4-85e9-e2dc3bf19a73 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:01.242588 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ead3f-3a43-49d4-85e9-e2dc3bf19a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:01.242929 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ead3f-3a43-49d4-85e9-e2dc3bf19a73 None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:01.243856 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ead3f-3a43-49d4-85e9-e2dc3bf19a73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:01.244365 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ead3f-3a43-49d4-85e9-e2dc3bf19a73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:01.247340 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ead3f-3a43-49d4-85e9-e2dc3bf19a73 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:01.262995 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 229/451] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:13:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:01.273076 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d60389-b32c-4911-adde-7464740acfb6 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:01.417667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d60389-b32c-4911-adde-7464740acfb6 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:01.470608 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:01.476895 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851b6e0-7351-4484-9071-961a76827f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:01.477655 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851b6e0-7351-4484-9071-961a76827f61 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:01.477934 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851b6e0-7351-4484-9071-961a76827f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:01.478203 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851b6e0-7351-4484-9071-961a76827f61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:01.590028 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851b6e0-7351-4484-9071-961a76827f61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:01.592471 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851b6e0-7351-4484-9071-961a76827f61 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:01.722130 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 223/452] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:13:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:13:01.728031 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ead3f-3a43-49d4-85e9-e2dc3bf19a73 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:01.836709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ead3f-3a43-49d4-85e9-e2dc3bf19a73 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:01.874401 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11511b-fe3b-4464-937f-2f7789485236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:01.875342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11511b-fe3b-4464-937f-2f7789485236 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:01.875342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11511b-fe3b-4464-937f-2f7789485236 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:01.875585 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11511b-fe3b-4464-937f-2f7789485236 None admin] PATH_INFO: `/v3/projects/dad9b8e962404742bf84b26f82ffb671` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:01.876728 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11511b-fe3b-4464-937f-2f7789485236 None admin] RBAC: Authorizing `identity:get_project(project_id=dad9b8e962404742bf84b26f82ffb671)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:01.878327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11511b-fe3b-4464-937f-2f7789485236 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:01.879998 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 230/453] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:13:01 2022] GET /identity/v3/projects/dad9b8e962404742bf84b26f82ffb671 => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:01.885726 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851b6e0-7351-4484-9071-961a76827f61 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:01.919303 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:01.991137 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851b6e0-7351-4484-9071-961a76827f61 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:02.026847 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6c40b-e5d5-45ad-8cc7-b176c5957f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:02.027482 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6c40b-e5d5-45ad-8cc7-b176c5957f39 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:02.027844 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6c40b-e5d5-45ad-8cc7-b176c5957f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:02.028117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6c40b-e5d5-45ad-8cc7-b176c5957f39 None admin] PATH_INFO: `/v3/groups/e3c9dec2e8824c56b3dec3791b9c4029` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:02.029464 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d6c40b-e5d5-45ad-8cc7-b176c5957f39 None admin] RBAC: Authorizing `identity:get_group(group_id=e3c9dec2e8824c56b3dec3791b9c4029)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:02.030895 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d6c40b-e5d5-45ad-8cc7-b176c5957f39 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:02.032490 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 224/454] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Aug 23 22:13:01 2022] GET /identity/v3/groups/e3c9dec2e8824c56b3dec3791b9c4029 => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:02.038497 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11511b-fe3b-4464-937f-2f7789485236 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:02.087319 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:02.144554 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11511b-fe3b-4464-937f-2f7789485236 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:02.180302 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07b843-17fe-491b-866d-f7d469fcf678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:02.180920 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07b843-17fe-491b-866d-f7d469fcf678 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:02.181201 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07b843-17fe-491b-866d-f7d469fcf678 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:02.181585 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07b843-17fe-491b-866d-f7d469fcf678 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:02.182298 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e07b843-17fe-491b-866d-f7d469fcf678 None admin] RBAC: Adding query filter params (group.id=e3c9dec2e8824c56b3dec3791b9c4029, role.id=e806ce849cf34b92979b5524f3ea9ff6, scope.project.id=dad9b8e962404742bf84b26f82ffb671) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:02.182607 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e07b843-17fe-491b-866d-f7d469fcf678 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:02.184103 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e07b843-17fe-491b-866d-f7d469fcf678 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:02.190824 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 231/455] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Aug 23 22:13:02 2022] GET /identity/v3/role_assignments?group.id=e3c9dec2e8824c56b3dec3791b9c4029&scope.project.id=dad9b8e962404742bf84b26f82ffb671&role.id=e806ce849cf34b92979b5524f3ea9ff6 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:13:04.629829 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcbd88-d938-4e41-ae8b-03a3ded67774 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:04.631272 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcbd88-d938-4e41-ae8b-03a3ded67774 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:04.631996 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcbd88-d938-4e41-ae8b-03a3ded67774 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:04.633910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 225/456] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:04.641010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70c427-d662-462c-9965-bd334c0ff16f None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:04.641531 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70c427-d662-462c-9965-bd334c0ff16f None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:04.641603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70c427-d662-462c-9965-bd334c0ff16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:04.670557 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-0d70c427-d662-462c-9965-bd334c0ff16f None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:04.671799 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-0d70c427-d662-462c-9965-bd334c0ff16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:04.775736 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 232/457] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:13:04.929591 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0271959-16ec-409f-b0b3-55c0f181582b None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:04.930531 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0271959-16ec-409f-b0b3-55c0f181582b None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:04.931259 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0271959-16ec-409f-b0b3-55c0f181582b None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:04.934426 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 226/458] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:04.944337 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bfa42-bdd4-45b5-ac96-cac36fe68a22 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:04.945211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bfa42-bdd4-45b5-ac96-cac36fe68a22 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:04.945989 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bfa42-bdd4-45b5-ac96-cac36fe68a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:04.986489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-937bfa42-bdd4-45b5-ac96-cac36fe68a22 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:04.987740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-937bfa42-bdd4-45b5-ac96-cac36fe68a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:05.034770 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:05.084091 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 233/459] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:13:05.133657 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0271959-16ec-409f-b0b3-55c0f181582b None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:05.162302 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817037c-7ee3-4571-adf4-d0c81a0cbfcb None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:05.162993 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817037c-7ee3-4571-adf4-d0c81a0cbfcb None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:05.163601 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817037c-7ee3-4571-adf4-d0c81a0cbfcb None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:05.165534 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 234/460] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:13:05.172075 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905733cc-503d-4ed6-ab3a-168d7675123d None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:05.174150 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905733cc-503d-4ed6-ab3a-168d7675123d None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:05.175297 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905733cc-503d-4ed6-ab3a-168d7675123d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:05.210809 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-905733cc-503d-4ed6-ab3a-168d7675123d None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:05.214197 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-905733cc-503d-4ed6-ab3a-168d7675123d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:05.295030 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:05.303542 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0271959-16ec-409f-b0b3-55c0f181582b None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:05.342774 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 235/461] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:13:05.370691 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a41e82-20a9-4875-837d-f801e0459e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:05.371387 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a41e82-20a9-4875-837d-f801e0459e27 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:05.371879 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a41e82-20a9-4875-837d-f801e0459e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:05.372208 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a41e82-20a9-4875-837d-f801e0459e27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:05.385283 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a41e82-20a9-4875-837d-f801e0459e27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:05.387548 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a41e82-20a9-4875-837d-f801e0459e27 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:05.414806 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-92a41e82-20a9-4875-837d-f801e0459e27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:05.414806 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:05.414806 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:05.414806 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:05.414806 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:05.414806 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:05.414806 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:05.414806 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:05.414806 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:05.414806 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:05.414806 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:05.414806 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:05.414806 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:05.414806 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:05.414806 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:05.414806 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:05.415785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:05.415785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:05.415785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:05.415785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:05.415785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:05.415785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:05.415785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:05.415785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:05.415785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:05.415785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:05.415785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:05.415785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:05.415785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:05.415785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:05.415785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:05.415785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:05.415785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:05.416649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:05.416649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:05.416649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:05.416649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 227/462] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:05.422763 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905733cc-503d-4ed6-ab3a-168d7675123d None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:05.560073 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:05.566094 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905733cc-503d-4ed6-ab3a-168d7675123d None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:05.613912 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91f917-3f13-44bb-b34e-21e2f72e3822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:05.614540 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91f917-3f13-44bb-b34e-21e2f72e3822 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:05.614821 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91f917-3f13-44bb-b34e-21e2f72e3822 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:05.615092 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91f917-3f13-44bb-b34e-21e2f72e3822 None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:05.615742 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91f917-3f13-44bb-b34e-21e2f72e3822 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:05.616047 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91f917-3f13-44bb-b34e-21e2f72e3822 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:05.617442 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91f917-3f13-44bb-b34e-21e2f72e3822 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:05.626958 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a41e82-20a9-4875-837d-f801e0459e27 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:05.633389 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 236/463] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:13:05.640354 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91f917-3f13-44bb-b34e-21e2f72e3822 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:05.771859 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91f917-3f13-44bb-b34e-21e2f72e3822 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:05.799968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a41e82-20a9-4875-837d-f801e0459e27 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:05.826562 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d44cfa-d737-4495-9fb4-5f4fe618a8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:05.827500 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d44cfa-d737-4495-9fb4-5f4fe618a8a7 None admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:05.827893 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d44cfa-d737-4495-9fb4-5f4fe618a8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:05.828259 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d44cfa-d737-4495-9fb4-5f4fe618a8a7 None admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:05.829294 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d44cfa-d737-4495-9fb4-5f4fe618a8a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:05.831876 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d44cfa-d737-4495-9fb4-5f4fe618a8a7 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:05.847961 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b7cab-4313-4ef3-bee5-02e5b9ac9655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:05.848952 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b7cab-4313-4ef3-bee5-02e5b9ac9655 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:05.849427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b7cab-4313-4ef3-bee5-02e5b9ac9655 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:05.849427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b7cab-4313-4ef3-bee5-02e5b9ac9655 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:05.862768 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 237/464] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Aug 23 22:13:05 2022] POST /identity/v3/users => generated 246 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:13:05.864035 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d44cfa-d737-4495-9fb4-5f4fe618a8a7 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:05.873598 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b7cab-4313-4ef3-bee5-02e5b9ac9655 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:05.875313 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b7cab-4313-4ef3-bee5-02e5b9ac9655 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:05.893117 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:05.901812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-7d3b7cab-4313-4ef3-bee5-02e5b9ac9655 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:05.901812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:05.901812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:05.901812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:05.901812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:05.901812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:05.901812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:05.901812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:05.901812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:05.901812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:05.901812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:05.901812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:05.901812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:05.901812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:05.901812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:05.901812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:05.903316 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:05.903316 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:05.903316 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:05.903316 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:05.903316 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:05.903316 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:05.903316 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:05.903316 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:05.903316 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:05.903316 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:05.903316 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:05.903316 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:05.903316 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:05.903316 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:05.903316 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:05.903316 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:05.903316 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:05.904319 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:05.904319 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:05.904319 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:05.910176 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 228/465] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:05.916484 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b7cab-4313-4ef3-bee5-02e5b9ac9655 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:05.921290 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:06.002059 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d44cfa-d737-4495-9fb4-5f4fe618a8a7 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:06.037698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b7cab-4313-4ef3-bee5-02e5b9ac9655 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:06.045134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa0783-1b2b-4c8d-9030-8acfd726a7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:06.046189 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa0783-1b2b-4c8d-9030-8acfd726a7e4 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:06.046688 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa0783-1b2b-4c8d-9030-8acfd726a7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:06.047182 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa0783-1b2b-4c8d-9030-8acfd726a7e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:06.060912 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa0783-1b2b-4c8d-9030-8acfd726a7e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:06.063076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa0783-1b2b-4c8d-9030-8acfd726a7e4 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:06.080482 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ed900-5579-41aa-ba40-a06668b4572f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:06.081033 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ed900-5579-41aa-ba40-a06668b4572f None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:06.081344 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ed900-5579-41aa-ba40-a06668b4572f None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:06.081645 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ed900-5579-41aa-ba40-a06668b4572f None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:06.082303 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ed900-5579-41aa-ba40-a06668b4572f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:06.083186 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ed900-5579-41aa-ba40-a06668b4572f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:06.083983 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ed900-5579-41aa-ba40-a06668b4572f None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:06.086341 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-f0fa0783-1b2b-4c8d-9030-8acfd726a7e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:06.086341 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:06.086341 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:06.086341 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:06.086341 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:06.086341 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:06.086341 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:06.086341 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:06.086341 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:06.086341 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:06.086341 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:06.086341 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:06.086341 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:06.086341 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:06.086341 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:06.086341 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:06.087207 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:06.087207 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:06.087207 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:06.087207 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:06.087207 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:06.087207 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:06.087207 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:06.087207 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:06.087207 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:06.087207 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:06.087207 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:06.087207 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:06.087207 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:06.087207 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:06.087207 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:06.087207 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:06.087207 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:06.088043 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:06.088043 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:06.088043 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:06.090716 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 238/466] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:06.096842 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ed1b4-70ed-46f7-a747-000ee824cdd3 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:06.096842 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ed1b4-70ed-46f7-a747-000ee824cdd3 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:06.096842 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ed1b4-70ed-46f7-a747-000ee824cdd3 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:06.096842 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 239/467] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:06.098484 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ed1b4-70ed-46f7-a747-000ee824cdd3 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:06.105484 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 229/468] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:13:06.105484 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2fe95-382b-41d1-a0a5-00c8307b6667 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:06.105484 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2fe95-382b-41d1-a0a5-00c8307b6667 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:06.105484 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2fe95-382b-41d1-a0a5-00c8307b6667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:06.126604 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-a7b2fe95-382b-41d1-a0a5-00c8307b6667 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:06.128345 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-a7b2fe95-382b-41d1-a0a5-00c8307b6667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:06.194656 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:06.214627 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:06.223320 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 230/469] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:13:06.224484 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2fe95-382b-41d1-a0a5-00c8307b6667 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:06.258125 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ed1b4-70ed-46f7-a747-000ee824cdd3 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:06.344615 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2fe95-382b-41d1-a0a5-00c8307b6667 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:06.370252 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7903d9-c9ae-4ca5-b825-37e957e834ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:06.370901 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7903d9-c9ae-4ca5-b825-37e957e834ca None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:06.371208 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7903d9-c9ae-4ca5-b825-37e957e834ca None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:06.371485 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7903d9-c9ae-4ca5-b825-37e957e834ca None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:06.372234 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7903d9-c9ae-4ca5-b825-37e957e834ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:06.372480 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7903d9-c9ae-4ca5-b825-37e957e834ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:06.373956 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7903d9-c9ae-4ca5-b825-37e957e834ca None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:06.396163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56802c-5f31-4845-be58-4459f57170a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:06.396840 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56802c-5f31-4845-be58-4459f57170a5 None admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:06.397124 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56802c-5f31-4845-be58-4459f57170a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:06.397409 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56802c-5f31-4845-be58-4459f57170a5 None admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:06.399256 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 240/470] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:06.399416 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56802c-5f31-4845-be58-4459f57170a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:06.400886 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56802c-5f31-4845-be58-4459f57170a5 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:06.410509 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7903d9-c9ae-4ca5-b825-37e957e834ca None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:06.441952 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 231/471] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Aug 23 22:13:06 2022] POST /identity/v3/users => generated 248 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:13:06.460034 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91bb5f-bf82-4c75-9497-2d2578acb1f0 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:06.460967 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91bb5f-bf82-4c75-9497-2d2578acb1f0 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:06.461751 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91bb5f-bf82-4c75-9497-2d2578acb1f0 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:06.464536 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 232/472] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:13:06.475564 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec364ef-160a-48db-a854-8417144c0cc9 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:06.476504 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec364ef-160a-48db-a854-8417144c0cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:06.477405 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec364ef-160a-48db-a854-8417144c0cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:06.535250 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-aec364ef-160a-48db-a854-8417144c0cc9 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:06.537116 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-aec364ef-160a-48db-a854-8417144c0cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:06.652593 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:06.668419 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7903d9-c9ae-4ca5-b825-37e957e834ca None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:06.693945 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 233/473] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:13:06.695313 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec364ef-160a-48db-a854-8417144c0cc9 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:06.708061 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:06.723612 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d384de-3dfa-4447-be92-5e5faad3ab07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:06.724710 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d384de-3dfa-4447-be92-5e5faad3ab07 None admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:06.725175 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d384de-3dfa-4447-be92-5e5faad3ab07 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:06.725782 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d384de-3dfa-4447-be92-5e5faad3ab07 None admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:06.726883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d384de-3dfa-4447-be92-5e5faad3ab07 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:06.729490 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d384de-3dfa-4447-be92-5e5faad3ab07 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:06.795262 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 241/474] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Aug 23 22:13:06 2022] POST /identity/v3/users => generated 248 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:13:06.873593 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec364ef-160a-48db-a854-8417144c0cc9 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:06.920475 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf4d8f-35f6-443c-bec2-cb1d60a4f75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:06.921144 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf4d8f-35f6-443c-bec2-cb1d60a4f75b None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:06.921449 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf4d8f-35f6-443c-bec2-cb1d60a4f75b None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:06.921726 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf4d8f-35f6-443c-bec2-cb1d60a4f75b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:06.937704 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf4d8f-35f6-443c-bec2-cb1d60a4f75b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:06.939392 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf4d8f-35f6-443c-bec2-cb1d60a4f75b None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:06.962052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-abcf4d8f-35f6-443c-bec2-cb1d60a4f75b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:06.962052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:06.962052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:06.962052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:06.962052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:06.962052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:06.962052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:06.962052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:06.962052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:06.962052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:06.962052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:06.962052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:06.962052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:06.962052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:06.962052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:06.962052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:06.963045 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:06.963045 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:06.963045 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:06.963045 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:06.963045 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:06.963045 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:06.963045 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:06.963045 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:06.963045 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:06.963045 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:06.963045 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:06.963045 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:06.963045 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:06.963045 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:06.963045 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:06.963045 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:06.963045 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:06.964306 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:06.964306 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:06.964306 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:06.964306 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 234/475] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:06.970656 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d384de-3dfa-4447-be92-5e5faad3ab07 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:07.037572 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf4d8f-35f6-443c-bec2-cb1d60a4f75b None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:07.089812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:07.134037 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d384de-3dfa-4447-be92-5e5faad3ab07 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:07.188200 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d8200-54b5-4a3a-8e6e-e66299e7b602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:07.188766 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d8200-54b5-4a3a-8e6e-e66299e7b602 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:07.189046 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d8200-54b5-4a3a-8e6e-e66299e7b602 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:07.189319 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d8200-54b5-4a3a-8e6e-e66299e7b602 None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:07.190071 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d8200-54b5-4a3a-8e6e-e66299e7b602 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:07.190388 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d8200-54b5-4a3a-8e6e-e66299e7b602 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:07.192124 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d8200-54b5-4a3a-8e6e-e66299e7b602 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:07.202333 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf4d8f-35f6-443c-bec2-cb1d60a4f75b None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:07.207828 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 242/476] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:07.219643 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d8200-54b5-4a3a-8e6e-e66299e7b602 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:07.251947 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3814b9-8b94-4a2b-af1b-f68d9665a2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:07.253213 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3814b9-8b94-4a2b-af1b-f68d9665a2f6 None admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:07.253680 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3814b9-8b94-4a2b-af1b-f68d9665a2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:07.254136 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3814b9-8b94-4a2b-af1b-f68d9665a2f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:07.255029 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3814b9-8b94-4a2b-af1b-f68d9665a2f6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:07.257450 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3814b9-8b94-4a2b-af1b-f68d9665a2f6 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:07.268457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.sql.core [None req-eb3814b9-8b94-4a2b-af1b-f68d9665a2f6 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 23 22:13:07.268457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 23 22:13:07.268457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [parameters: {'id': 'bcaf228b28de4420a602a3a2f8f106c5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 23 22:13:07.268457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81751) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 22:13:07.290092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-eb3814b9-8b94-4a2b-af1b-f68d9665a2f6 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 23 22:13:07.290092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:07.290092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 22:13:07.290092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 22:13:07.290092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 22:13:07.290092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 22:13:07.290092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 22:13:07.290092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 22:13:07.290092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 22:13:07.290092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application conn.query(q) Aug 23 22:13:07.290092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 22:13:07.290092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 22:13:07.290092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 22:13:07.290092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application result.read() Aug 23 22:13:07.290092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 22:13:07.291055 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 22:13:07.291055 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 22:13:07.291055 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 22:13:07.291055 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 22:13:07.291055 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 22:13:07.291055 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 22:13:07.291055 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 22:13:07.291055 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 23 22:13:07.291055 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:07.291055 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 22:13:07.291055 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:07.291055 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:07.291055 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 22:13:07.291055 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 22:13:07.291055 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 23 22:13:07.291055 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return ref.to_dict() Aug 23 22:13:07.291055 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 22:13:07.291055 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application next(self.gen) Aug 23 22:13:07.291965 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 22:13:07.291965 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application yield resource Aug 23 22:13:07.291965 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 22:13:07.291965 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application next(self.gen) Aug 23 22:13:07.291965 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 22:13:07.291965 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 22:13:07.291965 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 22:13:07.291965 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 22:13:07.291965 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 22:13:07.291965 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise self.value Aug 23 22:13:07.291965 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 22:13:07.291965 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 22:13:07.291965 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 22:13:07.291965 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application session.commit() Aug 23 22:13:07.291965 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 22:13:07.291965 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 22:13:07.291965 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 22:13:07.293012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 22:13:07.293012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 22:13:07.293012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self.session.flush() Aug 23 22:13:07.293012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 22:13:07.293012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 22:13:07.293012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 22:13:07.293012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 22:13:07.293012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 22:13:07.293012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application compat.raise_( Aug 23 22:13:07.293012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 22:13:07.293012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception Aug 23 22:13:07.293012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 22:13:07.293012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 22:13:07.293012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 22:13:07.293012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 22:13:07.293012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 22:13:07.293012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 22:13:07.295465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 22:13:07.295465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 22:13:07.295465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 23 22:13:07.295465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 23 22:13:07.295465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 22:13:07.295465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 22:13:07.295465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 22:13:07.295465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 22:13:07.295465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 22:13:07.295465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 22:13:07.295465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 22:13:07.295465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 22:13:07.295465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 22:13:07.295465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 22:13:07.295465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 22:13:07.295465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception Aug 23 22:13:07.297032 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 22:13:07.297032 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 22:13:07.297032 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 22:13:07.297032 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 22:13:07.297032 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 22:13:07.297032 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 22:13:07.297032 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 22:13:07.297032 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application conn.query(q) Aug 23 22:13:07.297032 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 22:13:07.297032 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 22:13:07.297032 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 22:13:07.297032 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application result.read() Aug 23 22:13:07.297032 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 22:13:07.297032 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 22:13:07.297032 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 22:13:07.297032 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 22:13:07.298587 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 22:13:07.298587 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 22:13:07.298587 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 22:13:07.298587 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 22:13:07.298587 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 23 22:13:07.298587 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 23 22:13:07.298587 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [parameters: {'id': 'bcaf228b28de4420a602a3a2f8f106c5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 23 22:13:07.298587 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 22:13:07.298587 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:07.298587 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:13:07.298587 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:07.298587 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:07.298587 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:07.298587 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:07.298587 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:07.298587 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:07.300232 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:07.300232 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:07.300232 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:07.300232 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:07.300232 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:07.300232 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:07.300232 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 23 22:13:07.300232 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 23 22:13:07.300232 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:07.300232 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:07.300232 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 23 22:13:07.300232 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 23 22:13:07.300232 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 22:13:07.300232 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 22:13:07.300232 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 23 22:13:07.300232 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:07.303869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 235/477] 10.222.0.77 () {60 vars in 1131 bytes} [Tue Aug 23 22:13:07 2022] POST /identity/v3/roles => generated 144 bytes in 267 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:07.311086 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:07.312416 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3814b9-8b94-4a2b-af1b-f68d9665a2f6 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:07.469107 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3814b9-8b94-4a2b-af1b-f68d9665a2f6 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:07.471576 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:07.476177 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d8200-54b5-4a3a-8e6e-e66299e7b602 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:07.516294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989b69b-f49e-4e86-8965-2b62a50ff05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:07.517257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989b69b-f49e-4e86-8965-2b62a50ff05b None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:07.517781 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989b69b-f49e-4e86-8965-2b62a50ff05b None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:07.518238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989b69b-f49e-4e86-8965-2b62a50ff05b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:07.531191 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9989b69b-f49e-4e86-8965-2b62a50ff05b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:13:07.538785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-9989b69b-f49e-4e86-8965-2b62a50ff05b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:13:07.538785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:07.538785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:07.538785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:07.538785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:07.538785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:07.538785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:07.538785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:07.538785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:07.538785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:07.538785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:07.538785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:07.538785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:13:07.538785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:13:07.538785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:13:07.538785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:13:07.539764 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:13:07.539764 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:13:07.539764 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:13:07.539764 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:13:07.539764 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:07.539764 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:07.539764 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:07.539764 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:07.539764 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:07.539764 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:07.539764 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:07.539764 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:07.539764 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:07.539764 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:07.539764 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:07.539764 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:07.540580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:07.540580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:07.540580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:07.540580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:07.540580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:13:07.540580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:13:07.540580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:13:07.540580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:13:07.540580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:13:07.540580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:13:07.540580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:13:07.540580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:07.543373 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 236/478] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Aug 23 22:13:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:07.552478 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989b69b-f49e-4e86-8965-2b62a50ff05b None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:07.593264 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d5cde-8ac2-4482-8f50-516b2c8ab5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:07.595954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d5cde-8ac2-4482-8f50-516b2c8ab5bd None admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:07.596433 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d5cde-8ac2-4482-8f50-516b2c8ab5bd None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:07.596912 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d5cde-8ac2-4482-8f50-516b2c8ab5bd None admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:07.598955 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d5cde-8ac2-4482-8f50-516b2c8ab5bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:07.602301 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d5cde-8ac2-4482-8f50-516b2c8ab5bd None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:07.634252 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 243/479] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Aug 23 22:13:07 2022] POST /identity/v3/users => generated 249 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:13:07.757726 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989b69b-f49e-4e86-8965-2b62a50ff05b None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:07.805490 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae7985-0815-43ef-8efa-3f91228ba1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:07.806133 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae7985-0815-43ef-8efa-3f91228ba1b7 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:07.806417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae7985-0815-43ef-8efa-3f91228ba1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:07.806696 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae7985-0815-43ef-8efa-3f91228ba1b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:07.807391 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae7985-0815-43ef-8efa-3f91228ba1b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:07.807702 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae7985-0815-43ef-8efa-3f91228ba1b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:07.809958 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae7985-0815-43ef-8efa-3f91228ba1b7 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:07.825588 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 237/480] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:08.264630 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5b44a-8c41-4591-9d29-862d3ee768e9 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:08.265710 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5b44a-8c41-4591-9d29-862d3ee768e9 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:08.266198 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5b44a-8c41-4591-9d29-862d3ee768e9 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:08.268077 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 244/481] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:08.279762 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b2b22-dc15-4505-8e46-29c15eede92c None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:08.280719 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b2b22-dc15-4505-8e46-29c15eede92c None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:08.281217 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b2b22-dc15-4505-8e46-29c15eede92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:08.306432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-3c8b2b22-dc15-4505-8e46-29c15eede92c None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:08.307655 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-3c8b2b22-dc15-4505-8e46-29c15eede92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:08.330431 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:08.426002 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 238/482] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:13:08.762381 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5b44a-8c41-4591-9d29-862d3ee768e9 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:08.964622 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:08.972622 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5b44a-8c41-4591-9d29-862d3ee768e9 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:09.038092 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba72c94-2603-400c-9468-9f8ad26543dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:09.039630 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba72c94-2603-400c-9468-9f8ad26543dc None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:09.040415 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba72c94-2603-400c-9468-9f8ad26543dc None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:09.041212 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba72c94-2603-400c-9468-9f8ad26543dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:09.064254 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba72c94-2603-400c-9468-9f8ad26543dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:13:09.076606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-3ba72c94-2603-400c-9468-9f8ad26543dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:13:09.076606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:09.076606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:09.076606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:09.076606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:09.076606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:09.076606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:09.076606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:09.076606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:09.076606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:09.076606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:09.076606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:09.076606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:13:09.076606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:13:09.076606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:13:09.076606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:13:09.077902 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:13:09.077902 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:13:09.077902 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:13:09.077902 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:13:09.077902 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:09.077902 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:09.077902 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:09.077902 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:09.077902 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:09.077902 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:09.077902 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:09.077902 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:09.077902 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:09.077902 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:09.077902 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:09.077902 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:09.078683 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:09.078683 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:09.078683 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:09.078683 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:09.078683 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:13:09.078683 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:13:09.078683 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:13:09.078683 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:13:09.078683 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:13:09.078683 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:13:09.078683 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:13:09.078683 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:09.081397 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 245/483] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Aug 23 22:13:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:09.091940 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b2b22-dc15-4505-8e46-29c15eede92c None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:09.225635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b2b22-dc15-4505-8e46-29c15eede92c None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:09.268936 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0573d-f65c-4bfb-bedd-84aa6b618dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:09.269596 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0573d-f65c-4bfb-bedd-84aa6b618dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:09.269881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0573d-f65c-4bfb-bedd-84aa6b618dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:09.270163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0573d-f65c-4bfb-bedd-84aa6b618dc5 None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:09.270845 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0573d-f65c-4bfb-bedd-84aa6b618dc5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:09.271153 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0573d-f65c-4bfb-bedd-84aa6b618dc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:09.272541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0573d-f65c-4bfb-bedd-84aa6b618dc5 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:09.283175 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 239/484] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Aug 23 22:13:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:09.290539 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba72c94-2603-400c-9468-9f8ad26543dc None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:09.422551 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba72c94-2603-400c-9468-9f8ad26543dc None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:09.465698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c20fa-49f6-4b51-9a09-06a978977bce None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:09.466168 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c20fa-49f6-4b51-9a09-06a978977bce None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:09.466508 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c20fa-49f6-4b51-9a09-06a978977bce None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:09.467264 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4726aa7-af55-4338-9a43-6da2b1abc0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:09.468243 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 240/485] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:09.468490 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4726aa7-af55-4338-9a43-6da2b1abc0ce None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:09.468996 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4726aa7-af55-4338-9a43-6da2b1abc0ce None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:09.469546 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4726aa7-af55-4338-9a43-6da2b1abc0ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:09.474160 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b099732-cb9f-453f-b5d1-9d87a866cb3e None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:09.474474 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b099732-cb9f-453f-b5d1-9d87a866cb3e None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:09.474725 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b099732-cb9f-453f-b5d1-9d87a866cb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:09.485855 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4726aa7-af55-4338-9a43-6da2b1abc0ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:09.487697 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4726aa7-af55-4338-9a43-6da2b1abc0ce None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:09.502816 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-9b099732-cb9f-453f-b5d1-9d87a866cb3e None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:09.504042 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-9b099732-cb9f-453f-b5d1-9d87a866cb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:09.507351 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:09.517438 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-e4726aa7-af55-4338-9a43-6da2b1abc0ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:09.517438 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:09.517438 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:09.517438 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:09.517438 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:09.517438 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:09.517438 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:09.517438 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:09.517438 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:09.517438 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:09.517438 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:09.517438 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:09.517438 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:09.517438 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:09.517438 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:09.517438 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:09.518454 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:09.518454 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:09.518454 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:09.518454 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:09.518454 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:09.518454 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:09.518454 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:09.518454 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:09.518454 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:09.518454 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:09.518454 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:09.518454 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:09.518454 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:09.518454 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:09.518454 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:09.518454 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:09.518454 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:09.519307 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:09.519307 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:09.519307 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:09.519307 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 246/486] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:09.525036 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4726aa7-af55-4338-9a43-6da2b1abc0ce None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:09.573864 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:09.593188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 241/487] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:13:09.677896 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4726aa7-af55-4338-9a43-6da2b1abc0ce None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:09.728444 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb81d8-b451-4736-b60b-52d0e840fb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:09.729086 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb81d8-b451-4736-b60b-52d0e840fb54 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:09.729384 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb81d8-b451-4736-b60b-52d0e840fb54 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:09.729771 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb81d8-b451-4736-b60b-52d0e840fb54 None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:09.730418 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb81d8-b451-4736-b60b-52d0e840fb54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:09.730831 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb81d8-b451-4736-b60b-52d0e840fb54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:09.732336 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb81d8-b451-4736-b60b-52d0e840fb54 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:09.754875 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 247/488] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:13:09.760279 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b099732-cb9f-453f-b5d1-9d87a866cb3e None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:09.904726 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b099732-cb9f-453f-b5d1-9d87a866cb3e None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:09.944038 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb81d8-b451-4736-b60b-52d0e840fb54 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:09.946051 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6300e73-a70a-45ca-af29-3577fcf9f1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:09.947095 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6300e73-a70a-45ca-af29-3577fcf9f1b1 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:09.947598 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6300e73-a70a-45ca-af29-3577fcf9f1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:09.948094 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6300e73-a70a-45ca-af29-3577fcf9f1b1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:09.957664 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6300e73-a70a-45ca-af29-3577fcf9f1b1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:09.959581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6300e73-a70a-45ca-af29-3577fcf9f1b1 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:09.975707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-b6300e73-a70a-45ca-af29-3577fcf9f1b1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:13:09.975707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:09.975707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:09.975707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:09.975707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:09.975707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:09.975707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:09.975707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:09.975707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:09.975707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:09.975707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:09.975707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:09.975707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:13:09.975707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:13:09.975707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:13:09.975707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:13:09.976760 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:09.976760 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:09.976760 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:13:09.976760 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:09.976760 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:13:09.976760 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:09.976760 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:09.976760 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:09.976760 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:09.976760 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:09.976760 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:09.976760 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:09.976760 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:09.976760 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:09.976760 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:09.976760 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:09.976760 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:09.976760 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:09.977752 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:09.977752 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:09.977752 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:13:09.977752 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:13:09.977752 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:13:09.977752 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:13:09.977752 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:13:09.977752 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:13:09.977752 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:13:09.977752 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:09.980544 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:09.981172 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 242/489] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Aug 23 22:13:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:09.985582 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb535e2a-cad4-4219-9153-e17004f19a4e None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:09.986140 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb535e2a-cad4-4219-9153-e17004f19a4e None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:09.986611 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb535e2a-cad4-4219-9153-e17004f19a4e None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:09.988513 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 243/490] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:09.989508 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb535e2a-cad4-4219-9153-e17004f19a4e None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:10.038702 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:10.073641 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb81d8-b451-4736-b60b-52d0e840fb54 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:10.114401 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c83bd8-59c3-450e-b8d4-fa101b41765a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:10.115427 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c83bd8-59c3-450e-b8d4-fa101b41765a None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:10.115922 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c83bd8-59c3-450e-b8d4-fa101b41765a None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:10.116425 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c83bd8-59c3-450e-b8d4-fa101b41765a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:10.129205 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c83bd8-59c3-450e-b8d4-fa101b41765a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:13:10.129633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb535e2a-cad4-4219-9153-e17004f19a4e None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:10.134828 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-11c83bd8-59c3-450e-b8d4-fa101b41765a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:13:10.134828 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:10.134828 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:10.134828 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:10.134828 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:10.134828 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:10.134828 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:10.134828 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:10.134828 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:10.134828 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:10.134828 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:10.134828 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:10.134828 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:13:10.134828 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:13:10.134828 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:13:10.134828 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:13:10.135770 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:13:10.135770 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:13:10.135770 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:13:10.135770 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:13:10.135770 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:10.135770 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:10.135770 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:10.135770 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:10.135770 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:10.135770 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:10.135770 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:10.135770 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:10.135770 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:10.135770 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:10.135770 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:10.135770 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:10.136580 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:10.136580 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:10.136580 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:10.136580 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:10.136580 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:13:10.136580 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:13:10.136580 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:13:10.136580 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:13:10.136580 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:13:10.136580 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:13:10.136580 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:13:10.136580 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:10.139634 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 248/491] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Aug 23 22:13:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:10.141187 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbde38-f751-417e-9654-600dc7f760e1 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:10.141715 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbde38-f751-417e-9654-600dc7f760e1 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:10.142201 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbde38-f751-417e-9654-600dc7f760e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:10.162537 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-5ecbde38-f751-417e-9654-600dc7f760e1 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:10.164020 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-5ecbde38-f751-417e-9654-600dc7f760e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:10.172534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f52b93-2c59-4dfa-a62c-c33997f60ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:10.173552 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f52b93-2c59-4dfa-a62c-c33997f60ee1 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:10.174054 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f52b93-2c59-4dfa-a62c-c33997f60ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:10.174541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f52b93-2c59-4dfa-a62c-c33997f60ee1 None admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:10.175490 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f52b93-2c59-4dfa-a62c-c33997f60ee1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:10.176099 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f52b93-2c59-4dfa-a62c-c33997f60ee1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:10.177782 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f52b93-2c59-4dfa-a62c-c33997f60ee1 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:10.227420 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 244/492] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Aug 23 22:13:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:10.228735 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f52b93-2c59-4dfa-a62c-c33997f60ee1 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:10.257458 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 249/493] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:13:10.258745 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbde38-f751-417e-9654-600dc7f760e1 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:10.330881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:10.381384 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:10.420376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f52b93-2c59-4dfa-a62c-c33997f60ee1 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:10.441397 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbde38-f751-417e-9654-600dc7f760e1 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:10.484341 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a10e97-7828-44ab-b79a-2ed847b4c2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:10.485150 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a10e97-7828-44ab-b79a-2ed847b4c2ab None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:10.485462 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a10e97-7828-44ab-b79a-2ed847b4c2ab None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:10.485775 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a10e97-7828-44ab-b79a-2ed847b4c2ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:10.508489 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52c126-2b8e-47ed-97be-d3164e659280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:10.509570 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52c126-2b8e-47ed-97be-d3164e659280 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:10.510060 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52c126-2b8e-47ed-97be-d3164e659280 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:10.510553 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52c126-2b8e-47ed-97be-d3164e659280 None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:10.511446 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52c126-2b8e-47ed-97be-d3164e659280 None admin] RBAC: Adding query filter params (name=service) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:10.512911 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52c126-2b8e-47ed-97be-d3164e659280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:10.514654 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52c126-2b8e-47ed-97be-d3164e659280 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:10.524229 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 245/494] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Aug 23 22:13:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:10.531557 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba97aa-1fa6-419d-93c1-abfcae3b25f4 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:10.532177 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba97aa-1fa6-419d-93c1-abfcae3b25f4 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:10.532668 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba97aa-1fa6-419d-93c1-abfcae3b25f4 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:10.534583 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 246/495] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:10.535599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba97aa-1fa6-419d-93c1-abfcae3b25f4 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:10.589839 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a10e97-7828-44ab-b79a-2ed847b4c2ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:10.591808 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a10e97-7828-44ab-b79a-2ed847b4c2ab None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:10.673859 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:10.695259 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba97aa-1fa6-419d-93c1-abfcae3b25f4 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:10.722492 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:10.729268 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 250/496] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:13:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:13:10.731357 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e902593-e32d-46fd-98ae-8fbbf97c4e82 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:10.731930 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e902593-e32d-46fd-98ae-8fbbf97c4e82 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:10.732220 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e902593-e32d-46fd-98ae-8fbbf97c4e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:10.744435 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df141eb-c8c4-4503-9bfe-8b4f5d507949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:10.745667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df141eb-c8c4-4503-9bfe-8b4f5d507949 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:10.745973 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df141eb-c8c4-4503-9bfe-8b4f5d507949 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:10.746918 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df141eb-c8c4-4503-9bfe-8b4f5d507949 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:10.752309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-3e902593-e32d-46fd-98ae-8fbbf97c4e82 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:10.753592 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-3e902593-e32d-46fd-98ae-8fbbf97c4e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:10.759658 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df141eb-c8c4-4503-9bfe-8b4f5d507949 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:10.761153 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df141eb-c8c4-4503-9bfe-8b4f5d507949 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:10.781163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-6df141eb-c8c4-4503-9bfe-8b4f5d507949 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:10.781163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:10.781163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:10.781163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:10.781163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:10.781163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:10.781163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:10.781163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:10.781163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:10.781163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:10.781163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:10.781163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:10.781163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:10.781163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:10.781163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:10.781163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:10.782288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:10.782288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:10.782288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:10.782288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:10.782288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:10.782288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:10.782288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:10.782288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:10.782288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:10.782288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:10.782288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:10.782288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:10.782288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:10.782288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:10.782288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:10.782288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:10.782288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:10.783153 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:10.783153 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:10.783153 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:10.783153 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 247/497] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:10.784939 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f17b30-4790-40a6-b8f7-c2cc74119c1c None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:10.785233 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f17b30-4790-40a6-b8f7-c2cc74119c1c None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:10.785590 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f17b30-4790-40a6-b8f7-c2cc74119c1c None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:10.788100 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 248/498] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:10.788100 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f17b30-4790-40a6-b8f7-c2cc74119c1c None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:10.850877 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 251/499] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:13:10.851695 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e902593-e32d-46fd-98ae-8fbbf97c4e82 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:10.919361 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f17b30-4790-40a6-b8f7-c2cc74119c1c None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:10.956181 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:10.958859 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6040db9-0dc0-4f40-81ad-0e04315f8567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:10.959572 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6040db9-0dc0-4f40-81ad-0e04315f8567 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:10.959835 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6040db9-0dc0-4f40-81ad-0e04315f8567 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:10.960205 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6040db9-0dc0-4f40-81ad-0e04315f8567 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:10.966563 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e902593-e32d-46fd-98ae-8fbbf97c4e82 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:10.972099 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6040db9-0dc0-4f40-81ad-0e04315f8567 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:13:10.976890 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-f6040db9-0dc0-4f40-81ad-0e04315f8567 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:13:10.976890 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:10.976890 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:10.976890 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:10.976890 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:10.976890 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:10.976890 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:10.976890 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:10.976890 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:10.976890 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:10.976890 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:10.976890 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:10.976890 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:13:10.976890 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:13:10.976890 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:13:10.976890 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:13:10.977894 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:13:10.977894 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:13:10.977894 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:13:10.977894 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:13:10.977894 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:10.977894 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:10.977894 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:10.977894 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:10.977894 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:10.977894 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:10.977894 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:10.977894 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:10.977894 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:10.977894 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:10.977894 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:10.977894 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:10.978713 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:10.978713 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:10.978713 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:10.978713 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:10.978713 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:13:10.978713 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:13:10.978713 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:13:10.978713 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:13:10.978713 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:13:10.978713 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:13:10.978713 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:13:10.978713 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:10.978713 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 249/500] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Aug 23 22:13:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:10.979384 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6040db9-0dc0-4f40-81ad-0e04315f8567 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:11.010897 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a02e1-3793-475c-aa0f-0c4d66ca14e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:11.015763 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a02e1-3793-475c-aa0f-0c4d66ca14e7 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:11.015763 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a02e1-3793-475c-aa0f-0c4d66ca14e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:11.015763 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a02e1-3793-475c-aa0f-0c4d66ca14e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:11.017522 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:11.025892 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a02e1-3793-475c-aa0f-0c4d66ca14e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:11.028022 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a02e1-3793-475c-aa0f-0c4d66ca14e7 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:11.046427 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-105a02e1-3793-475c-aa0f-0c4d66ca14e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:11.046427 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:11.046427 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:11.046427 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:11.046427 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:11.046427 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:11.046427 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:11.046427 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:11.046427 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:11.046427 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:11.046427 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:11.046427 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:11.046427 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:11.046427 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:11.046427 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:11.046427 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:11.047401 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:11.047401 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:11.047401 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:11.047401 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:11.047401 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:11.047401 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:11.047401 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:11.047401 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:11.047401 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:11.047401 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:11.047401 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:11.047401 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:11.047401 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:11.047401 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:11.047401 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:11.047401 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:11.047401 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:11.048237 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:11.048237 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:11.048237 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:11.048237 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 252/501] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:11.049102 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a91904-8957-4811-aa8a-d8cb8cf8bfe6 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:11.049399 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a91904-8957-4811-aa8a-d8cb8cf8bfe6 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:11.049672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a91904-8957-4811-aa8a-d8cb8cf8bfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:11.074906 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-82a91904-8957-4811-aa8a-d8cb8cf8bfe6 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:11.076120 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-82a91904-8957-4811-aa8a-d8cb8cf8bfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:11.101190 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6040db9-0dc0-4f40-81ad-0e04315f8567 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:11.143053 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84682ce5-cf19-4ce2-99c4-2fa638699732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:11.143668 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84682ce5-cf19-4ce2-99c4-2fa638699732 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:11.143985 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84682ce5-cf19-4ce2-99c4-2fa638699732 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:11.144260 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84682ce5-cf19-4ce2-99c4-2fa638699732 None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:11.144918 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84682ce5-cf19-4ce2-99c4-2fa638699732 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:11.145224 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84682ce5-cf19-4ce2-99c4-2fa638699732 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:11.146648 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84682ce5-cf19-4ce2-99c4-2fa638699732 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:11.147093 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 253/502] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:13:11.147946 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a91904-8957-4811-aa8a-d8cb8cf8bfe6 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:11.164706 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 250/503] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:11.164706 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84682ce5-cf19-4ce2-99c4-2fa638699732 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:11.245839 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:11.272212 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:11.275078 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a91904-8957-4811-aa8a-d8cb8cf8bfe6 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:11.283352 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84682ce5-cf19-4ce2-99c4-2fa638699732 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:11.313675 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5e67d-5441-4a4f-9ecd-3c268b5984bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:11.314060 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5e67d-5441-4a4f-9ecd-3c268b5984bf None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:11.314336 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5e67d-5441-4a4f-9ecd-3c268b5984bf None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:11.314612 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5e67d-5441-4a4f-9ecd-3c268b5984bf None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:11.315276 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5e67d-5441-4a4f-9ecd-3c268b5984bf None admin] RBAC: Adding query filter params (name=service) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:11.315609 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5e67d-5441-4a4f-9ecd-3c268b5984bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:11.316984 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5e67d-5441-4a4f-9ecd-3c268b5984bf None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:11.323916 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36bcfae-1ca1-4320-aaa6-d2f0b2f4229f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:11.324614 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36bcfae-1ca1-4320-aaa6-d2f0b2f4229f None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:11.324894 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36bcfae-1ca1-4320-aaa6-d2f0b2f4229f None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:11.325169 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36bcfae-1ca1-4320-aaa6-d2f0b2f4229f None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:11.325857 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36bcfae-1ca1-4320-aaa6-d2f0b2f4229f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:11.326163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36bcfae-1ca1-4320-aaa6-d2f0b2f4229f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:11.326916 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 254/504] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Aug 23 22:13:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:11.327564 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36bcfae-1ca1-4320-aaa6-d2f0b2f4229f None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:11.328327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5e67d-5441-4a4f-9ecd-3c268b5984bf None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:11.343997 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 251/505] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:11.344858 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36bcfae-1ca1-4320-aaa6-d2f0b2f4229f None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:11.451521 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5e67d-5441-4a4f-9ecd-3c268b5984bf None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:11.459435 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36bcfae-1ca1-4320-aaa6-d2f0b2f4229f None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:11.487207 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89795999-1fae-48a0-b69f-ec551af3b953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:11.487846 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89795999-1fae-48a0-b69f-ec551af3b953 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:11.488127 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89795999-1fae-48a0-b69f-ec551af3b953 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:11.488444 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89795999-1fae-48a0-b69f-ec551af3b953 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:11.491161 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:11.494015 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befd3cf-1dc8-4d0e-952e-56973f15169f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:11.494642 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befd3cf-1dc8-4d0e-952e-56973f15169f None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:11.494956 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befd3cf-1dc8-4d0e-952e-56973f15169f None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:11.495231 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befd3cf-1dc8-4d0e-952e-56973f15169f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:11.500766 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89795999-1fae-48a0-b69f-ec551af3b953 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:13:11.503301 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befd3cf-1dc8-4d0e-952e-56973f15169f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:11.504791 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befd3cf-1dc8-4d0e-952e-56973f15169f None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:11.505863 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-89795999-1fae-48a0-b69f-ec551af3b953 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:13:11.505863 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:11.505863 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:11.505863 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:11.505863 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:11.505863 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:11.505863 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:11.505863 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:11.505863 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:11.505863 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:11.505863 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:11.505863 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:11.505863 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:13:11.505863 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:13:11.505863 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:13:11.505863 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:13:11.506788 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:13:11.506788 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:13:11.506788 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:13:11.506788 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:13:11.506788 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:11.506788 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:11.506788 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:11.506788 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:11.506788 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:11.506788 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:11.506788 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:11.506788 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:11.506788 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:11.506788 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:11.506788 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:11.506788 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:11.507602 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:11.507602 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:11.507602 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:11.507602 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:11.507602 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:13:11.507602 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:13:11.507602 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:13:11.507602 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:13:11.507602 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:13:11.507602 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:13:11.507602 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:13:11.507602 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:11.507602 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 255/506] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Aug 23 22:13:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:11.508509 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89795999-1fae-48a0-b69f-ec551af3b953 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:11.519630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-8befd3cf-1dc8-4d0e-952e-56973f15169f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 22:13:11.519630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:11.519630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:11.519630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:11.519630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:11.519630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:11.519630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:11.519630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:11.519630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:11.519630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:11.519630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:11.519630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:11.519630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:13:11.519630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:13:11.519630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:13:11.519630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:13:11.520724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:11.520724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:11.520724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:13:11.520724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:11.520724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:13:11.520724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:11.520724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:11.520724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:11.520724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:11.520724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:11.520724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:11.520724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:11.520724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:11.520724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:11.520724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:11.520724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:11.520724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:11.520724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:11.521729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:11.521729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:11.521729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:13:11.521729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:13:11.521729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:13:11.521729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:13:11.521729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:13:11.521729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:13:11.521729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 22:13:11.521729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:11.521729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 252/507] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:13:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:11.521729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befd3cf-1dc8-4d0e-952e-56973f15169f None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:11.539028 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:11.616351 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89795999-1fae-48a0-b69f-ec551af3b953 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:11.629071 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befd3cf-1dc8-4d0e-952e-56973f15169f None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:11.651544 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a0578-6512-4cfc-a592-70c61841779b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:11.652177 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a0578-6512-4cfc-a592-70c61841779b None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:11.653030 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a0578-6512-4cfc-a592-70c61841779b None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:11.653505 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a0578-6512-4cfc-a592-70c61841779b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:11.664460 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e0c67-9769-4174-98a6-68e5ff99703c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:11.664979 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a0578-6512-4cfc-a592-70c61841779b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:11.665096 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e0c67-9769-4174-98a6-68e5ff99703c None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:11.665391 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e0c67-9769-4174-98a6-68e5ff99703c None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:11.665681 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e0c67-9769-4174-98a6-68e5ff99703c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:11.666489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a0578-6512-4cfc-a592-70c61841779b None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:11.673229 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e0c67-9769-4174-98a6-68e5ff99703c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:11.674735 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e0c67-9769-4174-98a6-68e5ff99703c None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:11.681465 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-a46a0578-6512-4cfc-a592-70c61841779b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:11.681465 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:11.681465 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:11.681465 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:11.681465 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:11.681465 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:11.681465 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:11.681465 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:11.681465 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:11.681465 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:11.681465 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:11.681465 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:11.681465 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:11.681465 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:11.681465 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:11.681465 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:11.682451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:11.682451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:11.682451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:11.682451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:11.682451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:11.682451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:11.682451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:11.682451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:11.682451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:11.682451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:11.682451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:11.682451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:11.682451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:11.682451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:11.682451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:11.682451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:11.682451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:11.683294 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:11.683294 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:11.683294 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:11.683294 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 256/508] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:11.684139 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a0578-6512-4cfc-a592-70c61841779b None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:11.688383 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-109e0c67-9769-4174-98a6-68e5ff99703c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:11.688383 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:11.688383 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:11.688383 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:11.688383 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:11.688383 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:11.688383 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:11.688383 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:11.688383 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:11.688383 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:11.688383 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:11.688383 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:11.688383 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:13:11.688383 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:13:11.688383 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:13:11.689495 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:13:11.689495 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:11.689495 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:11.689495 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:11.689495 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:11.689495 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:11.689495 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:11.689495 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:11.689495 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:11.689495 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:11.689495 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:11.689495 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:11.689495 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:11.689495 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:11.689495 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:11.689495 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:11.689495 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:11.690442 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:13:11.690442 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:13:11.690442 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:13:11.690442 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:13:11.690442 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:13:11.690442 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:13:11.690442 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:11.690442 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:11.690442 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 253/509] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:11.690995 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e0c67-9769-4174-98a6-68e5ff99703c None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:11.747130 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:11.777548 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:11.806045 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e0c67-9769-4174-98a6-68e5ff99703c None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:11.810938 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a0578-6512-4cfc-a592-70c61841779b None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:11.846439 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db9001-5b85-4432-8d9d-25a68e70d41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:11.847056 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db9001-5b85-4432-8d9d-25a68e70d41a None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:11.847334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db9001-5b85-4432-8d9d-25a68e70d41a None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:11.847604 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db9001-5b85-4432-8d9d-25a68e70d41a None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:11.848277 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db9001-5b85-4432-8d9d-25a68e70d41a None admin] RBAC: Adding query filter params (name=service) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:11.848579 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db9001-5b85-4432-8d9d-25a68e70d41a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:11.849335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30db6e1-81ca-4f61-bf5a-3aeb4b481cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:11.850020 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30db6e1-81ca-4f61-bf5a-3aeb4b481cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:11.850136 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db9001-5b85-4432-8d9d-25a68e70d41a None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:11.850302 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30db6e1-81ca-4f61-bf5a-3aeb4b481cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:11.850573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30db6e1-81ca-4f61-bf5a-3aeb4b481cd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:11.859924 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 254/510] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Aug 23 22:13:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:11.860801 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db9001-5b85-4432-8d9d-25a68e70d41a None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:11.866048 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30db6e1-81ca-4f61-bf5a-3aeb4b481cd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:11.867541 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30db6e1-81ca-4f61-bf5a-3aeb4b481cd8 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:11.883342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-b30db6e1-81ca-4f61-bf5a-3aeb4b481cd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:11.883342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:11.883342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:11.883342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:11.883342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:11.883342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:11.883342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:11.883342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:11.883342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:11.883342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:11.883342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:11.883342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:11.883342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:11.883342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:11.883342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:11.883342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:11.884392 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:11.884392 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:11.884392 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:11.884392 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:11.884392 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:11.884392 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:11.884392 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:11.884392 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:11.884392 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:11.884392 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:11.884392 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:11.884392 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:11.884392 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:11.884392 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:11.884392 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:11.884392 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:11.884392 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:11.885287 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:11.885287 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:11.885287 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:11.885287 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 257/511] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:11.885552 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30db6e1-81ca-4f61-bf5a-3aeb4b481cd8 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:11.972183 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db9001-5b85-4432-8d9d-25a68e70d41a None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:11.992411 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:11.996050 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30db6e1-81ca-4f61-bf5a-3aeb4b481cd8 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:12.007464 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d62473-1ec5-435c-8b68-80c0bab06d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:12.008083 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d62473-1ec5-435c-8b68-80c0bab06d85 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:12.008360 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d62473-1ec5-435c-8b68-80c0bab06d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:12.008637 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d62473-1ec5-435c-8b68-80c0bab06d85 None admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:12.009397 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d62473-1ec5-435c-8b68-80c0bab06d85 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:12.009705 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d62473-1ec5-435c-8b68-80c0bab06d85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:12.011191 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d62473-1ec5-435c-8b68-80c0bab06d85 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:12.013202 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:12.032084 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 255/512] 10.222.0.77 () {56 vars in 1137 bytes} [Tue Aug 23 22:13:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:12.032807 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d62473-1ec5-435c-8b68-80c0bab06d85 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:12.033990 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddcbf55-b0aa-4ce6-b449-904ddd1561f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:12.034618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcbf55-b0aa-4ce6-b449-904ddd1561f7 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:12.034898 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcbf55-b0aa-4ce6-b449-904ddd1561f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:12.035172 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcbf55-b0aa-4ce6-b449-904ddd1561f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:12.035827 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddcbf55-b0aa-4ce6-b449-904ddd1561f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:12.036130 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddcbf55-b0aa-4ce6-b449-904ddd1561f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:12.037635 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddcbf55-b0aa-4ce6-b449-904ddd1561f7 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:12.052442 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 258/513] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:12.053096 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddcbf55-b0aa-4ce6-b449-904ddd1561f7 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:12.155141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d62473-1ec5-435c-8b68-80c0bab06d85 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:12.164607 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddcbf55-b0aa-4ce6-b449-904ddd1561f7 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:12.200669 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce541c-5330-4efd-9aa0-05b3f372677b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:12.201294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce541c-5330-4efd-9aa0-05b3f372677b None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:12.201607 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce541c-5330-4efd-9aa0-05b3f372677b None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:12.201876 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce541c-5330-4efd-9aa0-05b3f372677b None admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:12.202576 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce541c-5330-4efd-9aa0-05b3f372677b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:12.202885 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce541c-5330-4efd-9aa0-05b3f372677b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:12.204324 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce541c-5330-4efd-9aa0-05b3f372677b None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:12.209848 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df4b0a-b753-486e-85af-7d0f842dddf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:12.211006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df4b0a-b753-486e-85af-7d0f842dddf7 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:12.211158 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df4b0a-b753-486e-85af-7d0f842dddf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:12.211287 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df4b0a-b753-486e-85af-7d0f842dddf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:12.228025 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 256/514] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:13:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:12.229154 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df4b0a-b753-486e-85af-7d0f842dddf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:12.229465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce541c-5330-4efd-9aa0-05b3f372677b None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:12.232402 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df4b0a-b753-486e-85af-7d0f842dddf7 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:12.250004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-11df4b0a-b753-486e-85af-7d0f842dddf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:12.250004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:12.250004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:12.250004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:12.250004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:12.250004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:12.250004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:12.250004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:12.250004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:12.250004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:12.250004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:12.250004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:12.250004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:12.250004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:12.250004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:12.250004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:12.251455 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:12.251455 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:12.251455 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:12.251455 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:12.251455 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:12.251455 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:12.251455 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:12.251455 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:12.251455 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:12.251455 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:12.251455 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:12.251455 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:12.251455 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:12.251455 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:12.251455 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:12.251455 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:12.251455 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:12.252384 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:12.252384 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:12.252384 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:12.252384 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 259/515] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:12.252384 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df4b0a-b753-486e-85af-7d0f842dddf7 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:12.268074 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:12.312479 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:12.362136 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df4b0a-b753-486e-85af-7d0f842dddf7 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:12.362703 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce541c-5330-4efd-9aa0-05b3f372677b None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:12.398141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e526a-7d0d-4a35-a079-f0cff421f563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:12.398878 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e526a-7d0d-4a35-a079-f0cff421f563 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:12.399223 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e526a-7d0d-4a35-a079-f0cff421f563 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:12.399563 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e526a-7d0d-4a35-a079-f0cff421f563 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:12.403454 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902810da-1a1b-43b0-92a7-ced5c733628c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:12.404109 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902810da-1a1b-43b0-92a7-ced5c733628c None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:12.404382 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902810da-1a1b-43b0-92a7-ced5c733628c None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:12.404652 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902810da-1a1b-43b0-92a7-ced5c733628c None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:12.405492 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902810da-1a1b-43b0-92a7-ced5c733628c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:12.409756 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902810da-1a1b-43b0-92a7-ced5c733628c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:12.412309 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902810da-1a1b-43b0-92a7-ced5c733628c None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:12.425653 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 257/516] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:12.426744 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902810da-1a1b-43b0-92a7-ced5c733628c None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:12.474940 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e526a-7d0d-4a35-a079-f0cff421f563 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:12.476503 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e526a-7d0d-4a35-a079-f0cff421f563 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:12.491454 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:12.533781 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902810da-1a1b-43b0-92a7-ced5c733628c None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:12.547655 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:12.570885 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6b8c5-a50a-40c3-b072-f03b8cd55c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:12.571527 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6b8c5-a50a-40c3-b072-f03b8cd55c6f None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:12.571815 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6b8c5-a50a-40c3-b072-f03b8cd55c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:12.572091 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6b8c5-a50a-40c3-b072-f03b8cd55c6f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:12.580581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6b8c5-a50a-40c3-b072-f03b8cd55c6f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:12.582080 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6b8c5-a50a-40c3-b072-f03b8cd55c6f None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:12.582700 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 260/517] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:13:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:13:12.583548 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e526a-7d0d-4a35-a079-f0cff421f563 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:12.593489 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-52c6b8c5-a50a-40c3-b072-f03b8cd55c6f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 22:13:12.593489 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:12.593489 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:12.593489 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:12.593489 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:12.593489 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:12.593489 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:12.593489 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:12.593489 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:12.593489 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:12.593489 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:12.593489 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:12.593489 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:13:12.593489 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:13:12.593489 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:13:12.593489 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:13:12.594432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:12.594432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:12.594432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:13:12.594432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:12.594432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:13:12.594432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:12.594432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:12.594432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:12.594432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:12.594432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:12.594432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:12.594432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:12.594432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:12.594432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:12.594432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:12.594432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:12.594432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:12.594432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:12.595315 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:12.595315 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:12.595315 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:13:12.595315 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:13:12.595315 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:13:12.595315 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:13:12.595315 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:13:12.595315 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:13:12.595315 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 22:13:12.595315 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:12.595315 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 258/518] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:13:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:12.595897 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6b8c5-a50a-40c3-b072-f03b8cd55c6f None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:12.693700 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e526a-7d0d-4a35-a079-f0cff421f563 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:12.696533 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6b8c5-a50a-40c3-b072-f03b8cd55c6f None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:12.708046 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:12.729309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244f051-a14c-48e5-81e2-63a7fe93930d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:12.729951 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244f051-a14c-48e5-81e2-63a7fe93930d None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:12.730225 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244f051-a14c-48e5-81e2-63a7fe93930d None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:12.730527 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244f051-a14c-48e5-81e2-63a7fe93930d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:12.731246 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244f051-a14c-48e5-81e2-63a7fe93930d None admin] RBAC: Adding query filter params (role.id=fb1c5c0f0edb47bf828f63bc685f98ba, scope.project.id=da9a86463d68412884746b115667d2fc, user.id=1a0af5bf009b48a8915c7320b16d08dd) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:12.731551 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244f051-a14c-48e5-81e2-63a7fe93930d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:12.732181 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a66de-6f25-40ea-9ffc-d3c1754eb50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:12.732809 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a66de-6f25-40ea-9ffc-d3c1754eb50e None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:12.733093 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a66de-6f25-40ea-9ffc-d3c1754eb50e None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:12.733191 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244f051-a14c-48e5-81e2-63a7fe93930d None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:12.733685 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a66de-6f25-40ea-9ffc-d3c1754eb50e None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:12.734069 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a66de-6f25-40ea-9ffc-d3c1754eb50e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:12.734377 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a66de-6f25-40ea-9ffc-d3c1754eb50e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:12.736004 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a66de-6f25-40ea-9ffc-d3c1754eb50e None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:12.739091 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 261/519] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:13:12 2022] GET /identity/v3/role_assignments?user.id=1a0af5bf009b48a8915c7320b16d08dd&scope.project.id=da9a86463d68412884746b115667d2fc&role.id=fb1c5c0f0edb47bf828f63bc685f98ba => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:12.739884 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244f051-a14c-48e5-81e2-63a7fe93930d None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:12.757101 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 259/520] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:12.757101 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a66de-6f25-40ea-9ffc-d3c1754eb50e None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:12.800851 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:12.864970 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244f051-a14c-48e5-81e2-63a7fe93930d None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:12.888728 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a66de-6f25-40ea-9ffc-d3c1754eb50e None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:12.906485 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3f704-80fa-4f30-aaa4-3ff222260126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:12.907093 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3f704-80fa-4f30-aaa4-3ff222260126 None admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:12.907373 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3f704-80fa-4f30-aaa4-3ff222260126 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:12.907645 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3f704-80fa-4f30-aaa4-3ff222260126 None admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:12.908290 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3f704-80fa-4f30-aaa4-3ff222260126 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:12.909764 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3f704-80fa-4f30-aaa4-3ff222260126 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:12.928688 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30890af-da0e-440e-aafa-e24d923fea34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:12.929352 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30890af-da0e-440e-aafa-e24d923fea34 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:12.929705 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30890af-da0e-440e-aafa-e24d923fea34 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:12.930017 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30890af-da0e-440e-aafa-e24d923fea34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:12.935434 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 262/521] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Aug 23 22:13:12 2022] POST /identity/v3/users => generated 247 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:13:12.936509 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3f704-80fa-4f30-aaa4-3ff222260126 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:12.942316 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30890af-da0e-440e-aafa-e24d923fea34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:12.943832 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30890af-da0e-440e-aafa-e24d923fea34 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:12.963534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-d30890af-da0e-440e-aafa-e24d923fea34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:12.963534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:12.963534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:12.963534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:12.963534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:12.963534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:12.963534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:12.963534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:12.963534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:12.963534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:12.963534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:12.963534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:12.963534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:12.963534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:12.963534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:12.963534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:12.964557 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:12.964557 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:12.964557 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:12.964557 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:12.964557 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:12.964557 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:12.964557 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:12.964557 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:12.964557 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:12.964557 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:12.964557 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:12.964557 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:12.964557 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:12.964557 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:12.964557 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:12.964557 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:12.964557 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:12.966719 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:12.966719 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:12.966719 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:12.966719 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 260/522] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:12.967080 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30890af-da0e-440e-aafa-e24d923fea34 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:13.007325 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:13.084739 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:13.103435 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3f704-80fa-4f30-aaa4-3ff222260126 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:13.106544 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30890af-da0e-440e-aafa-e24d923fea34 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:13.146483 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6ed14-5061-42a3-b04c-d497cc222d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:13.147381 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6ed14-5061-42a3-b04c-d497cc222d2a None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:13.147561 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd08c8c-3c44-41fe-b1cf-52297b470ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:13.147971 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6ed14-5061-42a3-b04c-d497cc222d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:13.148172 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd08c8c-3c44-41fe-b1cf-52297b470ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:13.148446 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd08c8c-3c44-41fe-b1cf-52297b470ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:13.148714 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd08c8c-3c44-41fe-b1cf-52297b470ee2 None admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:13.148821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6ed14-5061-42a3-b04c-d497cc222d2a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:13.149499 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd08c8c-3c44-41fe-b1cf-52297b470ee2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:13.149775 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd08c8c-3c44-41fe-b1cf-52297b470ee2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:13.151941 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd08c8c-3c44-41fe-b1cf-52297b470ee2 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:13.159924 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6ed14-5061-42a3-b04c-d497cc222d2a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:13.161666 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6ed14-5061-42a3-b04c-d497cc222d2a None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:13.176930 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-b6e6ed14-5061-42a3-b04c-d497cc222d2a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 22:13:13.176930 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:13.176930 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:13.176930 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:13.176930 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:13.176930 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:13.176930 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:13.176930 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:13.176930 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:13.176930 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:13.176930 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:13.176930 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:13.176930 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:13:13.176930 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:13:13.176930 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:13:13.176930 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:13:13.177953 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:13.177953 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:13.177953 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:13:13.177953 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:13.177953 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:13:13.177953 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:13.177953 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:13.177953 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:13.177953 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:13.177953 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:13.177953 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:13.177953 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:13.177953 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:13.177953 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:13.177953 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:13.177953 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:13.177953 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:13.177953 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:13.179011 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:13.179011 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:13.179011 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:13:13.179011 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:13:13.179011 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:13:13.179011 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:13:13.179011 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:13:13.179011 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:13:13.179011 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 22:13:13.179011 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:13.179011 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 261/523] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Aug 23 22:13:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:13.179011 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6ed14-5061-42a3-b04c-d497cc222d2a None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:13.203958 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 263/524] 10.222.0.77 () {56 vars in 1137 bytes} [Tue Aug 23 22:13:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:13.204851 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd08c8c-3c44-41fe-b1cf-52297b470ee2 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:13.315397 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6ed14-5061-42a3-b04c-d497cc222d2a None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:13.328807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:13.349820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd08c8c-3c44-41fe-b1cf-52297b470ee2 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:13.364378 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856c0b8-b8cc-40a9-9e16-e79f9cc06475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:13.365755 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856c0b8-b8cc-40a9-9e16-e79f9cc06475 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:13.366301 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856c0b8-b8cc-40a9-9e16-e79f9cc06475 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:13.366769 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856c0b8-b8cc-40a9-9e16-e79f9cc06475 None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:13.367693 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856c0b8-b8cc-40a9-9e16-e79f9cc06475 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:13.368193 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856c0b8-b8cc-40a9-9e16-e79f9cc06475 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:13.369818 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856c0b8-b8cc-40a9-9e16-e79f9cc06475 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:13.392514 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 262/525] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:13.393694 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856c0b8-b8cc-40a9-9e16-e79f9cc06475 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:13.399111 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:13.408405 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade199c-b6c1-4d7a-aee7-c64746595f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:13.409473 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade199c-b6c1-4d7a-aee7-c64746595f6b None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:13.409983 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade199c-b6c1-4d7a-aee7-c64746595f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:13.410462 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade199c-b6c1-4d7a-aee7-c64746595f6b None admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:13.411413 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade199c-b6c1-4d7a-aee7-c64746595f6b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:13.411918 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade199c-b6c1-4d7a-aee7-c64746595f6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:13.413696 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade199c-b6c1-4d7a-aee7-c64746595f6b None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:13.445078 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 264/526] 10.222.0.77 () {56 vars in 1139 bytes} [Tue Aug 23 22:13:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:13.445078 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade199c-b6c1-4d7a-aee7-c64746595f6b None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:13.528183 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856c0b8-b8cc-40a9-9e16-e79f9cc06475 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:13.569706 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77363c5-cf68-4f75-843f-d464157ac0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:13.570673 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77363c5-cf68-4f75-843f-d464157ac0a8 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:13.571155 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77363c5-cf68-4f75-843f-d464157ac0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:13.571626 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77363c5-cf68-4f75-843f-d464157ac0a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:13.587966 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade199c-b6c1-4d7a-aee7-c64746595f6b None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:13.637407 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13027d9-3735-4d1e-8306-a38ed5125226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:13.638445 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13027d9-3735-4d1e-8306-a38ed5125226 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:13.638910 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13027d9-3735-4d1e-8306-a38ed5125226 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:13.639358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13027d9-3735-4d1e-8306-a38ed5125226 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:13.647103 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13027d9-3735-4d1e-8306-a38ed5125226 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:13.648838 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13027d9-3735-4d1e-8306-a38ed5125226 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:13.660274 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77363c5-cf68-4f75-843f-d464157ac0a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:13.661708 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77363c5-cf68-4f75-843f-d464157ac0a8 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:13.664422 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:13.666573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-e13027d9-3735-4d1e-8306-a38ed5125226 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:13.666573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:13.666573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:13.666573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:13.666573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:13.666573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:13.666573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:13.666573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:13.666573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:13.666573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:13.666573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:13.666573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:13.666573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:13:13.666573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:13:13.666573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:13:13.667531 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:13:13.667531 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:13.667531 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:13.667531 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:13.667531 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:13.667531 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:13.667531 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:13.667531 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:13.667531 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:13.667531 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:13.667531 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:13.667531 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:13.667531 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:13.667531 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:13.667531 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:13.667531 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:13.667531 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:13.668481 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:13:13.668481 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:13:13.668481 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:13:13.668481 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:13:13.668481 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:13:13.668481 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:13:13.668481 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:13.668481 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:13.670719 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 265/527] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:13.671842 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13027d9-3735-4d1e-8306-a38ed5125226 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:13.685863 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:13.801817 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 263/528] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:13:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:13:13.803195 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77363c5-cf68-4f75-843f-d464157ac0a8 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:13.809542 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13027d9-3735-4d1e-8306-a38ed5125226 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:13.860080 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0bb04-2b86-4d4f-aad0-7d6df2871f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:13.860714 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0bb04-2b86-4d4f-aad0-7d6df2871f39 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:13.860991 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0bb04-2b86-4d4f-aad0-7d6df2871f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:13.861257 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0bb04-2b86-4d4f-aad0-7d6df2871f39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:13.940710 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77363c5-cf68-4f75-843f-d464157ac0a8 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:13.944382 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:13.956275 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0bb04-2b86-4d4f-aad0-7d6df2871f39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:13.958161 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0bb04-2b86-4d4f-aad0-7d6df2871f39 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:13.969174 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:13.997927 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94f5a1-fe2b-4859-a145-ffb649fb7600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:13.998545 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94f5a1-fe2b-4859-a145-ffb649fb7600 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:13.998823 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94f5a1-fe2b-4859-a145-ffb649fb7600 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:13.999091 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94f5a1-fe2b-4859-a145-ffb649fb7600 None admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:14.000071 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e94f5a1-fe2b-4859-a145-ffb649fb7600 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:14.000379 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e94f5a1-fe2b-4859-a145-ffb649fb7600 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:14.002543 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e94f5a1-fe2b-4859-a145-ffb649fb7600 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:14.021913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 264/529] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:13:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:14.023330 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94f5a1-fe2b-4859-a145-ffb649fb7600 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:14.086927 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 266/530] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:13:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:13:14.088021 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0bb04-2b86-4d4f-aad0-7d6df2871f39 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:14.146167 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94f5a1-fe2b-4859-a145-ffb649fb7600 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:14.184907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ecda4a-15c8-407d-8496-0b205ce1f1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:14.185678 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecda4a-15c8-407d-8496-0b205ce1f1a9 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:14.185964 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecda4a-15c8-407d-8496-0b205ce1f1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:14.186242 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecda4a-15c8-407d-8496-0b205ce1f1a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:14.198565 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ecda4a-15c8-407d-8496-0b205ce1f1a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:14.200141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0bb04-2b86-4d4f-aad0-7d6df2871f39 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:14.200959 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ecda4a-15c8-407d-8496-0b205ce1f1a9 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:14.211526 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:14.218209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-d1ecda4a-15c8-407d-8496-0b205ce1f1a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:14.218209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:14.218209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:14.218209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:14.218209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:14.218209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:14.218209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:14.218209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:14.218209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:14.218209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:14.218209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:14.218209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:14.218209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:14.218209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:14.218209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:14.218209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:14.219395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:14.219395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:14.219395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:14.219395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:14.219395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:14.219395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:14.219395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:14.219395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:14.219395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:14.219395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:14.219395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:14.219395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:14.219395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:14.219395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:14.219395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:14.219395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:14.219395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:14.220412 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:14.220412 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:14.220412 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:14.220412 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 265/531] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:14.220638 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ecda4a-15c8-407d-8496-0b205ce1f1a9 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:14.240827 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:14.246576 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee3004-2b76-49e1-be62-e380d7044d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:14.247600 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee3004-2b76-49e1-be62-e380d7044d39 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:14.248027 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee3004-2b76-49e1-be62-e380d7044d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:14.248557 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee3004-2b76-49e1-be62-e380d7044d39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:14.249566 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee3004-2b76-49e1-be62-e380d7044d39 None admin] RBAC: Adding query filter params (role.id=fb1c5c0f0edb47bf828f63bc685f98ba, scope.project.id=da9a86463d68412884746b115667d2fc, user.id=855cbc7a992d4c6697632d2d4d74abfb) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:14.250046 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee3004-2b76-49e1-be62-e380d7044d39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:14.251636 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee3004-2b76-49e1-be62-e380d7044d39 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:14.258112 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 267/532] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:13:14 2022] GET /identity/v3/role_assignments?user.id=855cbc7a992d4c6697632d2d4d74abfb&scope.project.id=da9a86463d68412884746b115667d2fc&role.id=fb1c5c0f0edb47bf828f63bc685f98ba => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:14.259178 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee3004-2b76-49e1-be62-e380d7044d39 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:14.408655 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ecda4a-15c8-407d-8496-0b205ce1f1a9 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:14.469696 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6046d-8903-4173-902a-6c8745f5e2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:14.471361 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6046d-8903-4173-902a-6c8745f5e2cf None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:14.471799 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6046d-8903-4173-902a-6c8745f5e2cf None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:14.472465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6046d-8903-4173-902a-6c8745f5e2cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:14.488726 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6046d-8903-4173-902a-6c8745f5e2cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:14.491458 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6046d-8903-4173-902a-6c8745f5e2cf None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:14.515472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-73d6046d-8903-4173-902a-6c8745f5e2cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:14.515472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:14.515472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:14.515472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:14.515472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:14.515472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:14.515472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:14.515472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:14.515472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:14.515472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:14.515472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:14.515472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:14.515472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:14.515472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:14.515472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:14.515472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:14.516649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:14.516649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:14.516649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:14.516649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:14.516649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:14.516649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:14.516649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:14.516649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:14.516649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:14.516649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:14.516649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:14.516649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:14.516649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:14.516649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:14.516649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:14.516649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:14.516649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:14.517737 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:14.517737 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:14.517737 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:14.519678 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 266/533] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:14.526356 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6046d-8903-4173-902a-6c8745f5e2cf None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:14.560237 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee3004-2b76-49e1-be62-e380d7044d39 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:14.629966 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcef86e-0a56-4b1b-9ea9-80413c3670d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:14.630636 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcef86e-0a56-4b1b-9ea9-80413c3670d7 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:14.630847 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcef86e-0a56-4b1b-9ea9-80413c3670d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:14.631114 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcef86e-0a56-4b1b-9ea9-80413c3670d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:14.631771 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcef86e-0a56-4b1b-9ea9-80413c3670d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:14.632073 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcef86e-0a56-4b1b-9ea9-80413c3670d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:14.633518 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcef86e-0a56-4b1b-9ea9-80413c3670d7 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:14.653287 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:14.657488 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 268/534] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:14.665784 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcef86e-0a56-4b1b-9ea9-80413c3670d7 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:14.712237 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6046d-8903-4173-902a-6c8745f5e2cf None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:14.750932 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:14.765834 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc022a2-068b-43d3-a5f4-73ff755e48ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:14.766745 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc022a2-068b-43d3-a5f4-73ff755e48ae None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:14.768302 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc022a2-068b-43d3-a5f4-73ff755e48ae None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:14.768743 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc022a2-068b-43d3-a5f4-73ff755e48ae None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:14.769666 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc022a2-068b-43d3-a5f4-73ff755e48ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:14.770125 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc022a2-068b-43d3-a5f4-73ff755e48ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:14.771808 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc022a2-068b-43d3-a5f4-73ff755e48ae None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:14.792742 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 267/535] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:14.800235 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc022a2-068b-43d3-a5f4-73ff755e48ae None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:14.887874 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcef86e-0a56-4b1b-9ea9-80413c3670d7 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:14.928386 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590927d8-b4e2-41ad-b5ec-8be29ff92393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:14.929277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590927d8-b4e2-41ad-b5ec-8be29ff92393 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:14.929726 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590927d8-b4e2-41ad-b5ec-8be29ff92393 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:14.930139 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590927d8-b4e2-41ad-b5ec-8be29ff92393 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:14.939131 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590927d8-b4e2-41ad-b5ec-8be29ff92393 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:14.940851 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590927d8-b4e2-41ad-b5ec-8be29ff92393 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:14.955078 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-590927d8-b4e2-41ad-b5ec-8be29ff92393 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:14.955078 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:14.955078 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:14.955078 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:14.955078 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:14.955078 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:14.955078 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:14.955078 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:14.955078 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:14.955078 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:14.955078 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:14.955078 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:14.955078 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:13:14.955078 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:13:14.955078 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:13:14.956183 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:13:14.956183 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:14.956183 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:14.956183 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:14.956183 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:14.956183 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:14.956183 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:14.956183 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:14.956183 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:14.956183 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:14.956183 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:14.956183 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:14.956183 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:14.956183 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:14.956183 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:14.956183 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:14.956183 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:14.957235 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:13:14.957235 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:13:14.957235 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:13:14.957235 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:13:14.957235 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:13:14.957235 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:13:14.957235 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:14.957235 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:14.963744 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 269/536] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:14.966303 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b94db1-e032-4e38-b739-3463eab2cba6 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:14.966767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b94db1-e032-4e38-b739-3463eab2cba6 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:14.967201 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b94db1-e032-4e38-b739-3463eab2cba6 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:14.969278 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 270/537] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:14.970339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b94db1-e032-4e38-b739-3463eab2cba6 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:15.010028 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc022a2-068b-43d3-a5f4-73ff755e48ae None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:15.060073 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:15.063104 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc8cad-440b-48f2-bf7a-8447e658db4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:15.064563 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc8cad-440b-48f2-bf7a-8447e658db4a None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:15.065197 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc8cad-440b-48f2-bf7a-8447e658db4a None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:15.066091 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc8cad-440b-48f2-bf7a-8447e658db4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:15.079651 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc8cad-440b-48f2-bf7a-8447e658db4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:15.081546 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc8cad-440b-48f2-bf7a-8447e658db4a None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:15.104188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-e9bc8cad-440b-48f2-bf7a-8447e658db4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:15.104188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:15.104188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:15.104188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:15.104188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:15.104188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:15.104188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:15.104188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:15.104188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:15.104188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:15.104188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:15.104188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:15.104188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:13:15.104188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:13:15.104188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:13:15.106117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:13:15.106117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:15.106117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:15.106117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:15.106117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:15.106117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:15.106117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:15.106117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:15.106117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:15.106117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:15.106117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:15.106117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:15.106117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:15.106117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:15.106117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:15.106117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:15.106117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:15.107179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:13:15.107179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:13:15.107179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:13:15.107179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:13:15.107179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:13:15.107179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:13:15.107179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:15.107179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:15.113276 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 268/538] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:15.115124 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244359d8-1398-49ac-b0b4-1dbcc3be1524 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:15.115413 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244359d8-1398-49ac-b0b4-1dbcc3be1524 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:15.115689 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244359d8-1398-49ac-b0b4-1dbcc3be1524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:15.127942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:15.143223 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-244359d8-1398-49ac-b0b4-1dbcc3be1524 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:15.144721 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-244359d8-1398-49ac-b0b4-1dbcc3be1524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:15.145980 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b94db1-e032-4e38-b739-3463eab2cba6 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:15.203582 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ca305-23ac-4cfe-8329-2c0230154d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:15.204497 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ca305-23ac-4cfe-8329-2c0230154d52 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:15.204782 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ca305-23ac-4cfe-8329-2c0230154d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:15.205555 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ca305-23ac-4cfe-8329-2c0230154d52 None admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:15.205927 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ca305-23ac-4cfe-8329-2c0230154d52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:15.206441 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ca305-23ac-4cfe-8329-2c0230154d52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:15.209067 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ca305-23ac-4cfe-8329-2c0230154d52 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:15.238087 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 271/539] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:13:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:15.249566 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 269/540] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:13:15.249809 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ca305-23ac-4cfe-8329-2c0230154d52 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:15.249937 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a69bed-acfc-447a-84f6-80c97334cc74 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:15.250512 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a69bed-acfc-447a-84f6-80c97334cc74 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:15.250694 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a69bed-acfc-447a-84f6-80c97334cc74 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:15.253450 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 270/541] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:15 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:15.254950 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a69bed-acfc-447a-84f6-80c97334cc74 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:15.426717 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a69bed-acfc-447a-84f6-80c97334cc74 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:15.445980 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ca305-23ac-4cfe-8329-2c0230154d52 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:15.454305 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:15.487369 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2ffb6-e584-4e83-b336-40d173253880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:15.488716 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2ffb6-e584-4e83-b336-40d173253880 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:15.489212 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2ffb6-e584-4e83-b336-40d173253880 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:15.489741 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2ffb6-e584-4e83-b336-40d173253880 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:15.490699 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2ffb6-e584-4e83-b336-40d173253880 None admin] RBAC: Adding query filter params (role.id=fb1c5c0f0edb47bf828f63bc685f98ba, scope.project.id=da9a86463d68412884746b115667d2fc, user.id=99f6180d62a2415ca4bb7ad55fe33c5b) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:15.491291 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2ffb6-e584-4e83-b336-40d173253880 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:15.493083 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2ffb6-e584-4e83-b336-40d173253880 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:15.500351 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bb674-c756-46c6-922b-df4a7f58c358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:15.501043 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bb674-c756-46c6-922b-df4a7f58c358 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:15.501324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bb674-c756-46c6-922b-df4a7f58c358 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:15.501652 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bb674-c756-46c6-922b-df4a7f58c358 None admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:15.502369 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bb674-c756-46c6-922b-df4a7f58c358 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:15.502672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bb674-c756-46c6-922b-df4a7f58c358 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:15.504200 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bb674-c756-46c6-922b-df4a7f58c358 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:15.505006 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 271/542] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:13:15 2022] GET /identity/v3/role_assignments?user.id=99f6180d62a2415ca4bb7ad55fe33c5b&scope.project.id=da9a86463d68412884746b115667d2fc&role.id=fb1c5c0f0edb47bf828f63bc685f98ba => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:15.506798 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7cc760-0b7e-4fc7-9387-6a4ff42840ec None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:15.507326 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7cc760-0b7e-4fc7-9387-6a4ff42840ec None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:15.507803 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7cc760-0b7e-4fc7-9387-6a4ff42840ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:15.542280 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-cd7cc760-0b7e-4fc7-9387-6a4ff42840ec None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:15.542667 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 272/543] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:13:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:15.546560 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-cd7cc760-0b7e-4fc7-9387-6a4ff42840ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:15.549322 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bb674-c756-46c6-922b-df4a7f58c358 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:15.608256 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:15.688611 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 272/544] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:13:15.689522 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7cc760-0b7e-4fc7-9387-6a4ff42840ec None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:15.731938 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bb674-c756-46c6-922b-df4a7f58c358 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:15.790208 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867c7ec-ffc9-44d0-98f6-ec3641f2fbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:15.791532 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867c7ec-ffc9-44d0-98f6-ec3641f2fbd1 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:15.792316 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867c7ec-ffc9-44d0-98f6-ec3641f2fbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:15.794604 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867c7ec-ffc9-44d0-98f6-ec3641f2fbd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:15.796474 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867c7ec-ffc9-44d0-98f6-ec3641f2fbd1 None admin] RBAC: Adding query filter params (role.id=fb1c5c0f0edb47bf828f63bc685f98ba, scope.project.id=da9a86463d68412884746b115667d2fc, user.id=84ea6fbc3de84b7db9e62b9ee6055c52) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:15.797395 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867c7ec-ffc9-44d0-98f6-ec3641f2fbd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:15.801148 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867c7ec-ffc9-44d0-98f6-ec3641f2fbd1 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:15.816559 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 273/545] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:13:15 2022] GET /identity/v3/role_assignments?user.id=84ea6fbc3de84b7db9e62b9ee6055c52&scope.project.id=da9a86463d68412884746b115667d2fc&role.id=fb1c5c0f0edb47bf828f63bc685f98ba => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:13:15.871608 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7cc760-0b7e-4fc7-9387-6a4ff42840ec None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:15.890166 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:15.920188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87961bb4-8791-4d8a-8f27-22c83f32693e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:15.921294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87961bb4-8791-4d8a-8f27-22c83f32693e None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:15.921889 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87961bb4-8791-4d8a-8f27-22c83f32693e None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:15.922386 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87961bb4-8791-4d8a-8f27-22c83f32693e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:15.937166 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87961bb4-8791-4d8a-8f27-22c83f32693e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:13:15.942745 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-87961bb4-8791-4d8a-8f27-22c83f32693e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:13:15.942745 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:15.942745 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:15.942745 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:15.942745 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:15.942745 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:15.942745 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:15.942745 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:15.942745 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:15.942745 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:15.942745 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:15.942745 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:15.942745 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:13:15.942745 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:13:15.942745 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:13:15.942745 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:13:15.943686 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:13:15.943686 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:13:15.943686 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:13:15.943686 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:13:15.943686 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:15.943686 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:15.943686 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:15.943686 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:15.943686 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:15.943686 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:15.943686 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:15.943686 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:15.943686 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:15.943686 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:15.943686 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:15.943686 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:15.944482 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:15.944482 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:15.944482 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:15.944482 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:15.944482 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:13:15.944482 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:13:15.944482 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:13:15.944482 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:13:15.944482 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:13:15.944482 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:13:15.944482 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:13:15.944482 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:15.947907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 273/546] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Aug 23 22:13:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:15.956169 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867c7ec-ffc9-44d0-98f6-ec3641f2fbd1 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:16.170129 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:16.208352 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867c7ec-ffc9-44d0-98f6-ec3641f2fbd1 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:16.273543 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054fb09f-a56a-4223-b9f5-acf8b8d07316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:16.274601 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fb09f-a56a-4223-b9f5-acf8b8d07316 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:16.275185 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fb09f-a56a-4223-b9f5-acf8b8d07316 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:16.275686 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fb09f-a56a-4223-b9f5-acf8b8d07316 None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:16.276675 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054fb09f-a56a-4223-b9f5-acf8b8d07316 None admin] RBAC: Adding query filter params (name=service) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:16.277815 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054fb09f-a56a-4223-b9f5-acf8b8d07316 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:16.279643 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054fb09f-a56a-4223-b9f5-acf8b8d07316 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:16.295466 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 274/547] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Aug 23 22:13:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:13:16.304361 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87961bb4-8791-4d8a-8f27-22c83f32693e None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:16.385319 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054fb09f-a56a-4223-b9f5-acf8b8d07316 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:16.619195 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054fb09f-a56a-4223-b9f5-acf8b8d07316 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:16.681070 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87961bb4-8791-4d8a-8f27-22c83f32693e None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:16.697526 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adbfe3-6393-43a6-b426-9095cf69c308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:16.698176 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adbfe3-6393-43a6-b426-9095cf69c308 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:16.698451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adbfe3-6393-43a6-b426-9095cf69c308 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:16.698771 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adbfe3-6393-43a6-b426-9095cf69c308 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:16.713981 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:16.724345 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2adbfe3-6393-43a6-b426-9095cf69c308 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:13:16.753685 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-a2adbfe3-6393-43a6-b426-9095cf69c308 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:13:16.753685 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:16.753685 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:16.753685 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:16.753685 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:16.753685 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:16.753685 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:16.753685 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:16.753685 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:16.753685 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:16.753685 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:16.753685 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:16.753685 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:13:16.753685 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:13:16.753685 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:13:16.753685 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:13:16.756278 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:13:16.756278 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:13:16.756278 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:13:16.756278 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:13:16.756278 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:16.756278 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:16.756278 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:16.756278 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:16.756278 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:16.756278 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:16.756278 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:16.756278 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:16.756278 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:16.756278 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:16.756278 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:16.756278 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:16.759267 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:16.759267 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:16.759267 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:16.759267 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:16.759267 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:13:16.759267 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:13:16.759267 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:13:16.759267 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:13:16.759267 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:13:16.759267 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:13:16.759267 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:13:16.759267 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:16.759267 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 275/548] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Aug 23 22:13:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:16.764659 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adbfe3-6393-43a6-b426-9095cf69c308 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:16.826590 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585d9b4-451a-4789-975b-53498563d588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:16.827711 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585d9b4-451a-4789-975b-53498563d588 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:16.828202 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585d9b4-451a-4789-975b-53498563d588 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:16.828690 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585d9b4-451a-4789-975b-53498563d588 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:16.853579 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585d9b4-451a-4789-975b-53498563d588 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:16.857004 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585d9b4-451a-4789-975b-53498563d588 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:16.888141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-b585d9b4-451a-4789-975b-53498563d588 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:16.888141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:16.888141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:16.888141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:16.888141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:16.888141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:16.888141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:16.888141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:16.888141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:16.888141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:16.888141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:16.888141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:16.888141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:16.888141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:16.888141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:16.888141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:16.890240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:16.890240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:16.890240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:16.890240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:16.890240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:16.890240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:16.890240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:16.890240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:16.890240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:16.890240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:16.890240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:16.890240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:16.890240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:16.890240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:16.890240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:16.890240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:16.890240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:16.893737 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:16.893737 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:16.893737 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:16.893737 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 274/549] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 587 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:16.900900 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585d9b4-451a-4789-975b-53498563d588 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:16.955530 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:17.059395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585d9b4-451a-4789-975b-53498563d588 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:17.072154 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adbfe3-6393-43a6-b426-9095cf69c308 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:17.111046 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896945c-265b-4a91-9d18-580423173107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:17.111757 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896945c-265b-4a91-9d18-580423173107 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:17.112214 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896945c-265b-4a91-9d18-580423173107 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:17.112619 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896945c-265b-4a91-9d18-580423173107 None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:17.113444 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896945c-265b-4a91-9d18-580423173107 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:17.113929 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896945c-265b-4a91-9d18-580423173107 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:17.115369 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896945c-265b-4a91-9d18-580423173107 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:17.136870 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 275/550] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:17.138990 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1165cf-4ee6-400f-9564-4522f4f78a8e None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:17.139262 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1165cf-4ee6-400f-9564-4522f4f78a8e None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:17.142072 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1165cf-4ee6-400f-9564-4522f4f78a8e None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:17.142467 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338b6c0-45e4-4d76-9ee6-65ee61045119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:17.142467 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338b6c0-45e4-4d76-9ee6-65ee61045119 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:17.142972 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338b6c0-45e4-4d76-9ee6-65ee61045119 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:17.143202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338b6c0-45e4-4d76-9ee6-65ee61045119 None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:17.144414 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338b6c0-45e4-4d76-9ee6-65ee61045119 None admin] RBAC: Adding query filter params (name=service) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:17.144942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338b6c0-45e4-4d76-9ee6-65ee61045119 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:17.146020 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 276/551] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:17.147208 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1165cf-4ee6-400f-9564-4522f4f78a8e None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:17.148012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338b6c0-45e4-4d76-9ee6-65ee61045119 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:17.165254 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 276/552] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Aug 23 22:13:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:17.167618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a333f-f9cd-48f2-9f58-de8f3b059fac None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:17.168915 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a333f-f9cd-48f2-9f58-de8f3b059fac None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:17.169458 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a333f-f9cd-48f2-9f58-de8f3b059fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:17.202028 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-0c6a333f-f9cd-48f2-9f58-de8f3b059fac None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:17.204059 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-0c6a333f-f9cd-48f2-9f58-de8f3b059fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:17.294003 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:17.325547 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:17.334305 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1165cf-4ee6-400f-9564-4522f4f78a8e None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:17.354071 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 277/553] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:13:17.356896 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a333f-f9cd-48f2-9f58-de8f3b059fac None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:17.421865 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafe835-8cb0-454a-bf04-f968d194e907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:17.422626 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafe835-8cb0-454a-bf04-f968d194e907 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:17.423254 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafe835-8cb0-454a-bf04-f968d194e907 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:17.423254 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafe835-8cb0-454a-bf04-f968d194e907 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:17.433358 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafe835-8cb0-454a-bf04-f968d194e907 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:17.436007 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafe835-8cb0-454a-bf04-f968d194e907 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:17.453957 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-6fafe835-8cb0-454a-bf04-f968d194e907 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:13:17.453957 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:17.453957 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:17.453957 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:17.453957 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:17.453957 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:17.453957 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:17.453957 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:17.453957 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:17.453957 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:17.453957 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:17.453957 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:17.453957 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:13:17.453957 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:13:17.453957 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:13:17.453957 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:13:17.455689 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:17.455689 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:17.455689 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:13:17.455689 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:17.455689 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:13:17.455689 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:17.455689 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:17.455689 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:17.455689 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:17.455689 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:17.455689 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:17.455689 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:17.455689 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:17.455689 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:17.455689 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:17.455689 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:17.455689 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:17.455689 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:17.457550 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:17.457550 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:17.457550 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:13:17.457550 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:13:17.457550 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:13:17.457550 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:13:17.457550 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:13:17.457550 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:13:17.457550 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:13:17.457550 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:17.457550 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 277/554] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Aug 23 22:13:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:17.461276 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafe835-8cb0-454a-bf04-f968d194e907 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:17.573964 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a333f-f9cd-48f2-9f58-de8f3b059fac None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:17.678120 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafe835-8cb0-454a-bf04-f968d194e907 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:17.707661 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e2974-a6e0-42ee-af42-50c840a05ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:17.708765 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e2974-a6e0-42ee-af42-50c840a05ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:17.709249 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e2974-a6e0-42ee-af42-50c840a05ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:17.709754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e2974-a6e0-42ee-af42-50c840a05ea7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:17.728676 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fbb292-f4ee-4667-bf2e-3bb7e4dabc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:17.729836 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbb292-f4ee-4667-bf2e-3bb7e4dabc2e None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:17.729836 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbb292-f4ee-4667-bf2e-3bb7e4dabc2e None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:17.730239 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbb292-f4ee-4667-bf2e-3bb7e4dabc2e None admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:17.731659 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fbb292-f4ee-4667-bf2e-3bb7e4dabc2e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:17.731821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fbb292-f4ee-4667-bf2e-3bb7e4dabc2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:17.736662 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fbb292-f4ee-4667-bf2e-3bb7e4dabc2e None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:17.756788 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 278/555] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Aug 23 22:13:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:17.758095 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e2974-a6e0-42ee-af42-50c840a05ea7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:17.759765 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e2974-a6e0-42ee-af42-50c840a05ea7 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:17.763578 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fbb292-f4ee-4667-bf2e-3bb7e4dabc2e None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:17.767026 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:17.796257 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-444e2974-a6e0-42ee-af42-50c840a05ea7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:17.796257 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:17.796257 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:17.796257 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:17.796257 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:17.796257 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:17.796257 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:17.796257 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:17.796257 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:17.796257 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:17.796257 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:17.796257 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:17.796257 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:17.796257 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:17.796257 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:17.796257 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:17.797553 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:17.797553 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:17.797553 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:17.797553 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:17.797553 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:17.797553 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:17.797553 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:17.797553 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:17.797553 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:17.797553 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:17.797553 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:17.797553 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:17.797553 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:17.797553 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:17.797553 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:17.797553 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:17.797553 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:17.798625 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:17.798625 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:17.798625 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:17.807033 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 278/556] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 452 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:17.818436 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e2974-a6e0-42ee-af42-50c840a05ea7 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:17.941167 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fbb292-f4ee-4667-bf2e-3bb7e4dabc2e None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:17.971460 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:17.987714 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c5e12-10a8-4c9d-b483-9ed8e43db888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:17.988478 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c5e12-10a8-4c9d-b483-9ed8e43db888 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:17.988857 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c5e12-10a8-4c9d-b483-9ed8e43db888 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:17.989280 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c5e12-10a8-4c9d-b483-9ed8e43db888 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:18.007674 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c5e12-10a8-4c9d-b483-9ed8e43db888 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:18.009473 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c5e12-10a8-4c9d-b483-9ed8e43db888 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:18.033389 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-cb6c5e12-10a8-4c9d-b483-9ed8e43db888 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:18.033389 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:18.033389 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:18.033389 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:18.033389 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:18.033389 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:18.033389 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:18.033389 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:18.033389 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:18.033389 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:18.033389 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:18.033389 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:18.033389 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:18.033389 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:18.033389 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:18.033389 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:18.034635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:18.034635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:18.034635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:18.034635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:18.034635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:18.034635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:18.034635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:18.034635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:18.034635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:18.034635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:18.034635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:18.034635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:18.034635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:18.034635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:18.034635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:18.034635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:18.034635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:18.036677 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:18.036677 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:18.036677 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:18.040239 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 279/557] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:18.041454 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c5e12-10a8-4c9d-b483-9ed8e43db888 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:18.117584 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e2974-a6e0-42ee-af42-50c840a05ea7 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:18.142021 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:18.167327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96deebe-5af7-4c2b-8dcf-9e462e8cc9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:18.168520 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96deebe-5af7-4c2b-8dcf-9e462e8cc9d1 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:18.168896 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96deebe-5af7-4c2b-8dcf-9e462e8cc9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:18.169343 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96deebe-5af7-4c2b-8dcf-9e462e8cc9d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:18.170387 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96deebe-5af7-4c2b-8dcf-9e462e8cc9d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:18.170703 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96deebe-5af7-4c2b-8dcf-9e462e8cc9d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:18.173478 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96deebe-5af7-4c2b-8dcf-9e462e8cc9d1 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:18.194415 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 279/558] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:18.195498 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96deebe-5af7-4c2b-8dcf-9e462e8cc9d1 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:18.233200 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c5e12-10a8-4c9d-b483-9ed8e43db888 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:18.296749 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844729f-c056-4a41-8368-097c01ad1bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:18.297850 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844729f-c056-4a41-8368-097c01ad1bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:18.298200 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844729f-c056-4a41-8368-097c01ad1bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:18.298563 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844729f-c056-4a41-8368-097c01ad1bb8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:18.317041 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844729f-c056-4a41-8368-097c01ad1bb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:13:18.325821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-5844729f-c056-4a41-8368-097c01ad1bb8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:13:18.325821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:18.325821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:18.325821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:18.325821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:18.325821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:18.325821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:18.325821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:18.325821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:18.325821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:18.325821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:18.325821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:18.325821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:13:18.325821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:13:18.325821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:13:18.325821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:13:18.327812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:13:18.327812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:13:18.327812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:13:18.327812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:13:18.327812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:18.327812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:18.327812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:18.327812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:18.327812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:18.327812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:18.327812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:18.327812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:18.327812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:18.327812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:18.327812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:18.327812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:18.335476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:18.335476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:18.335476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:18.335476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:18.335476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:13:18.335476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:13:18.335476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:13:18.335476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:13:18.335476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:13:18.335476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:13:18.335476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:13:18.335476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:18.335476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 280/559] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Aug 23 22:13:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:18.335476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844729f-c056-4a41-8368-097c01ad1bb8 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:18.398491 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96deebe-5af7-4c2b-8dcf-9e462e8cc9d1 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:18.402597 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:18.482067 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c63916-349c-4ec1-8998-2ee03a553508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:18.482572 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c63916-349c-4ec1-8998-2ee03a553508 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:18.483968 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c63916-349c-4ec1-8998-2ee03a553508 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:18.484539 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c63916-349c-4ec1-8998-2ee03a553508 None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:18.485826 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c63916-349c-4ec1-8998-2ee03a553508 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:18.486392 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c63916-349c-4ec1-8998-2ee03a553508 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:18.490138 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c63916-349c-4ec1-8998-2ee03a553508 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:18.518651 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 280/560] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:18.521968 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c63916-349c-4ec1-8998-2ee03a553508 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:18.551848 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844729f-c056-4a41-8368-097c01ad1bb8 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:18.576832 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:18.617949 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14bb02-3284-444d-b802-556a64cd1e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:18.619550 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14bb02-3284-444d-b802-556a64cd1e38 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:18.620295 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14bb02-3284-444d-b802-556a64cd1e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:18.621612 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14bb02-3284-444d-b802-556a64cd1e38 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:18.636522 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a14bb02-3284-444d-b802-556a64cd1e38 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:18.640632 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a14bb02-3284-444d-b802-556a64cd1e38 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:18.663907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-7a14bb02-3284-444d-b802-556a64cd1e38 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 22:13:18.663907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:18.663907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:18.663907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:18.663907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:18.663907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:18.663907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:18.663907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:18.663907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:18.663907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:18.663907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:18.663907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:18.663907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:13:18.663907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:13:18.663907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:13:18.663907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:13:18.665833 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:18.665833 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:18.665833 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:13:18.665833 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:18.665833 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:13:18.665833 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:18.665833 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:18.665833 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:18.665833 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:18.665833 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:18.665833 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:18.665833 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:18.665833 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:18.665833 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:18.665833 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:18.665833 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:18.665833 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:18.665833 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:18.667873 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:18.667873 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:18.667873 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:13:18.667873 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:13:18.667873 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:13:18.667873 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:13:18.667873 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:13:18.667873 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:13:18.667873 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 22:13:18.667873 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:18.673398 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 281/561] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:13:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:18.675357 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14bb02-3284-444d-b802-556a64cd1e38 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:18.746779 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c63916-349c-4ec1-8998-2ee03a553508 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:18.812270 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c34a8-8d12-48cc-9792-fbf71670bea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:18.814627 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c34a8-8d12-48cc-9792-fbf71670bea6 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:18.815445 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c34a8-8d12-48cc-9792-fbf71670bea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:18.816174 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c34a8-8d12-48cc-9792-fbf71670bea6 None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:18.817801 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c34a8-8d12-48cc-9792-fbf71670bea6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:18.818664 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c34a8-8d12-48cc-9792-fbf71670bea6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:18.821557 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c34a8-8d12-48cc-9792-fbf71670bea6 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:18.846723 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 281/562] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Aug 23 22:13:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:18.848719 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c34a8-8d12-48cc-9792-fbf71670bea6 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:18.882793 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14bb02-3284-444d-b802-556a64cd1e38 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:18.910115 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:18.935417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8b142-fc27-4fa2-826d-9c5be871b245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:18.936217 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8b142-fc27-4fa2-826d-9c5be871b245 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:18.936579 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8b142-fc27-4fa2-826d-9c5be871b245 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:18.937147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8b142-fc27-4fa2-826d-9c5be871b245 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:18.946139 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c8b142-fc27-4fa2-826d-9c5be871b245 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:18.947817 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c8b142-fc27-4fa2-826d-9c5be871b245 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:18.963487 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-70c8b142-fc27-4fa2-826d-9c5be871b245 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:18.963487 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:18.963487 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:18.963487 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:18.963487 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:18.963487 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:18.963487 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:18.963487 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:18.963487 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:18.963487 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:18.963487 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:18.963487 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:18.963487 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:13:18.963487 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:13:18.963487 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:13:18.965842 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:13:18.965842 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:18.965842 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:18.965842 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:18.965842 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:18.965842 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:18.965842 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:18.965842 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:18.965842 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:18.965842 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:18.965842 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:18.965842 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:18.965842 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:18.965842 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:18.965842 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:18.965842 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:18.965842 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:18.968229 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:13:18.968229 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:13:18.968229 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:13:18.968229 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:13:18.968229 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:13:18.968229 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:13:18.968229 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:18.968229 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:18.969709 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 282/563] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:18.970802 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8b142-fc27-4fa2-826d-9c5be871b245 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:19.017227 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:19.076177 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c34a8-8d12-48cc-9792-fbf71670bea6 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:19.110783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8b142-fc27-4fa2-826d-9c5be871b245 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:19.146564 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff84ea-3fc6-4913-8d42-be2b5a23c4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:19.147690 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff84ea-3fc6-4913-8d42-be2b5a23c4d5 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:19.148443 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff84ea-3fc6-4913-8d42-be2b5a23c4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:19.148914 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff84ea-3fc6-4913-8d42-be2b5a23c4d5 None admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:19.150368 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff84ea-3fc6-4913-8d42-be2b5a23c4d5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:19.150957 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff84ea-3fc6-4913-8d42-be2b5a23c4d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:19.156254 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff84ea-3fc6-4913-8d42-be2b5a23c4d5 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:19.175421 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ea750-ca53-4d43-a281-792183949ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:19.176826 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ea750-ca53-4d43-a281-792183949ec3 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:19.177340 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ea750-ca53-4d43-a281-792183949ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:19.177908 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ea750-ca53-4d43-a281-792183949ec3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:19.196401 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 282/564] 10.222.0.77 () {56 vars in 1135 bytes} [Tue Aug 23 22:13:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:19.196401 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff84ea-3fc6-4913-8d42-be2b5a23c4d5 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:19.204184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ea750-ca53-4d43-a281-792183949ec3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:19.207368 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ea750-ca53-4d43-a281-792183949ec3 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:19.236035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-af1ea750-ca53-4d43-a281-792183949ec3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:19.236035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:19.236035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:19.236035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:19.236035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:19.236035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:19.236035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:19.236035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:19.236035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:19.236035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:19.236035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:19.236035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:19.236035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:19.236035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:19.236035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:19.236035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:19.238771 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:19.238771 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:19.238771 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:19.238771 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:19.238771 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:19.238771 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:19.238771 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:19.238771 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:19.238771 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:19.238771 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:19.238771 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:19.238771 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:19.238771 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:19.238771 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:19.238771 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:19.238771 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:19.238771 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:19.241330 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:19.241330 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:19.241330 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:19.241330 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 283/565] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:19.241330 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bdfa4-1d93-4fdf-94d6-c1fb1783520d None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:19.241330 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bdfa4-1d93-4fdf-94d6-c1fb1783520d None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:19.241330 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bdfa4-1d93-4fdf-94d6-c1fb1783520d None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:19.242988 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 284/566] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:19.245008 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc6b20-90b6-4499-8a46-86bd7d746dae None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:19.245524 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc6b20-90b6-4499-8a46-86bd7d746dae None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:19.246737 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc6b20-90b6-4499-8a46-86bd7d746dae None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:19.250021 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 285/567] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:19.250563 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc6b20-90b6-4499-8a46-86bd7d746dae None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:19.372538 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:19.375179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:19.397778 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff84ea-3fc6-4913-8d42-be2b5a23c4d5 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:19.406905 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc6b20-90b6-4499-8a46-86bd7d746dae None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:19.443415 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02a848-b89c-4e7a-a74b-a05f8d3060a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:19.444415 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02a848-b89c-4e7a-a74b-a05f8d3060a4 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:19.444846 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02a848-b89c-4e7a-a74b-a05f8d3060a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:19.445291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02a848-b89c-4e7a-a74b-a05f8d3060a4 None admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:19.446601 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02a848-b89c-4e7a-a74b-a05f8d3060a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:19.447122 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02a848-b89c-4e7a-a74b-a05f8d3060a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:19.450194 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02a848-b89c-4e7a-a74b-a05f8d3060a4 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:19.465996 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e112c-5f8b-4580-b9e9-7c8015735116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:19.466795 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e112c-5f8b-4580-b9e9-7c8015735116 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:19.467309 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e112c-5f8b-4580-b9e9-7c8015735116 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:19.467699 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e112c-5f8b-4580-b9e9-7c8015735116 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:19.479047 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 283/568] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:13:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:19.479047 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe37e1a-6a65-49e5-9602-a971b599da8e None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:19.479047 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe37e1a-6a65-49e5-9602-a971b599da8e None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:19.479047 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe37e1a-6a65-49e5-9602-a971b599da8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:19.502249 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-dbe37e1a-6a65-49e5-9602-a971b599da8e None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:19.503809 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-dbe37e1a-6a65-49e5-9602-a971b599da8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:19.600807 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e112c-5f8b-4580-b9e9-7c8015735116 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:19.603503 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e112c-5f8b-4580-b9e9-7c8015735116 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:19.612096 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 284/569] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:13:19.613536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe37e1a-6a65-49e5-9602-a971b599da8e None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:19.732549 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:19.783281 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:19.804516 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 286/570] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:13:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:13:19.809676 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bde1b3-6164-4013-a9fc-1ad40c456e6b None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:19.809676 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bde1b3-6164-4013-a9fc-1ad40c456e6b None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:19.809676 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bde1b3-6164-4013-a9fc-1ad40c456e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:19.821028 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe37e1a-6a65-49e5-9602-a971b599da8e None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:19.834079 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-d0bde1b3-6164-4013-a9fc-1ad40c456e6b None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:19.835507 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-d0bde1b3-6164-4013-a9fc-1ad40c456e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:19.895157 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7745b56-c074-4228-b039-e4beed1a1406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:19.896317 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7745b56-c074-4228-b039-e4beed1a1406 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:19.896851 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7745b56-c074-4228-b039-e4beed1a1406 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:19.897406 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7745b56-c074-4228-b039-e4beed1a1406 None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:19.898670 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7745b56-c074-4228-b039-e4beed1a1406 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:19.899591 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7745b56-c074-4228-b039-e4beed1a1406 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:19.901349 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7745b56-c074-4228-b039-e4beed1a1406 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:19.922371 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 285/571] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:19.923946 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7745b56-c074-4228-b039-e4beed1a1406 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:19.956772 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 287/572] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:13:19.959579 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bde1b3-6164-4013-a9fc-1ad40c456e6b None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:20.148837 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7745b56-c074-4228-b039-e4beed1a1406 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:20.176964 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bde1b3-6164-4013-a9fc-1ad40c456e6b None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:20.213272 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:20.215728 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:20.224852 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9790c79-7f67-4db6-b9ae-ab3fd960ce47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:20.226161 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9790c79-7f67-4db6-b9ae-ab3fd960ce47 None admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:20.226480 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9790c79-7f67-4db6-b9ae-ab3fd960ce47 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:20.232768 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9790c79-7f67-4db6-b9ae-ab3fd960ce47 None admin] PATH_INFO: `/v3/projects/da9a86463d68412884746b115667d2fc/users/1a0af5bf009b48a8915c7320b16d08dd/roles/fb1c5c0f0edb47bf828f63bc685f98ba` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:20.252625 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3adda-fe12-456a-a52a-b2c739ba9c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:20.253865 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3adda-fe12-456a-a52a-b2c739ba9c19 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:20.254434 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3adda-fe12-456a-a52a-b2c739ba9c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:20.254760 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3adda-fe12-456a-a52a-b2c739ba9c19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:20.263311 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9790c79-7f67-4db6-b9ae-ab3fd960ce47 None admin] RBAC: Authorizing `identity:create_grant(project_id=da9a86463d68412884746b115667d2fc, user_id=1a0af5bf009b48a8915c7320b16d08dd, role_id=fb1c5c0f0edb47bf828f63bc685f98ba)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:20.266185 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9790c79-7f67-4db6-b9ae-ab3fd960ce47 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:20.274640 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3adda-fe12-456a-a52a-b2c739ba9c19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:20.278370 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3adda-fe12-456a-a52a-b2c739ba9c19 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:20.297430 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 286/573] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Aug 23 22:13:19 2022] PUT /identity/v3/projects/da9a86463d68412884746b115667d2fc/users/1a0af5bf009b48a8915c7320b16d08dd/roles/fb1c5c0f0edb47bf828f63bc685f98ba => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:13:20.297430 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9790c79-7f67-4db6-b9ae-ab3fd960ce47 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:20.319393 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-d1b3adda-fe12-456a-a52a-b2c739ba9c19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:20.319393 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:20.319393 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:20.319393 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:20.319393 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:20.319393 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:20.319393 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:20.319393 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:20.319393 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:20.319393 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:20.319393 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:20.319393 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:20.319393 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:20.319393 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:20.319393 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:20.319393 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:20.321226 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:20.321226 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:20.321226 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:20.321226 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:20.321226 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:20.321226 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:20.321226 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:20.321226 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:20.321226 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:20.321226 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:20.321226 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:20.321226 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:20.321226 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:20.321226 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:20.321226 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:20.321226 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:20.321226 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:20.323466 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:20.323466 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:20.323466 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:20.323466 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 288/574] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:20.323949 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3adda-fe12-456a-a52a-b2c739ba9c19 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:20.527963 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9790c79-7f67-4db6-b9ae-ab3fd960ce47 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:20.552044 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3adda-fe12-456a-a52a-b2c739ba9c19 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:20.608244 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadfb78-7cfe-403b-ae81-1461f7be06af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:20.609428 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadfb78-7cfe-403b-ae81-1461f7be06af None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:20.609930 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadfb78-7cfe-403b-ae81-1461f7be06af None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:20.610420 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadfb78-7cfe-403b-ae81-1461f7be06af None admin] PATH_INFO: `/v3/users/glance` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:20.625414 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adadfb78-7cfe-403b-ae81-1461f7be06af None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:20.628232 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adadfb78-7cfe-403b-ae81-1461f7be06af None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:20.629876 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbaae4-cc48-4098-8c39-af2e1a682d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:20.630927 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbaae4-cc48-4098-8c39-af2e1a682d07 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:20.631406 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbaae4-cc48-4098-8c39-af2e1a682d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:20.631857 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbaae4-cc48-4098-8c39-af2e1a682d07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:20.654889 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbaae4-cc48-4098-8c39-af2e1a682d07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:13:20.655836 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-adadfb78-7cfe-403b-ae81-1461f7be06af None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 22:13:20.655836 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:20.655836 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:20.655836 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:20.655836 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:20.655836 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:20.655836 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:20.655836 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:20.655836 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:20.655836 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:20.655836 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:20.655836 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:20.655836 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:13:20.655836 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:13:20.655836 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:13:20.655836 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:13:20.657530 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:20.657530 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:20.657530 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:13:20.657530 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:20.657530 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:13:20.657530 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:20.657530 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:20.657530 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:20.657530 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:20.657530 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:20.657530 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:20.657530 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:20.657530 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:20.657530 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:20.657530 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:20.657530 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:20.657530 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:20.657530 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:20.659434 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:20.659434 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:20.659434 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:13:20.659434 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:13:20.659434 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:13:20.659434 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:13:20.659434 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:13:20.659434 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:13:20.659434 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 22:13:20.659434 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:20.661611 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 287/575] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:13:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:20.663521 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadfb78-7cfe-403b-ae81-1461f7be06af None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:20.665015 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-f3cbaae4-cc48-4098-8c39-af2e1a682d07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:13:20.665015 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:20.665015 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:20.665015 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:20.665015 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:20.665015 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:20.665015 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:20.665015 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:20.665015 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:20.665015 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:20.665015 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:20.665015 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:20.665015 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:13:20.665015 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:13:20.665015 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:13:20.665015 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:13:20.666794 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:13:20.666794 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:13:20.666794 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:13:20.666794 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:13:20.666794 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:20.666794 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:20.666794 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:20.666794 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:20.666794 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:20.666794 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:20.666794 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:20.666794 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:20.666794 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:20.666794 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:20.666794 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:20.666794 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:20.669881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:20.669881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:20.669881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:20.669881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:20.669881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:13:20.669881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:13:20.669881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:13:20.669881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:13:20.669881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:13:20.669881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:13:20.669881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:13:20.669881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:20.673623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 289/576] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Aug 23 22:13:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:20.675688 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbaae4-cc48-4098-8c39-af2e1a682d07 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:20.736547 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:20.767969 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:20.889850 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadfb78-7cfe-403b-ae81-1461f7be06af None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:20.892985 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbaae4-cc48-4098-8c39-af2e1a682d07 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:20.949688 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235c561-1685-4219-9e28-3f9b26f4b51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:20.950759 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235c561-1685-4219-9e28-3f9b26f4b51f None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:20.951229 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235c561-1685-4219-9e28-3f9b26f4b51f None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:20.951703 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235c561-1685-4219-9e28-3f9b26f4b51f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:20.955086 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094bb240-41a9-4013-b3f3-526a2c1555d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:20.956376 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bb240-41a9-4013-b3f3-526a2c1555d1 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:20.956930 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bb240-41a9-4013-b3f3-526a2c1555d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:20.957460 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bb240-41a9-4013-b3f3-526a2c1555d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:20.958480 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094bb240-41a9-4013-b3f3-526a2c1555d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:20.958967 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094bb240-41a9-4013-b3f3-526a2c1555d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:20.961300 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094bb240-41a9-4013-b3f3-526a2c1555d1 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:20.970627 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235c561-1685-4219-9e28-3f9b26f4b51f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:13:20.979206 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-7235c561-1685-4219-9e28-3f9b26f4b51f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:13:20.979206 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:20.979206 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:20.979206 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:20.979206 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:20.979206 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:20.979206 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:20.979206 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:20.979206 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:20.979206 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:20.979206 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:20.979206 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:20.979206 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:13:20.979206 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:13:20.979206 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:13:20.979206 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:13:20.981633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:13:20.981633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:13:20.981633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:13:20.981633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:13:20.981633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:20.981633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:20.981633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:20.981633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:20.981633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:20.981633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:20.981633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:20.981633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:20.981633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:20.981633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:20.981633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:20.981633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:20.992142 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:20.992142 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:20.992142 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:20.992142 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:20.992142 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:13:20.992142 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:13:20.992142 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:13:20.992142 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:13:20.992142 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:13:20.992142 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:13:20.992142 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:13:20.992142 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:20.992142 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 290/577] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Aug 23 22:13:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:20.992142 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235c561-1685-4219-9e28-3f9b26f4b51f None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:20.993866 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 288/578] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:20.993866 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094bb240-41a9-4013-b3f3-526a2c1555d1 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:21.123519 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:21.141707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235c561-1685-4219-9e28-3f9b26f4b51f None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:21.163923 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094bb240-41a9-4013-b3f3-526a2c1555d1 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:21.165978 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:21.204676 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3234c23-4004-436f-addb-8af2e7ab6b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:21.205758 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3234c23-4004-436f-addb-8af2e7ab6b4a None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:21.206306 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3234c23-4004-436f-addb-8af2e7ab6b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:21.206688 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3234c23-4004-436f-addb-8af2e7ab6b4a None admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:21.207641 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3234c23-4004-436f-addb-8af2e7ab6b4a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:21.208015 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3234c23-4004-436f-addb-8af2e7ab6b4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:21.209224 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29794d8-4f98-4feb-8b2c-ac8244cd37f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:21.209895 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29794d8-4f98-4feb-8b2c-ac8244cd37f9 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:21.210052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3234c23-4004-436f-addb-8af2e7ab6b4a None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:21.210189 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29794d8-4f98-4feb-8b2c-ac8244cd37f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:21.210453 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29794d8-4f98-4feb-8b2c-ac8244cd37f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:21.211167 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29794d8-4f98-4feb-8b2c-ac8244cd37f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:21.211481 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29794d8-4f98-4feb-8b2c-ac8244cd37f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:21.212988 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29794d8-4f98-4feb-8b2c-ac8244cd37f9 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:21.231202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 289/579] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Aug 23 22:13:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:21.231202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29794d8-4f98-4feb-8b2c-ac8244cd37f9 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:21.241873 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 291/580] 10.222.0.77 () {56 vars in 1137 bytes} [Tue Aug 23 22:13:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:21.244325 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3234c23-4004-436f-addb-8af2e7ab6b4a None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:21.410517 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29794d8-4f98-4feb-8b2c-ac8244cd37f9 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:21.427607 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3234c23-4004-436f-addb-8af2e7ab6b4a None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:21.478605 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3a07b-20b9-47f1-a2d4-af4fd0e97e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:21.479791 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3a07b-20b9-47f1-a2d4-af4fd0e97e14 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:21.480969 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3a07b-20b9-47f1-a2d4-af4fd0e97e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:21.481129 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79bc35-ab0f-4944-8f43-a5189a6cb20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:21.482302 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79bc35-ab0f-4944-8f43-a5189a6cb20e None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:21.482505 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3a07b-20b9-47f1-a2d4-af4fd0e97e14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:21.482804 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79bc35-ab0f-4944-8f43-a5189a6cb20e None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:21.483428 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79bc35-ab0f-4944-8f43-a5189a6cb20e None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:21.484597 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c79bc35-ab0f-4944-8f43-a5189a6cb20e None admin] RBAC: Adding query filter params (name=service) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:21.484994 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c79bc35-ab0f-4944-8f43-a5189a6cb20e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:21.486849 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c79bc35-ab0f-4944-8f43-a5189a6cb20e None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:21.493630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3a07b-20b9-47f1-a2d4-af4fd0e97e14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:21.495318 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3a07b-20b9-47f1-a2d4-af4fd0e97e14 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:21.508452 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 290/581] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Aug 23 22:13:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:21.508452 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79bc35-ab0f-4944-8f43-a5189a6cb20e None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:21.515511 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-8bf3a07b-20b9-47f1-a2d4-af4fd0e97e14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:21.515511 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:21.515511 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:21.515511 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:21.515511 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:21.515511 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:21.515511 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:21.515511 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:21.515511 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:21.515511 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:21.515511 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:21.515511 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:21.515511 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:13:21.515511 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:13:21.515511 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:13:21.517823 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:13:21.517823 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:21.517823 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:21.517823 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:21.517823 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:21.517823 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:21.517823 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:21.517823 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:21.517823 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:21.517823 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:21.517823 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:21.517823 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:21.517823 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:21.517823 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:21.517823 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:21.517823 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:21.517823 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:21.519612 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:13:21.519612 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:13:21.519612 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:13:21.519612 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:13:21.519612 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:13:21.519612 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:13:21.519612 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:21.519612 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:21.519612 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 292/582] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:21.519612 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3a07b-20b9-47f1-a2d4-af4fd0e97e14 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:21.541882 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:21.560142 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:21.691326 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79bc35-ab0f-4944-8f43-a5189a6cb20e None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:21.723309 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3a07b-20b9-47f1-a2d4-af4fd0e97e14 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:21.763889 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46f140-c780-44ab-a1ce-316954fe1698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:21.764985 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46f140-c780-44ab-a1ce-316954fe1698 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:21.765516 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46f140-c780-44ab-a1ce-316954fe1698 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:21.766022 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46f140-c780-44ab-a1ce-316954fe1698 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:21.784018 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96feecb-cdf7-40af-88f2-02df7a712130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:21.784765 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96feecb-cdf7-40af-88f2-02df7a712130 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:21.785196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96feecb-cdf7-40af-88f2-02df7a712130 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:21.785733 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96feecb-cdf7-40af-88f2-02df7a712130 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:21.786456 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46f140-c780-44ab-a1ce-316954fe1698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:21.788096 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46f140-c780-44ab-a1ce-316954fe1698 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:21.806903 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96feecb-cdf7-40af-88f2-02df7a712130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:21.807199 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-5d46f140-c780-44ab-a1ce-316954fe1698 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:21.807199 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:21.807199 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:21.807199 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:21.807199 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:21.807199 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:21.807199 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:21.807199 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:21.807199 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:21.807199 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:21.807199 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:21.807199 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:21.807199 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:21.807199 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:21.807199 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:21.807199 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:21.808202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:21.808202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:21.808202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:21.808202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:21.808202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:21.808202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:21.808202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:21.808202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:21.808202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:21.808202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:21.808202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:21.808202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:21.808202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:21.808202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:21.808202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:21.808202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:21.808202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:21.809188 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:21.809188 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:21.809188 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:21.810541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96feecb-cdf7-40af-88f2-02df7a712130 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:21.813553 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 291/583] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:21.815254 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46f140-c780-44ab-a1ce-316954fe1698 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:21.841485 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-d96feecb-cdf7-40af-88f2-02df7a712130 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:21.841485 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:21.841485 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:21.841485 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:21.841485 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:21.841485 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:21.841485 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:21.841485 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:21.841485 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:21.841485 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:21.841485 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:21.841485 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:21.841485 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:21.841485 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:21.841485 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:21.841485 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:21.843257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:21.843257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:21.843257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:21.843257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:21.843257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:21.843257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:21.843257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:21.843257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:21.843257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:21.843257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:21.843257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:21.843257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:21.843257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:21.843257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:21.843257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:21.843257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:21.843257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:21.844680 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:21.844680 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:21.844680 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:21.849907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 293/584] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:21.850985 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96feecb-cdf7-40af-88f2-02df7a712130 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:21.924923 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:21.954768 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46f140-c780-44ab-a1ce-316954fe1698 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:21.965448 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:22.004815 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15fb76-fa30-42de-9945-f81cd70c0dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:22.005982 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15fb76-fa30-42de-9945-f81cd70c0dfc None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:22.006336 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15fb76-fa30-42de-9945-f81cd70c0dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:22.006605 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15fb76-fa30-42de-9945-f81cd70c0dfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:22.022387 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15fb76-fa30-42de-9945-f81cd70c0dfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:22.024756 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15fb76-fa30-42de-9945-f81cd70c0dfc None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:22.045942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-da15fb76-fa30-42de-9945-f81cd70c0dfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:22.045942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:22.045942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:22.045942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:22.045942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:22.045942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:22.045942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:22.045942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:22.045942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:22.045942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:22.045942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:22.045942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:22.045942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:22.045942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:22.045942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:22.045942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:22.047814 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:22.047814 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:22.047814 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:22.047814 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:22.047814 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:22.047814 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:22.047814 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:22.047814 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:22.047814 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:22.047814 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:22.047814 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:22.047814 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:22.047814 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:22.047814 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:22.047814 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:22.047814 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:22.047814 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:22.049455 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:22.049455 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:22.049455 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:22.049772 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96feecb-cdf7-40af-88f2-02df7a712130 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:22.050426 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 292/585] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:22.050426 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15fb76-fa30-42de-9945-f81cd70c0dfc None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:22.112185 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5df4b-2867-4b19-a920-4698d55a0286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:22.113227 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5df4b-2867-4b19-a920-4698d55a0286 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:22.113781 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5df4b-2867-4b19-a920-4698d55a0286 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:22.114491 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5df4b-2867-4b19-a920-4698d55a0286 None admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:22.115584 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5df4b-2867-4b19-a920-4698d55a0286 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:22.116186 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5df4b-2867-4b19-a920-4698d55a0286 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:22.118953 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5df4b-2867-4b19-a920-4698d55a0286 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:22.149898 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 294/586] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:13:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:22.151481 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5df4b-2867-4b19-a920-4698d55a0286 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:22.239389 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15fb76-fa30-42de-9945-f81cd70c0dfc None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:22.292411 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:22.300737 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77182aac-4233-41be-a923-d98672326874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:22.301361 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77182aac-4233-41be-a923-d98672326874 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:22.301751 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77182aac-4233-41be-a923-d98672326874 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:22.302164 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77182aac-4233-41be-a923-d98672326874 None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:22.302974 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77182aac-4233-41be-a923-d98672326874 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:22.303287 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77182aac-4233-41be-a923-d98672326874 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:22.305855 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77182aac-4233-41be-a923-d98672326874 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:22.326183 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 293/587] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:22.326183 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77182aac-4233-41be-a923-d98672326874 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:22.334097 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5df4b-2867-4b19-a920-4698d55a0286 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:22.377667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:22.410398 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6cc1f3-7f75-4b1d-b438-8a7832ba80bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:22.411424 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cc1f3-7f75-4b1d-b438-8a7832ba80bb None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:22.412040 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cc1f3-7f75-4b1d-b438-8a7832ba80bb None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:22.412501 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cc1f3-7f75-4b1d-b438-8a7832ba80bb None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:22.413876 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6cc1f3-7f75-4b1d-b438-8a7832ba80bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:22.414409 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6cc1f3-7f75-4b1d-b438-8a7832ba80bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:22.417076 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6cc1f3-7f75-4b1d-b438-8a7832ba80bb None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:22.448362 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 295/588] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:22.448362 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6cc1f3-7f75-4b1d-b438-8a7832ba80bb None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:22.526063 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77182aac-4233-41be-a923-d98672326874 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:22.593004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d15a6-abd7-4a24-91ca-e30ab4883500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:22.594069 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d15a6-abd7-4a24-91ca-e30ab4883500 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:22.594515 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d15a6-abd7-4a24-91ca-e30ab4883500 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:22.594952 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d15a6-abd7-4a24-91ca-e30ab4883500 None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:22.596070 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d15a6-abd7-4a24-91ca-e30ab4883500 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:22.596477 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d15a6-abd7-4a24-91ca-e30ab4883500 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:22.599262 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d15a6-abd7-4a24-91ca-e30ab4883500 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:22.620598 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 294/589] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:22.622688 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d15a6-abd7-4a24-91ca-e30ab4883500 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:22.653050 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6cc1f3-7f75-4b1d-b438-8a7832ba80bb None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:22.702911 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270f9e9-d7c9-486f-a7be-380bd844ec16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:22.703661 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270f9e9-d7c9-486f-a7be-380bd844ec16 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:22.704034 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270f9e9-d7c9-486f-a7be-380bd844ec16 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:22.704389 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270f9e9-d7c9-486f-a7be-380bd844ec16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:22.705264 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270f9e9-d7c9-486f-a7be-380bd844ec16 None admin] RBAC: Adding query filter params (role.id=fb1c5c0f0edb47bf828f63bc685f98ba, scope.project.id=da9a86463d68412884746b115667d2fc, user.id=abda1f23a18c4c808483cd6b53952975) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:22.705712 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270f9e9-d7c9-486f-a7be-380bd844ec16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:22.707886 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270f9e9-d7c9-486f-a7be-380bd844ec16 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:22.716509 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 296/590] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:13:22 2022] GET /identity/v3/role_assignments?user.id=abda1f23a18c4c808483cd6b53952975&scope.project.id=da9a86463d68412884746b115667d2fc&role.id=fb1c5c0f0edb47bf828f63bc685f98ba => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:22.718019 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270f9e9-d7c9-486f-a7be-380bd844ec16 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:22.761890 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:22.826525 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:22.872737 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d15a6-abd7-4a24-91ca-e30ab4883500 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:22.957029 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b068be-3111-4f2b-b914-76030cf6993f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:22.958330 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b068be-3111-4f2b-b914-76030cf6993f None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:22.958732 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b068be-3111-4f2b-b914-76030cf6993f None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:22.959074 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b068be-3111-4f2b-b914-76030cf6993f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:22.974370 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b068be-3111-4f2b-b914-76030cf6993f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:22.977307 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b068be-3111-4f2b-b914-76030cf6993f None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:22.982616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270f9e9-d7c9-486f-a7be-380bd844ec16 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:23.003118 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-95b068be-3111-4f2b-b914-76030cf6993f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 22:13:23.003118 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:23.003118 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:23.003118 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:23.003118 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:23.003118 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:23.003118 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:23.003118 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:23.003118 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:23.003118 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:23.003118 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:23.003118 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:23.003118 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:13:23.003118 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:13:23.003118 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:13:23.003118 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:13:23.005309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:23.005309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:23.005309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:13:23.005309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:23.005309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:13:23.005309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:23.005309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:23.005309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:23.005309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:23.005309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:23.005309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:23.005309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:23.005309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:23.005309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:23.005309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:23.005309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:23.005309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:23.005309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:23.007609 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:23.007609 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:23.007609 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:13:23.007609 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:13:23.007609 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:13:23.007609 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:13:23.007609 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:13:23.007609 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:13:23.007609 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 22:13:23.007609 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:23.009827 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 295/591] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Aug 23 22:13:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:23.014726 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b068be-3111-4f2b-b914-76030cf6993f None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:23.078707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7747cf-a9f8-40c5-beec-d3b533a49431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:23.081024 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7747cf-a9f8-40c5-beec-d3b533a49431 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:23.081790 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7747cf-a9f8-40c5-beec-d3b533a49431 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:23.082768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7747cf-a9f8-40c5-beec-d3b533a49431 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:23.102150 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7747cf-a9f8-40c5-beec-d3b533a49431 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:23.106022 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7747cf-a9f8-40c5-beec-d3b533a49431 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:23.135440 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-7d7747cf-a9f8-40c5-beec-d3b533a49431 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:23.135440 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:23.135440 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:23.135440 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:23.135440 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:23.135440 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:23.135440 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:23.135440 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:23.135440 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:23.135440 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:23.135440 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:23.135440 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:23.135440 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:13:23.135440 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:13:23.135440 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:13:23.137608 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:13:23.137608 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:23.137608 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:23.137608 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:23.137608 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:23.137608 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:23.137608 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:23.137608 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:23.137608 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:23.137608 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:23.137608 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:23.137608 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:23.137608 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:23.137608 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:23.137608 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:23.137608 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:23.137608 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:23.139463 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:13:23.139463 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:13:23.139463 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:13:23.139463 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:13:23.139463 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:13:23.139463 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:13:23.139463 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:23.139463 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:23.146002 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 297/592] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 429 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:23.148402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7747cf-a9f8-40c5-beec-d3b533a49431 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:23.253724 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b068be-3111-4f2b-b914-76030cf6993f None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:23.275908 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:23.326378 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c971176-b39c-4e19-8f51-dccf5a89d9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:23.327801 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c971176-b39c-4e19-8f51-dccf5a89d9a4 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:23.328428 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c971176-b39c-4e19-8f51-dccf5a89d9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:23.329130 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c971176-b39c-4e19-8f51-dccf5a89d9a4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:23.344517 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c971176-b39c-4e19-8f51-dccf5a89d9a4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:23.347436 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c971176-b39c-4e19-8f51-dccf5a89d9a4 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:23.370619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-9c971176-b39c-4e19-8f51-dccf5a89d9a4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 22:13:23.370619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:23.370619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:23.370619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:23.370619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:23.370619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:23.370619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:23.370619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:23.370619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:23.370619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:23.370619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:23.370619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:23.370619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:13:23.370619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:13:23.370619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:13:23.370619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:13:23.373301 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:23.373301 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:23.373301 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:13:23.373301 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:23.373301 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:13:23.373301 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:23.373301 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:23.373301 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:23.373301 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:23.373301 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:23.373301 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:23.373301 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:23.373301 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:23.373301 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:23.373301 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:23.373301 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:23.373301 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:23.373301 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:23.375457 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:23.375457 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:23.375457 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:13:23.375457 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:13:23.375457 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:13:23.375457 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:13:23.375457 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:13:23.375457 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:13:23.375457 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 22:13:23.375457 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:23.381069 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7747cf-a9f8-40c5-beec-d3b533a49431 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:23.381662 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 296/593] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:13:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:23.383132 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c971176-b39c-4e19-8f51-dccf5a89d9a4 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:23.384861 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:23.451435 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20ef58-5504-418d-b1c7-acf6091095f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:23.452070 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20ef58-5504-418d-b1c7-acf6091095f7 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:23.452372 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20ef58-5504-418d-b1c7-acf6091095f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:23.452821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20ef58-5504-418d-b1c7-acf6091095f7 None admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:23.453996 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20ef58-5504-418d-b1c7-acf6091095f7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:23.454301 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20ef58-5504-418d-b1c7-acf6091095f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:23.455815 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20ef58-5504-418d-b1c7-acf6091095f7 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:23.490335 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 298/594] 10.222.0.77 () {56 vars in 1139 bytes} [Tue Aug 23 22:13:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:23.490335 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5716dd5-73e2-46f4-90da-7b5cfdf4333a None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:23.490335 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5716dd5-73e2-46f4-90da-7b5cfdf4333a None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:23.490335 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5716dd5-73e2-46f4-90da-7b5cfdf4333a None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:23.490335 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 299/595] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:23.490335 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5716dd5-73e2-46f4-90da-7b5cfdf4333a None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:23.611649 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c971176-b39c-4e19-8f51-dccf5a89d9a4 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:23.668095 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9bae8-a71e-4674-811d-e869d02697fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:23.669296 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9bae8-a71e-4674-811d-e869d02697fe None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:23.669642 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9bae8-a71e-4674-811d-e869d02697fe None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:23.669989 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9bae8-a71e-4674-811d-e869d02697fe None admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:23.671246 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d9bae8-a71e-4674-811d-e869d02697fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:23.671895 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d9bae8-a71e-4674-811d-e869d02697fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:23.674635 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d9bae8-a71e-4674-811d-e869d02697fe None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:23.680581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5716dd5-73e2-46f4-90da-7b5cfdf4333a None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:23.708877 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 297/596] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:13:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:23.710655 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9bae8-a71e-4674-811d-e869d02697fe None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:23.729957 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6844a61-16dc-4e6f-a5fb-a1063bd7e1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:23.730824 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6844a61-16dc-4e6f-a5fb-a1063bd7e1d3 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:23.731426 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6844a61-16dc-4e6f-a5fb-a1063bd7e1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:23.736483 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6844a61-16dc-4e6f-a5fb-a1063bd7e1d3 None admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:23.736483 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6844a61-16dc-4e6f-a5fb-a1063bd7e1d3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:23.736483 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6844a61-16dc-4e6f-a5fb-a1063bd7e1d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:23.736483 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6844a61-16dc-4e6f-a5fb-a1063bd7e1d3 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:23.766298 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 300/597] 10.222.0.77 () {56 vars in 1137 bytes} [Tue Aug 23 22:13:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:23.768863 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1c4de-b087-4a12-9a08-d3662bb68cfc None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:23.769455 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1c4de-b087-4a12-9a08-d3662bb68cfc None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:23.769848 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1c4de-b087-4a12-9a08-d3662bb68cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:23.779568 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:23.797307 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-43e1c4de-b087-4a12-9a08-d3662bb68cfc None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:23.798802 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-43e1c4de-b087-4a12-9a08-d3662bb68cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:23.816852 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:23.899637 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9bae8-a71e-4674-811d-e869d02697fe None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:23.905587 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 301/598] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:13:23.905587 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1c4de-b087-4a12-9a08-d3662bb68cfc None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:23.982516 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdcbec5-2092-4493-b84c-686b70e53fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:23.984362 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcbec5-2092-4493-b84c-686b70e53fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:23.985119 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcbec5-2092-4493-b84c-686b70e53fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:23.985814 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcbec5-2092-4493-b84c-686b70e53fb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:24.005805 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdcbec5-2092-4493-b84c-686b70e53fb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:24.008698 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdcbec5-2092-4493-b84c-686b70e53fb0 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:24.037534 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-2fdcbec5-2092-4493-b84c-686b70e53fb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:24.037534 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:24.037534 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:24.037534 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:24.037534 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:24.037534 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:24.037534 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:24.037534 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:24.037534 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:24.037534 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:24.037534 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:24.037534 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:24.037534 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:24.037534 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:24.037534 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:24.037534 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:24.039665 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:24.039665 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:24.039665 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:24.039665 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:24.039665 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:24.039665 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:24.039665 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:24.039665 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:24.039665 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:24.039665 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:24.039665 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:24.039665 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:24.039665 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:24.039665 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:24.039665 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:24.039665 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:24.039665 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:24.042169 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:24.042169 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:24.042169 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:24.051728 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 298/599] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:24.053757 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdcbec5-2092-4493-b84c-686b70e53fb0 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:24.128871 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1c4de-b087-4a12-9a08-d3662bb68cfc None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:24.195290 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:24.207680 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee821c4-fab3-420b-a937-0d3d8c9b1854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:24.208706 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee821c4-fab3-420b-a937-0d3d8c9b1854 None admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:24.209448 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee821c4-fab3-420b-a937-0d3d8c9b1854 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:24.210038 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee821c4-fab3-420b-a937-0d3d8c9b1854 None admin] PATH_INFO: `/v3/projects/da9a86463d68412884746b115667d2fc/users/855cbc7a992d4c6697632d2d4d74abfb/roles/fb1c5c0f0edb47bf828f63bc685f98ba` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:24.226774 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdcbec5-2092-4493-b84c-686b70e53fb0 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:24.248186 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee821c4-fab3-420b-a937-0d3d8c9b1854 None admin] RBAC: Authorizing `identity:create_grant(project_id=da9a86463d68412884746b115667d2fc, user_id=855cbc7a992d4c6697632d2d4d74abfb, role_id=fb1c5c0f0edb47bf828f63bc685f98ba)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:24.251702 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee821c4-fab3-420b-a937-0d3d8c9b1854 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:24.268112 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:24.276100 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 302/600] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Aug 23 22:13:23 2022] PUT /identity/v3/projects/da9a86463d68412884746b115667d2fc/users/855cbc7a992d4c6697632d2d4d74abfb/roles/fb1c5c0f0edb47bf828f63bc685f98ba => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:13:24.278166 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee821c4-fab3-420b-a937-0d3d8c9b1854 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:24.291311 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64578141-d24b-4ed7-bae7-fd4dd1125bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:24.293890 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64578141-d24b-4ed7-bae7-fd4dd1125bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:24.294889 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64578141-d24b-4ed7-bae7-fd4dd1125bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:24.295655 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64578141-d24b-4ed7-bae7-fd4dd1125bc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:24.328524 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64578141-d24b-4ed7-bae7-fd4dd1125bc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:24.332142 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64578141-d24b-4ed7-bae7-fd4dd1125bc8 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:24.373885 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-64578141-d24b-4ed7-bae7-fd4dd1125bc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:24.373885 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:24.373885 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:24.373885 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:24.373885 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:24.373885 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:24.373885 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:24.373885 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:24.373885 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:24.373885 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:24.373885 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:24.373885 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:24.373885 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:24.373885 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:24.373885 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:24.373885 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:24.375391 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:24.375391 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:24.375391 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:24.375391 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:24.375391 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:24.375391 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:24.375391 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:24.375391 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:24.375391 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:24.375391 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:24.375391 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:24.375391 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:24.375391 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:24.375391 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:24.375391 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:24.375391 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:24.375391 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:24.376409 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:24.376409 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:24.376409 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:24.379662 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 299/601] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:24.390606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64578141-d24b-4ed7-bae7-fd4dd1125bc8 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:24.516444 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee821c4-fab3-420b-a937-0d3d8c9b1854 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:24.604818 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79224c32-8af7-4be5-92bd-71d69d924124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:24.606156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79224c32-8af7-4be5-92bd-71d69d924124 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:24.606628 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79224c32-8af7-4be5-92bd-71d69d924124 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:24.607100 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79224c32-8af7-4be5-92bd-71d69d924124 None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:24.608746 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79224c32-8af7-4be5-92bd-71d69d924124 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:24.609293 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79224c32-8af7-4be5-92bd-71d69d924124 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:24.612310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79224c32-8af7-4be5-92bd-71d69d924124 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:24.645522 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 303/602] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:24.647617 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79224c32-8af7-4be5-92bd-71d69d924124 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:24.659260 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64578141-d24b-4ed7-bae7-fd4dd1125bc8 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:24.729439 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc2328-66e8-4404-93ab-e5c5ce2b643f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:24.731210 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc2328-66e8-4404-93ab-e5c5ce2b643f None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:24.732305 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc2328-66e8-4404-93ab-e5c5ce2b643f None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:24.732814 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc2328-66e8-4404-93ab-e5c5ce2b643f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:24.736520 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:24.761043 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc2328-66e8-4404-93ab-e5c5ce2b643f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:13:24.774185 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-5bfc2328-66e8-4404-93ab-e5c5ce2b643f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:13:24.774185 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:24.774185 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:24.774185 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:24.774185 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:24.774185 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:24.774185 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:24.774185 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:24.774185 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:24.774185 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:24.774185 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:24.774185 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:24.774185 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:13:24.774185 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:13:24.774185 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:13:24.774185 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:13:24.776315 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:13:24.776315 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:13:24.776315 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:13:24.776315 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:13:24.776315 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:24.776315 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:24.776315 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:24.776315 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:24.776315 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:24.776315 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:24.776315 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:24.776315 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:24.776315 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:24.776315 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:24.776315 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:24.776315 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:24.778314 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:24.778314 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:24.778314 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:24.778314 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:24.778314 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:13:24.778314 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:13:24.778314 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:13:24.778314 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:13:24.778314 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:13:24.778314 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:13:24.778314 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:13:24.778314 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:24.788401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:24.788938 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 300/603] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Aug 23 22:13:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:24.790975 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc2328-66e8-4404-93ab-e5c5ce2b643f None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:24.885131 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79224c32-8af7-4be5-92bd-71d69d924124 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:24.966115 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8e75b-4d72-4cbe-bdf1-6b6faa1526f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:24.967121 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8e75b-4d72-4cbe-bdf1-6b6faa1526f5 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:24.968191 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8e75b-4d72-4cbe-bdf1-6b6faa1526f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:24.968191 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8e75b-4d72-4cbe-bdf1-6b6faa1526f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:24.969729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d8e75b-4d72-4cbe-bdf1-6b6faa1526f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:24.970478 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d8e75b-4d72-4cbe-bdf1-6b6faa1526f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:24.973528 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d8e75b-4d72-4cbe-bdf1-6b6faa1526f5 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:25.003974 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 304/604] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:25.006096 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8e75b-4d72-4cbe-bdf1-6b6faa1526f5 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:25.024146 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc2328-66e8-4404-93ab-e5c5ce2b643f None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:25.101856 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7d304-2e06-4c45-ba7b-e320156b9928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:25.103437 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7d304-2e06-4c45-ba7b-e320156b9928 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:25.104225 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7d304-2e06-4c45-ba7b-e320156b9928 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:25.105037 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7d304-2e06-4c45-ba7b-e320156b9928 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:25.122413 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7d304-2e06-4c45-ba7b-e320156b9928 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:25.125847 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7d304-2e06-4c45-ba7b-e320156b9928 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:25.151431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-dee7d304-2e06-4c45-ba7b-e320156b9928 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:25.151431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:25.151431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:25.151431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:25.151431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:25.151431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:25.151431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:25.151431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:25.151431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:25.151431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:25.151431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:25.151431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:25.151431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:13:25.151431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:13:25.151431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:13:25.154121 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:13:25.154121 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:25.154121 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:25.154121 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:25.154121 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:25.154121 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:25.154121 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:25.154121 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:25.154121 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:25.154121 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:25.154121 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:25.154121 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:25.154121 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:25.154121 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:25.154121 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:25.154121 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:25.154121 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:25.155922 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:13:25.155922 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:13:25.155922 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:13:25.155922 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:13:25.155922 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:13:25.155922 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:13:25.155922 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:25.155922 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:25.160260 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 301/605] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:25.162111 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7d304-2e06-4c45-ba7b-e320156b9928 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:25.248721 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8e75b-4d72-4cbe-bdf1-6b6faa1526f5 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:25.288050 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:25.303639 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:25.332277 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550eb08c-d202-4d16-b4d9-7b2ac98329d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:25.333050 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550eb08c-d202-4d16-b4d9-7b2ac98329d3 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:25.333526 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550eb08c-d202-4d16-b4d9-7b2ac98329d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:25.333833 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550eb08c-d202-4d16-b4d9-7b2ac98329d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:25.335086 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550eb08c-d202-4d16-b4d9-7b2ac98329d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:25.335634 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550eb08c-d202-4d16-b4d9-7b2ac98329d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:25.338340 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550eb08c-d202-4d16-b4d9-7b2ac98329d3 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:25.362935 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 305/606] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Aug 23 22:13:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:25.362935 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550eb08c-d202-4d16-b4d9-7b2ac98329d3 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:25.413522 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7d304-2e06-4c45-ba7b-e320156b9928 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:25.490289 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc1c79-3f2b-4e7c-b697-2fe49c3575a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:25.491259 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc1c79-3f2b-4e7c-b697-2fe49c3575a5 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:25.491678 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc1c79-3f2b-4e7c-b697-2fe49c3575a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:25.492096 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc1c79-3f2b-4e7c-b697-2fe49c3575a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:25.504919 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc1c79-3f2b-4e7c-b697-2fe49c3575a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:25.507425 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc1c79-3f2b-4e7c-b697-2fe49c3575a5 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:25.530632 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-4bbc1c79-3f2b-4e7c-b697-2fe49c3575a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:25.530632 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:25.530632 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:25.530632 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:25.530632 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:25.530632 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:25.530632 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:25.530632 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:25.530632 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:25.530632 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:25.530632 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:25.530632 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:25.530632 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:13:25.530632 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:13:25.530632 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:13:25.532226 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:13:25.532226 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:25.532226 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:25.532226 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:25.532226 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:25.532226 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:25.532226 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:25.532226 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:25.532226 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:25.532226 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:25.532226 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:25.532226 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:25.532226 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:25.532226 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:25.532226 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:25.532226 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:25.532226 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:25.533255 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:13:25.533255 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:13:25.533255 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:13:25.533255 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:13:25.533255 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:13:25.533255 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:13:25.533255 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:25.533255 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:25.533255 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 302/607] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:25.535075 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc1c79-3f2b-4e7c-b697-2fe49c3575a5 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:25.580071 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550eb08c-d202-4d16-b4d9-7b2ac98329d3 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:25.644495 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf72205-1575-42a1-9804-f8fd91014502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:25.646113 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf72205-1575-42a1-9804-f8fd91014502 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:25.646478 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf72205-1575-42a1-9804-f8fd91014502 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:25.646965 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf72205-1575-42a1-9804-f8fd91014502 None admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:25.648304 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf72205-1575-42a1-9804-f8fd91014502 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:25.648861 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf72205-1575-42a1-9804-f8fd91014502 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:25.651692 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf72205-1575-42a1-9804-f8fd91014502 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:25.693288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 306/608] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:13:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:25.693288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf72205-1575-42a1-9804-f8fd91014502 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:25.749512 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc1c79-3f2b-4e7c-b697-2fe49c3575a5 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:25.779348 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:25.800422 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:25.824906 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e9da7-a3af-4177-a17c-87d317bb2bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:25.826279 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e9da7-a3af-4177-a17c-87d317bb2bbd None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:25.826801 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e9da7-a3af-4177-a17c-87d317bb2bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:25.827447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e9da7-a3af-4177-a17c-87d317bb2bbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:25.852964 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e9da7-a3af-4177-a17c-87d317bb2bbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:25.856956 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e9da7-a3af-4177-a17c-87d317bb2bbd None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:25.899423 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-335e9da7-a3af-4177-a17c-87d317bb2bbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:25.899423 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:25.899423 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:25.899423 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:25.899423 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:25.899423 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:25.899423 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:25.899423 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:25.899423 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:25.899423 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:25.899423 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:25.899423 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:25.899423 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:25.899423 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:25.899423 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:25.899423 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:25.901076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:25.901076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:25.901076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:25.901076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:25.901076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:25.901076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:25.901076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:25.901076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:25.901076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:25.901076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:25.901076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:25.901076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:25.901076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:25.901076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:25.901076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:25.901076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:25.901076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:25.903723 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:25.903723 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:25.903723 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:25.903723 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 303/609] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:25.904165 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f701f71-3c34-4327-a5fb-3b9612165807 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:25.904720 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f701f71-3c34-4327-a5fb-3b9612165807 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:25.905071 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f701f71-3c34-4327-a5fb-3b9612165807 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:25.913457 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 304/610] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:25.913457 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f701f71-3c34-4327-a5fb-3b9612165807 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:25.942480 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf72205-1575-42a1-9804-f8fd91014502 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:26.024598 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c75f9-e57a-4d73-b5c6-f699ddd78236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:26.026168 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c75f9-e57a-4d73-b5c6-f699ddd78236 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:26.027052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c75f9-e57a-4d73-b5c6-f699ddd78236 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:26.027924 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c75f9-e57a-4d73-b5c6-f699ddd78236 None admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:26.029768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c75f9-e57a-4d73-b5c6-f699ddd78236 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:26.030295 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c75f9-e57a-4d73-b5c6-f699ddd78236 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:26.033004 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c75f9-e57a-4d73-b5c6-f699ddd78236 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:26.058610 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 307/611] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:13:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:26.060002 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c75f9-e57a-4d73-b5c6-f699ddd78236 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:26.169086 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f701f71-3c34-4327-a5fb-3b9612165807 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:26.237318 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a91d1-65fc-4afd-ad5b-aff1391784d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:26.238575 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a91d1-65fc-4afd-ad5b-aff1391784d7 None admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:26.239036 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a91d1-65fc-4afd-ad5b-aff1391784d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:26.239482 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a91d1-65fc-4afd-ad5b-aff1391784d7 None admin] PATH_INFO: `/v3/projects/da9a86463d68412884746b115667d2fc/users/84ea6fbc3de84b7db9e62b9ee6055c52/roles/fb1c5c0f0edb47bf828f63bc685f98ba` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:26.266994 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a91d1-65fc-4afd-ad5b-aff1391784d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=da9a86463d68412884746b115667d2fc, user_id=84ea6fbc3de84b7db9e62b9ee6055c52, role_id=fb1c5c0f0edb47bf828f63bc685f98ba)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:26.268801 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a91d1-65fc-4afd-ad5b-aff1391784d7 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:26.281907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:26.289905 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c75f9-e57a-4d73-b5c6-f699ddd78236 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:26.294203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 305/612] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Aug 23 22:13:25 2022] PUT /identity/v3/projects/da9a86463d68412884746b115667d2fc/users/84ea6fbc3de84b7db9e62b9ee6055c52/roles/fb1c5c0f0edb47bf828f63bc685f98ba => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:13:26.296681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63f2a6-3d5f-4864-82df-7437c466053e None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:26.297412 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63f2a6-3d5f-4864-82df-7437c466053e None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:26.297748 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63f2a6-3d5f-4864-82df-7437c466053e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:26.334208 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-ec63f2a6-3d5f-4864-82df-7437c466053e None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:26.335779 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-ec63f2a6-3d5f-4864-82df-7437c466053e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:26.361000 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:26.405645 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617429e4-12c1-44ea-aa11-cbf06ef454b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:26.406662 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617429e4-12c1-44ea-aa11-cbf06ef454b8 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:26.407129 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617429e4-12c1-44ea-aa11-cbf06ef454b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:26.407644 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617429e4-12c1-44ea-aa11-cbf06ef454b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:26.408810 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617429e4-12c1-44ea-aa11-cbf06ef454b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:26.409706 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617429e4-12c1-44ea-aa11-cbf06ef454b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:26.414289 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617429e4-12c1-44ea-aa11-cbf06ef454b8 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:26.451372 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 308/613] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:26.451372 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617429e4-12c1-44ea-aa11-cbf06ef454b8 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:26.491482 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 306/614] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:13:26.496493 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63f2a6-3d5f-4864-82df-7437c466053e None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:26.700079 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617429e4-12c1-44ea-aa11-cbf06ef454b8 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:26.723866 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63f2a6-3d5f-4864-82df-7437c466053e None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:26.786404 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5246b9-cdef-4812-b25f-ad646ad93d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:26.788155 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5246b9-cdef-4812-b25f-ad646ad93d0b None admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:26.788587 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5246b9-cdef-4812-b25f-ad646ad93d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:26.789062 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5246b9-cdef-4812-b25f-ad646ad93d0b None admin] PATH_INFO: `/v3/projects/da9a86463d68412884746b115667d2fc/users/99f6180d62a2415ca4bb7ad55fe33c5b/roles/fb1c5c0f0edb47bf828f63bc685f98ba` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:26.790802 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f5d40-65d1-4668-8f7e-4f3e449692ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:26.791808 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f5d40-65d1-4668-8f7e-4f3e449692ea None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:26.792293 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f5d40-65d1-4668-8f7e-4f3e449692ea None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:26.792776 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f5d40-65d1-4668-8f7e-4f3e449692ea None admin] PATH_INFO: `/v3/users/nova` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:26.818829 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f5d40-65d1-4668-8f7e-4f3e449692ea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:26.825164 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f5d40-65d1-4668-8f7e-4f3e449692ea None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:26.845099 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5246b9-cdef-4812-b25f-ad646ad93d0b None admin] RBAC: Authorizing `identity:create_grant(project_id=da9a86463d68412884746b115667d2fc, user_id=99f6180d62a2415ca4bb7ad55fe33c5b, role_id=fb1c5c0f0edb47bf828f63bc685f98ba)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:26.846915 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5246b9-cdef-4812-b25f-ad646ad93d0b None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:26.860681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-c01f5d40-65d1-4668-8f7e-4f3e449692ea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:13:26.860681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:26.860681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:26.860681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:26.860681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:26.860681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:26.860681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:26.860681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:26.860681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:26.860681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:26.860681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:26.860681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:26.860681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:13:26.860681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:13:26.860681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:13:26.860681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:13:26.862408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:26.862408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:26.862408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:13:26.862408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:26.862408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:13:26.862408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:26.862408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:26.862408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:26.862408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:26.862408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:26.862408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:26.862408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:26.862408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:26.862408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:26.862408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:26.862408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:26.862408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:26.862408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:26.864221 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:26.864221 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:26.864221 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:13:26.864221 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:13:26.864221 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:13:26.864221 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:13:26.864221 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:13:26.864221 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:13:26.864221 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:13:26.864221 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:26.868838 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 307/615] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Aug 23 22:13:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:26.878225 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f5d40-65d1-4668-8f7e-4f3e449692ea None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:26.883657 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 309/616] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Aug 23 22:13:26 2022] PUT /identity/v3/projects/da9a86463d68412884746b115667d2fc/users/99f6180d62a2415ca4bb7ad55fe33c5b/roles/fb1c5c0f0edb47bf828f63bc685f98ba => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:13:26.903943 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:26.972409 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5246b9-cdef-4812-b25f-ad646ad93d0b None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:27.005498 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:27.208825 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f5d40-65d1-4668-8f7e-4f3e449692ea None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:27.244772 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5246b9-cdef-4812-b25f-ad646ad93d0b None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:27.269901 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181fed2-6e85-45ba-a618-bb8062242072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:27.271048 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181fed2-6e85-45ba-a618-bb8062242072 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:27.271716 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181fed2-6e85-45ba-a618-bb8062242072 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:27.272436 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181fed2-6e85-45ba-a618-bb8062242072 None admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:27.274015 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181fed2-6e85-45ba-a618-bb8062242072 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:27.274681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181fed2-6e85-45ba-a618-bb8062242072 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:27.278100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181fed2-6e85-45ba-a618-bb8062242072 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:27.312089 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 308/617] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Aug 23 22:13:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:27.318714 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478ffc2-0aec-4622-88ed-25ad3d74f980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:27.319883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478ffc2-0aec-4622-88ed-25ad3d74f980 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:27.320501 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181fed2-6e85-45ba-a618-bb8062242072 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:27.320686 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478ffc2-0aec-4622-88ed-25ad3d74f980 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:27.321227 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478ffc2-0aec-4622-88ed-25ad3d74f980 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:27.383171 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478ffc2-0aec-4622-88ed-25ad3d74f980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:13:27.409795 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-d478ffc2-0aec-4622-88ed-25ad3d74f980 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:13:27.409795 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:27.409795 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:27.409795 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:27.409795 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:27.409795 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:27.409795 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:27.409795 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:27.409795 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:27.409795 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:27.409795 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:27.409795 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:27.409795 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:13:27.409795 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:13:27.409795 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:13:27.409795 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:13:27.411738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:13:27.411738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:13:27.411738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:13:27.411738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:13:27.411738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:27.411738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:27.411738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:27.411738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:27.411738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:27.411738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:27.411738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:27.411738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:27.411738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:27.411738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:27.411738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:27.411738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:27.414404 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:27.414404 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:27.414404 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:27.414404 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:27.414404 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:13:27.414404 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:13:27.414404 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:13:27.414404 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:13:27.414404 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:13:27.414404 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:13:27.414404 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:13:27.414404 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:27.414404 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 310/618] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Aug 23 22:13:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 442 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:27.426052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478ffc2-0aec-4622-88ed-25ad3d74f980 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:27.498860 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:27.603167 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181fed2-6e85-45ba-a618-bb8062242072 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:27.629039 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:27.700571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0c479-f2e3-4ae3-ae15-9b8595244781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:27.701386 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0c479-f2e3-4ae3-ae15-9b8595244781 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:27.701903 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0c479-f2e3-4ae3-ae15-9b8595244781 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:27.702346 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0c479-f2e3-4ae3-ae15-9b8595244781 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:27.705338 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478ffc2-0aec-4622-88ed-25ad3d74f980 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:27.834453 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72235d6e-9faa-40e5-90fd-c381e167105f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:27.835404 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72235d6e-9faa-40e5-90fd-c381e167105f None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:27.835925 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72235d6e-9faa-40e5-90fd-c381e167105f None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:27.836435 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72235d6e-9faa-40e5-90fd-c381e167105f None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:27.838068 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72235d6e-9faa-40e5-90fd-c381e167105f None admin] RBAC: Adding query filter params (name=service) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:27.838611 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72235d6e-9faa-40e5-90fd-c381e167105f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:27.841670 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72235d6e-9faa-40e5-90fd-c381e167105f None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:27.861590 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d0c479-f2e3-4ae3-ae15-9b8595244781 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:27.864329 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d0c479-f2e3-4ae3-ae15-9b8595244781 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:27.868726 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 311/619] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Aug 23 22:13:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 445 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:27.878052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72235d6e-9faa-40e5-90fd-c381e167105f None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:27.982967 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:28.061410 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 309/620] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:13:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 737 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 22:13:28.061410 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777aa59e-952a-463e-a5e2-7d5236c30bf8 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:28.061410 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777aa59e-952a-463e-a5e2-7d5236c30bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:28.061410 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777aa59e-952a-463e-a5e2-7d5236c30bf8 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:28.062287 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 310/621] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:28.070368 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777aa59e-952a-463e-a5e2-7d5236c30bf8 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:28.133969 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72235d6e-9faa-40e5-90fd-c381e167105f None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:28.184661 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:28.196424 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e0fd0-de61-4d17-8587-72bf11d1b7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:28.197278 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e0fd0-de61-4d17-8587-72bf11d1b7be None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:28.197675 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e0fd0-de61-4d17-8587-72bf11d1b7be None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:28.198057 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e0fd0-de61-4d17-8587-72bf11d1b7be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:28.222833 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e0fd0-de61-4d17-8587-72bf11d1b7be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:28.224930 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e0fd0-de61-4d17-8587-72bf11d1b7be None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:28.252585 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-5b5e0fd0-de61-4d17-8587-72bf11d1b7be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:28.252585 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:28.252585 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:28.252585 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:28.252585 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:28.252585 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:28.252585 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:28.252585 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:28.252585 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:28.252585 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:28.252585 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:28.252585 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:28.252585 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:28.252585 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:28.252585 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:28.252585 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:28.254535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:28.254535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:28.254535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:28.254535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:28.254535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:28.254535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:28.254535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:28.254535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:28.254535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:28.254535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:28.254535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:28.254535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:28.254535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:28.254535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:28.254535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:28.254535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:28.254535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:28.256470 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:28.256470 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:28.256470 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:28.261452 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 312/622] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:28.263625 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8af53-51f5-4900-817a-e4b623281e5d None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:28.264782 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8af53-51f5-4900-817a-e4b623281e5d None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:28.264782 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8af53-51f5-4900-817a-e4b623281e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:28.294954 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-5cc8af53-51f5-4900-817a-e4b623281e5d None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:28.296370 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-5cc8af53-51f5-4900-817a-e4b623281e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:28.309597 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777aa59e-952a-463e-a5e2-7d5236c30bf8 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:28.388086 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b926c1a-9b6f-4cbb-bc14-ffd870a9edc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:28.390029 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b926c1a-9b6f-4cbb-bc14-ffd870a9edc7 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:28.390982 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b926c1a-9b6f-4cbb-bc14-ffd870a9edc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:28.391914 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b926c1a-9b6f-4cbb-bc14-ffd870a9edc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:28.416007 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b926c1a-9b6f-4cbb-bc14-ffd870a9edc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:28.421124 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b926c1a-9b6f-4cbb-bc14-ffd870a9edc7 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:28.441405 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 313/623] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:13:28.441405 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8af53-51f5-4900-817a-e4b623281e5d None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:28.478783 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-2b926c1a-9b6f-4cbb-bc14-ffd870a9edc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:28.478783 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:28.478783 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:28.478783 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:28.478783 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:28.478783 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:28.478783 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:28.478783 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:28.478783 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:28.478783 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:28.478783 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:28.478783 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:28.478783 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:28.478783 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:28.478783 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:28.478783 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:28.482571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:28.482571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:28.482571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:28.482571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:28.482571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:28.482571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:28.482571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:28.482571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:28.482571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:28.482571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:28.482571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:28.482571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:28.482571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:28.482571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:28.482571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:28.482571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:28.482571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:28.484386 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:28.484386 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:28.484386 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:28.498074 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 311/624] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:28.515291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b926c1a-9b6f-4cbb-bc14-ffd870a9edc7 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:28.578267 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:28.647812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8af53-51f5-4900-817a-e4b623281e5d None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:28.688509 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:28.722005 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b926c1a-9b6f-4cbb-bc14-ffd870a9edc7 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:28.746262 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51f889-ed32-49f5-8ee7-65d3847dee2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:28.746262 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51f889-ed32-49f5-8ee7-65d3847dee2f None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:28.746262 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51f889-ed32-49f5-8ee7-65d3847dee2f None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:28.746262 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51f889-ed32-49f5-8ee7-65d3847dee2f None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:28.747294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51f889-ed32-49f5-8ee7-65d3847dee2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:28.753417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51f889-ed32-49f5-8ee7-65d3847dee2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:28.753417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51f889-ed32-49f5-8ee7-65d3847dee2f None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:28.789431 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 314/625] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:28.789639 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090b325-9adc-486d-9995-5cd592cd3fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:28.789639 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090b325-9adc-486d-9995-5cd592cd3fee None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:28.789639 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090b325-9adc-486d-9995-5cd592cd3fee None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:28.789639 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090b325-9adc-486d-9995-5cd592cd3fee None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:28.790072 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090b325-9adc-486d-9995-5cd592cd3fee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:28.790072 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090b325-9adc-486d-9995-5cd592cd3fee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:28.790072 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090b325-9adc-486d-9995-5cd592cd3fee None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:28.793749 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51f889-ed32-49f5-8ee7-65d3847dee2f None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:28.807121 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 312/626] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:28.829332 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090b325-9adc-486d-9995-5cd592cd3fee None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:29.062171 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:29.082396 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51f889-ed32-49f5-8ee7-65d3847dee2f None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:29.129525 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090b325-9adc-486d-9995-5cd592cd3fee None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:29.171631 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a52c5-7f5a-440d-bec5-3129baf9254d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:29.172629 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a52c5-7f5a-440d-bec5-3129baf9254d None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:29.173113 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a52c5-7f5a-440d-bec5-3129baf9254d None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:29.173714 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a52c5-7f5a-440d-bec5-3129baf9254d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:29.189499 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a52c5-7f5a-440d-bec5-3129baf9254d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:29.192043 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a52c5-7f5a-440d-bec5-3129baf9254d None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:29.195810 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f806714-cf17-4933-9d4d-c4c0174289eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:29.196832 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f806714-cf17-4933-9d4d-c4c0174289eb None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:29.197288 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f806714-cf17-4933-9d4d-c4c0174289eb None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:29.197787 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f806714-cf17-4933-9d4d-c4c0174289eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:29.211382 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f806714-cf17-4933-9d4d-c4c0174289eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:29.213862 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f806714-cf17-4933-9d4d-c4c0174289eb None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:29.214184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-133a52c5-7f5a-440d-bec5-3129baf9254d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 22:13:29.214184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:29.214184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:29.214184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:29.214184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:29.214184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:29.214184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:29.214184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:29.214184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:29.214184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:29.214184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:29.214184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:29.214184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:13:29.214184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:13:29.214184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:13:29.214184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:13:29.216746 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:29.216746 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:29.216746 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:13:29.216746 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:29.216746 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:13:29.216746 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:29.216746 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:29.216746 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:29.216746 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:29.216746 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:29.216746 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:29.216746 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:29.216746 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:29.216746 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:29.216746 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:29.216746 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:29.216746 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:29.216746 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:29.219223 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:29.219223 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:29.219223 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:13:29.219223 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:13:29.219223 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:13:29.219223 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:13:29.219223 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:13:29.219223 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:13:29.219223 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 22:13:29.219223 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:29.225123 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 315/627] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:13:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:29.226631 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a52c5-7f5a-440d-bec5-3129baf9254d None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:29.238051 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-0f806714-cf17-4933-9d4d-c4c0174289eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:29.238051 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:29.238051 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:29.238051 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:29.238051 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:29.238051 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:29.238051 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:29.238051 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:29.238051 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:29.238051 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:29.238051 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:29.238051 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:29.238051 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:13:29.238051 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:13:29.238051 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:13:29.240907 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:13:29.240907 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:29.240907 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:29.240907 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:29.240907 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:29.240907 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:29.240907 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:29.240907 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:29.240907 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:29.240907 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:29.240907 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:29.240907 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:29.240907 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:29.240907 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:29.240907 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:29.240907 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:29.240907 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:29.243820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:13:29.243820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:13:29.243820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:13:29.243820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:13:29.243820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:13:29.243820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:13:29.243820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:29.243820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:29.243820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 313/628] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 412 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:29.243820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f806714-cf17-4933-9d4d-c4c0174289eb None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:29.316154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:29.449476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a52c5-7f5a-440d-bec5-3129baf9254d None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:29.479078 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f806714-cf17-4933-9d4d-c4c0174289eb None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:29.539428 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0211de-1957-4aad-be70-4aad61928248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:29.540160 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfed100-2a2c-4deb-aaf4-8572047e1370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:29.540419 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0211de-1957-4aad-be70-4aad61928248 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:29.540925 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0211de-1957-4aad-be70-4aad61928248 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:29.541397 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfed100-2a2c-4deb-aaf4-8572047e1370 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:29.541585 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0211de-1957-4aad-be70-4aad61928248 None admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:29.541918 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfed100-2a2c-4deb-aaf4-8572047e1370 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:29.543106 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfed100-2a2c-4deb-aaf4-8572047e1370 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:29.543397 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0211de-1957-4aad-be70-4aad61928248 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:29.543945 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0211de-1957-4aad-be70-4aad61928248 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:29.546884 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0211de-1957-4aad-be70-4aad61928248 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:29.553117 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:29.578141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfed100-2a2c-4deb-aaf4-8572047e1370 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:13:29.590267 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 314/629] 10.222.0.77 () {56 vars in 1135 bytes} [Tue Aug 23 22:13:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:29.592205 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0211de-1957-4aad-be70-4aad61928248 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:29.601915 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-bbfed100-2a2c-4deb-aaf4-8572047e1370 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:13:29.601915 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:29.601915 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:29.601915 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:29.601915 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:29.601915 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:29.601915 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:29.601915 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:29.601915 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:29.601915 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:29.601915 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:29.601915 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:29.601915 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:13:29.601915 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:13:29.601915 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:13:29.601915 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:13:29.604241 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:13:29.604241 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:13:29.604241 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:13:29.604241 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:13:29.604241 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:29.604241 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:29.604241 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:29.604241 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:29.604241 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:29.604241 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:29.604241 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:29.604241 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:29.604241 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:29.604241 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:29.604241 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:29.604241 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:29.607568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:29.607568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:29.607568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:29.607568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:29.607568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:13:29.607568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:13:29.607568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:13:29.607568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:13:29.607568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:13:29.607568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:13:29.607568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:13:29.607568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:29.615892 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 316/630] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Aug 23 22:13:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:29.619168 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfed100-2a2c-4deb-aaf4-8572047e1370 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:29.808106 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:29.823866 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfed100-2a2c-4deb-aaf4-8572047e1370 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:29.824736 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0211de-1957-4aad-be70-4aad61928248 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:29.882463 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa9b1f-3c7a-47c7-9dad-3d6b3c57d71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:29.883392 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa9b1f-3c7a-47c7-9dad-3d6b3c57d71c None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:29.883866 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa9b1f-3c7a-47c7-9dad-3d6b3c57d71c None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:29.884327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa9b1f-3c7a-47c7-9dad-3d6b3c57d71c None admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:29.885542 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa9b1f-3c7a-47c7-9dad-3d6b3c57d71c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:29.886054 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa9b1f-3c7a-47c7-9dad-3d6b3c57d71c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:29.888194 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef43e6-d225-43f9-b6f1-b5daa80719d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:29.889078 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef43e6-d225-43f9-b6f1-b5daa80719d0 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:29.889208 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa9b1f-3c7a-47c7-9dad-3d6b3c57d71c None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:29.889654 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef43e6-d225-43f9-b6f1-b5daa80719d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:29.890157 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef43e6-d225-43f9-b6f1-b5daa80719d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:29.910831 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef43e6-d225-43f9-b6f1-b5daa80719d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:29.913596 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef43e6-d225-43f9-b6f1-b5daa80719d0 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:29.914721 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 315/631] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:13:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:29.922514 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa9b1f-3c7a-47c7-9dad-3d6b3c57d71c None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:29.955337 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-4fef43e6-d225-43f9-b6f1-b5daa80719d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:29.955337 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:29.955337 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:29.955337 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:29.955337 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:29.955337 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:29.955337 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:29.955337 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:29.955337 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:29.955337 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:29.955337 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:29.955337 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:29.955337 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:29.955337 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:29.955337 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:29.955337 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:29.956783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:29.956783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:29.956783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:29.956783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:29.956783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:29.956783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:29.956783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:29.956783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:29.956783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:29.956783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:29.956783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:29.956783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:29.956783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:29.956783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:29.956783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:29.956783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:29.956783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:29.958015 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:29.958015 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:29.958015 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:29.958015 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 317/632] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:29.958833 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a9ef8-1aad-4a0f-8710-b713a37af872 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:29.959334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a9ef8-1aad-4a0f-8710-b713a37af872 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:29.959945 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a9ef8-1aad-4a0f-8710-b713a37af872 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:29.965436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 318/633] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:29.965950 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a9ef8-1aad-4a0f-8710-b713a37af872 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:30.048294 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:30.158963 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa9b1f-3c7a-47c7-9dad-3d6b3c57d71c None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:30.207860 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a9ef8-1aad-4a0f-8710-b713a37af872 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:30.228826 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad26d0f5-162f-46c2-b676-71589c1d18f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:30.231441 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26d0f5-162f-46c2-b676-71589c1d18f5 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:30.232065 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26d0f5-162f-46c2-b676-71589c1d18f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:30.232585 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26d0f5-162f-46c2-b676-71589c1d18f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:30.233872 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad26d0f5-162f-46c2-b676-71589c1d18f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:30.234449 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad26d0f5-162f-46c2-b676-71589c1d18f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:30.236667 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad26d0f5-162f-46c2-b676-71589c1d18f5 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:30.252233 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 316/634] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Aug 23 22:13:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:30.254184 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad26d0f5-162f-46c2-b676-71589c1d18f5 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:30.289117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8882c-d1a0-4adf-96db-a07b983600ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:30.289913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8882c-d1a0-4adf-96db-a07b983600ae None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:30.290244 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8882c-d1a0-4adf-96db-a07b983600ae None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:30.290598 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8882c-d1a0-4adf-96db-a07b983600ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:30.291776 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8882c-d1a0-4adf-96db-a07b983600ae None admin] RBAC: Adding query filter params (role.id=fb1c5c0f0edb47bf828f63bc685f98ba, scope.project.id=da9a86463d68412884746b115667d2fc, user.id=1a0af5bf009b48a8915c7320b16d08dd) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:30.292281 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8882c-d1a0-4adf-96db-a07b983600ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:30.295514 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8882c-d1a0-4adf-96db-a07b983600ae None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:30.306263 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 319/635] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:13:29 2022] GET /identity/v3/role_assignments?user.id=1a0af5bf009b48a8915c7320b16d08dd&scope.project.id=da9a86463d68412884746b115667d2fc&role.id=fb1c5c0f0edb47bf828f63bc685f98ba => generated 608 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:30.308993 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a72dd-4e2f-441d-967e-2bc5cd6c430d None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:30.309277 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a72dd-4e2f-441d-967e-2bc5cd6c430d None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:30.309580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a72dd-4e2f-441d-967e-2bc5cd6c430d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:30.338124 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-942a72dd-4e2f-441d-967e-2bc5cd6c430d None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:30.341071 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-942a72dd-4e2f-441d-967e-2bc5cd6c430d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:30.347629 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:30.521443 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 320/636] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:13:30.521443 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a72dd-4e2f-441d-967e-2bc5cd6c430d None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:30.539666 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad26d0f5-162f-46c2-b676-71589c1d18f5 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:30.581880 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:30.621856 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184695e-6702-4441-9294-d699138d3961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:30.622946 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184695e-6702-4441-9294-d699138d3961 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:30.623446 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184695e-6702-4441-9294-d699138d3961 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:30.623935 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184695e-6702-4441-9294-d699138d3961 None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:30.625125 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3184695e-6702-4441-9294-d699138d3961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:30.625707 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3184695e-6702-4441-9294-d699138d3961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:30.628472 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3184695e-6702-4441-9294-d699138d3961 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:30.654694 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 317/637] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:30.656982 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc56ad1-ba74-45b4-8fdf-807c5eab2ba3 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:30.657895 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc56ad1-ba74-45b4-8fdf-807c5eab2ba3 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:30.658164 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc56ad1-ba74-45b4-8fdf-807c5eab2ba3 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:30.662848 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 318/638] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:30.667298 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc56ad1-ba74-45b4-8fdf-807c5eab2ba3 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:30.816037 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a72dd-4e2f-441d-967e-2bc5cd6c430d None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:30.879743 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83841f-2c85-45af-9bcb-30dede40a1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:30.880414 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83841f-2c85-45af-9bcb-30dede40a1a8 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:30.880699 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83841f-2c85-45af-9bcb-30dede40a1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:30.881003 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83841f-2c85-45af-9bcb-30dede40a1a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:30.894313 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:30.898048 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83841f-2c85-45af-9bcb-30dede40a1a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:30.899438 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83841f-2c85-45af-9bcb-30dede40a1a8 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:30.926892 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-9b83841f-2c85-45af-9bcb-30dede40a1a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:30.926892 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:30.926892 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:30.926892 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:30.926892 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:30.926892 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:30.926892 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:30.926892 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:30.926892 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:30.926892 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:30.926892 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:30.926892 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:30.926892 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:30.926892 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:30.926892 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:30.926892 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:30.929012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:30.929012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:30.929012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:30.929012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:30.929012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:30.929012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:30.929012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:30.929012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:30.929012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:30.929012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:30.929012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:30.929012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:30.929012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:30.929012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:30.929012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:30.929012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:30.929012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:30.930908 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:30.930908 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:30.930908 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:30.934309 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 321/639] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:30.936582 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a527c-71d2-47c9-98d2-ba335bb3cb60 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:30.937326 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a527c-71d2-47c9-98d2-ba335bb3cb60 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:30.937920 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a527c-71d2-47c9-98d2-ba335bb3cb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:30.959311 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc56ad1-ba74-45b4-8fdf-807c5eab2ba3 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:30.974994 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-377a527c-71d2-47c9-98d2-ba335bb3cb60 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:30.977340 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-377a527c-71d2-47c9-98d2-ba335bb3cb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:31.050872 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17445a-cc60-4dc2-acd0-3e99c7e63152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:31.051942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17445a-cc60-4dc2-acd0-3e99c7e63152 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:31.052412 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17445a-cc60-4dc2-acd0-3e99c7e63152 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:31.052890 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17445a-cc60-4dc2-acd0-3e99c7e63152 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:31.067581 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17445a-cc60-4dc2-acd0-3e99c7e63152 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:31.070315 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17445a-cc60-4dc2-acd0-3e99c7e63152 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:31.095297 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-4c17445a-cc60-4dc2-acd0-3e99c7e63152 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:31.095297 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:31.095297 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:31.095297 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:31.095297 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:31.095297 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:31.095297 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:31.095297 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:31.095297 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:31.095297 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:31.095297 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:31.095297 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:31.095297 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:13:31.095297 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:13:31.095297 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:13:31.096649 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:13:31.096649 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:31.096649 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:31.096649 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:31.096649 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:31.096649 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:31.096649 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:31.096649 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:31.096649 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:31.096649 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:31.096649 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:31.096649 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:31.096649 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:31.096649 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:31.096649 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:31.096649 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:31.096649 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:31.106188 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:13:31.106188 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:13:31.106188 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:13:31.106188 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:13:31.106188 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:13:31.106188 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:13:31.106188 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:31.106188 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:31.106188 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 319/640] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 432 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:31.106188 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17445a-cc60-4dc2-acd0-3e99c7e63152 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:31.149413 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 322/641] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:13:31.149413 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a527c-71d2-47c9-98d2-ba335bb3cb60 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:31.181516 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:31.324625 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17445a-cc60-4dc2-acd0-3e99c7e63152 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:31.370303 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a527c-71d2-47c9-98d2-ba335bb3cb60 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:31.396194 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3f374-38c0-47ba-8449-1c732c2b950f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:31.396901 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3f374-38c0-47ba-8449-1c732c2b950f None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:31.397207 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3f374-38c0-47ba-8449-1c732c2b950f None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:31.397560 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3f374-38c0-47ba-8449-1c732c2b950f None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:31.398442 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3f374-38c0-47ba-8449-1c732c2b950f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:31.398844 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3f374-38c0-47ba-8449-1c732c2b950f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:31.400483 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3f374-38c0-47ba-8449-1c732c2b950f None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:31.416428 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:31.430010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 320/642] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:31.431522 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3f374-38c0-47ba-8449-1c732c2b950f None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:31.441203 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72212df3-5742-4629-ae8c-2bca79293fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:31.442513 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72212df3-5742-4629-ae8c-2bca79293fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:31.443101 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72212df3-5742-4629-ae8c-2bca79293fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:31.443685 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72212df3-5742-4629-ae8c-2bca79293fc6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:31.466429 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72212df3-5742-4629-ae8c-2bca79293fc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:13:31.476643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-72212df3-5742-4629-ae8c-2bca79293fc6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:13:31.476643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:31.476643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:31.476643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:31.476643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:31.476643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:31.476643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:31.476643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:31.476643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:31.476643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:31.476643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:31.476643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:31.476643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:13:31.476643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:13:31.476643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:13:31.476643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:13:31.478506 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:13:31.478506 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:13:31.478506 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:13:31.478506 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:13:31.478506 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:31.478506 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:31.478506 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:31.478506 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:31.478506 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:31.478506 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:31.478506 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:31.478506 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:31.478506 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:31.478506 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:31.478506 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:31.478506 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:31.480642 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:31.480642 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:31.480642 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:31.480642 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:31.480642 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:13:31.480642 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:13:31.480642 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:13:31.480642 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:13:31.480642 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:13:31.480642 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:13:31.480642 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:13:31.480642 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:31.485714 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 323/643] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Aug 23 22:13:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:31.493800 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72212df3-5742-4629-ae8c-2bca79293fc6 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:31.610366 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:31.622383 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3f374-38c0-47ba-8449-1c732c2b950f None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:31.690620 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72212df3-5742-4629-ae8c-2bca79293fc6 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:31.697110 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12546c-f9e7-4650-a957-02522b60d5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:31.697915 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12546c-f9e7-4650-a957-02522b60d5c4 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:31.698234 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12546c-f9e7-4650-a957-02522b60d5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:31.699106 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12546c-f9e7-4650-a957-02522b60d5c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:31.700072 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd12546c-f9e7-4650-a957-02522b60d5c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:31.700491 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd12546c-f9e7-4650-a957-02522b60d5c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:31.702749 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd12546c-f9e7-4650-a957-02522b60d5c4 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:31.728546 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 321/644] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:13:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:31.729704 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12546c-f9e7-4650-a957-02522b60d5c4 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:31.765222 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55352cac-dafe-4347-851f-68c1ab836ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:31.766171 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55352cac-dafe-4347-851f-68c1ab836ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:31.766590 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55352cac-dafe-4347-851f-68c1ab836ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:31.767004 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55352cac-dafe-4347-851f-68c1ab836ad8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:31.785769 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55352cac-dafe-4347-851f-68c1ab836ad8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:31.790060 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55352cac-dafe-4347-851f-68c1ab836ad8 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:31.808402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-55352cac-dafe-4347-851f-68c1ab836ad8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 22:13:31.808402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:31.808402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:31.808402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:31.808402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:31.808402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:31.808402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:31.808402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:31.808402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:31.808402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:31.808402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:31.808402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:31.808402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:13:31.808402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:13:31.808402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:13:31.808402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:13:31.810514 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:31.810514 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:31.810514 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:13:31.810514 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:31.810514 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:13:31.810514 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:31.810514 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:31.810514 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:31.810514 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:31.810514 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:31.810514 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:31.810514 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:31.810514 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:31.810514 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:31.810514 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:31.810514 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:31.810514 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:31.810514 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:31.812815 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:31.812815 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:31.812815 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:13:31.812815 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:13:31.812815 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:13:31.812815 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:13:31.812815 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:13:31.812815 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:13:31.812815 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 22:13:31.812815 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:31.817631 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 324/645] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:13:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:31.819090 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55352cac-dafe-4347-851f-68c1ab836ad8 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:31.898816 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:31.931017 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12546c-f9e7-4650-a957-02522b60d5c4 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:32.003495 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725f0b7-21f8-4016-8865-2adc67f9c5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:32.005008 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725f0b7-21f8-4016-8865-2adc67f9c5a2 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:32.005685 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725f0b7-21f8-4016-8865-2adc67f9c5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:32.006039 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725f0b7-21f8-4016-8865-2adc67f9c5a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:32.008581 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0725f0b7-21f8-4016-8865-2adc67f9c5a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:32.008581 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0725f0b7-21f8-4016-8865-2adc67f9c5a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:32.010503 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0725f0b7-21f8-4016-8865-2adc67f9c5a2 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:32.025618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 322/646] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Aug 23 22:13:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:32.026454 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725f0b7-21f8-4016-8865-2adc67f9c5a2 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:32.030836 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55352cac-dafe-4347-851f-68c1ab836ad8 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:32.062068 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:32.115342 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c178d-90c6-43c9-ad2c-92a01683d6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:32.116451 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c178d-90c6-43c9-ad2c-92a01683d6aa None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:32.116944 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c178d-90c6-43c9-ad2c-92a01683d6aa None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:32.117474 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c178d-90c6-43c9-ad2c-92a01683d6aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:32.138385 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c178d-90c6-43c9-ad2c-92a01683d6aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:13:32.148691 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-620c178d-90c6-43c9-ad2c-92a01683d6aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:13:32.148691 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:32.148691 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:32.148691 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:32.148691 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:32.148691 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:32.148691 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:32.148691 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:32.148691 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:32.148691 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:32.148691 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:32.148691 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:32.148691 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:13:32.148691 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:13:32.148691 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:13:32.148691 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:13:32.149978 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:13:32.149978 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:13:32.149978 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:13:32.149978 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:13:32.149978 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:32.149978 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:32.149978 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:32.149978 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:32.149978 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:32.149978 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:32.149978 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:32.149978 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:32.149978 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:32.149978 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:32.149978 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:32.149978 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:32.151241 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:32.151241 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:32.151241 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:32.151241 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:32.151241 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:13:32.151241 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:13:32.151241 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:13:32.151241 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:13:32.151241 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:13:32.151241 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:13:32.151241 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:13:32.151241 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:32.151241 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 325/647] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Aug 23 22:13:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:32.153768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c178d-90c6-43c9-ad2c-92a01683d6aa None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:32.260441 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725f0b7-21f8-4016-8865-2adc67f9c5a2 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:32.338009 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a7199-30fa-47bf-abd7-a265e7066b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:32.338683 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a7199-30fa-47bf-abd7-a265e7066b09 None admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:32.338971 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a7199-30fa-47bf-abd7-a265e7066b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:32.340083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a7199-30fa-47bf-abd7-a265e7066b09 None admin] PATH_INFO: `/v3/projects/da9a86463d68412884746b115667d2fc/users/abda1f23a18c4c808483cd6b53952975/roles/fb1c5c0f0edb47bf828f63bc685f98ba` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:32.340457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c178d-90c6-43c9-ad2c-92a01683d6aa None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:32.343143 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:32.371212 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a7199-30fa-47bf-abd7-a265e7066b09 None admin] RBAC: Authorizing `identity:create_grant(project_id=da9a86463d68412884746b115667d2fc, user_id=abda1f23a18c4c808483cd6b53952975, role_id=fb1c5c0f0edb47bf828f63bc685f98ba)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:32.372877 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a7199-30fa-47bf-abd7-a265e7066b09 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:32.398504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 323/648] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Aug 23 22:13:32 2022] PUT /identity/v3/projects/da9a86463d68412884746b115667d2fc/users/abda1f23a18c4c808483cd6b53952975/roles/fb1c5c0f0edb47bf828f63bc685f98ba => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:13:32.400472 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a7199-30fa-47bf-abd7-a265e7066b09 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:32.434637 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb29e2-4f58-4a7e-acc1-1846a892cf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:32.435827 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb29e2-4f58-4a7e-acc1-1846a892cf39 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:32.436462 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb29e2-4f58-4a7e-acc1-1846a892cf39 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:32.437340 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb29e2-4f58-4a7e-acc1-1846a892cf39 None admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:32.439525 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb29e2-4f58-4a7e-acc1-1846a892cf39 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:32.440081 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb29e2-4f58-4a7e-acc1-1846a892cf39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:32.443415 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb29e2-4f58-4a7e-acc1-1846a892cf39 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:32.497858 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 326/649] 10.222.0.77 () {56 vars in 1137 bytes} [Tue Aug 23 22:13:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:32.499456 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb29e2-4f58-4a7e-acc1-1846a892cf39 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:32.554570 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:32.642836 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a7199-30fa-47bf-abd7-a265e7066b09 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:32.735541 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c08a61-11c5-42ce-a149-87b97a16bc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:32.736860 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c08a61-11c5-42ce-a149-87b97a16bc79 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:32.737501 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c08a61-11c5-42ce-a149-87b97a16bc79 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:32.738117 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c08a61-11c5-42ce-a149-87b97a16bc79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:32.747169 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb29e2-4f58-4a7e-acc1-1846a892cf39 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:32.767052 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c08a61-11c5-42ce-a149-87b97a16bc79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:32.769548 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c08a61-11c5-42ce-a149-87b97a16bc79 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:32.814536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-e7c08a61-11c5-42ce-a149-87b97a16bc79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:32.814536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:32.814536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:32.814536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:32.814536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:32.814536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:32.814536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:32.814536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:32.814536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:32.814536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:32.814536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:32.814536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:32.814536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:32.814536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:32.814536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:32.814536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:32.816967 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:32.816967 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:32.816967 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:32.816967 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:32.816967 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:32.816967 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:32.816967 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:32.816967 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:32.816967 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:32.816967 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:32.816967 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:32.816967 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:32.816967 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:32.816967 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:32.816967 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:32.816967 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:32.816967 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:32.819104 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:32.819104 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:32.819104 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:32.820664 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 324/650] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:32.827391 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c08a61-11c5-42ce-a149-87b97a16bc79 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:32.838326 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9018552-7c3f-4248-aa9e-382287811c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:32.839703 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9018552-7c3f-4248-aa9e-382287811c6f None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:32.843372 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9018552-7c3f-4248-aa9e-382287811c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:32.844649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9018552-7c3f-4248-aa9e-382287811c6f None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:32.846675 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9018552-7c3f-4248-aa9e-382287811c6f None admin] RBAC: Adding query filter params (name=service) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:32.848829 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9018552-7c3f-4248-aa9e-382287811c6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:32.851878 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9018552-7c3f-4248-aa9e-382287811c6f None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:32.869580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 327/651] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Aug 23 22:13:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:32.871984 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9018552-7c3f-4248-aa9e-382287811c6f None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:32.928899 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:33.065606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c08a61-11c5-42ce-a149-87b97a16bc79 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:33.095643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9018552-7c3f-4248-aa9e-382287811c6f None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:33.109709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:33.142534 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432b6f0-46b8-44a3-930a-9121c52326c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:33.143527 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432b6f0-46b8-44a3-930a-9121c52326c9 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:33.144003 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432b6f0-46b8-44a3-930a-9121c52326c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:33.144466 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432b6f0-46b8-44a3-930a-9121c52326c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:33.166067 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a95e58-ecaa-4c1d-9c91-5b00e97a85bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:33.167683 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a95e58-ecaa-4c1d-9c91-5b00e97a85bb None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:33.168465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a95e58-ecaa-4c1d-9c91-5b00e97a85bb None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:33.169200 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a95e58-ecaa-4c1d-9c91-5b00e97a85bb None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:33.170779 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a95e58-ecaa-4c1d-9c91-5b00e97a85bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:33.171661 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a95e58-ecaa-4c1d-9c91-5b00e97a85bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:33.174470 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a95e58-ecaa-4c1d-9c91-5b00e97a85bb None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:33.198128 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 328/652] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:33.213690 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a95e58-ecaa-4c1d-9c91-5b00e97a85bb None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:33.296233 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432b6f0-46b8-44a3-930a-9121c52326c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:33.299110 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432b6f0-46b8-44a3-930a-9121c52326c9 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:33.373839 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:33.411936 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a95e58-ecaa-4c1d-9c91-5b00e97a85bb None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:33.476613 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065c2a8-3a63-4a5c-9ac8-1db9b34ce8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:33.478046 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065c2a8-3a63-4a5c-9ac8-1db9b34ce8af None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:33.478627 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065c2a8-3a63-4a5c-9ac8-1db9b34ce8af None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:33.479274 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065c2a8-3a63-4a5c-9ac8-1db9b34ce8af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:33.496162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 325/653] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:13:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:13:33.497919 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065c2a8-3a63-4a5c-9ac8-1db9b34ce8af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:33.498591 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432b6f0-46b8-44a3-930a-9121c52326c9 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:33.500275 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065c2a8-3a63-4a5c-9ac8-1db9b34ce8af None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:33.523540 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-7065c2a8-3a63-4a5c-9ac8-1db9b34ce8af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:33.523540 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:33.523540 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:33.523540 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:33.523540 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:33.523540 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:33.523540 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:33.523540 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:33.523540 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:33.523540 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:33.523540 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:33.523540 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:33.523540 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:33.523540 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:33.523540 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:33.523540 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:33.525887 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:33.525887 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:33.525887 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:33.525887 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:33.525887 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:33.525887 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:33.525887 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:33.525887 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:33.525887 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:33.525887 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:33.525887 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:33.525887 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:33.525887 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:33.525887 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:33.525887 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:33.525887 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:33.525887 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:33.528505 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:33.528505 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:33.528505 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:33.533531 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 329/654] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:33.533531 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065c2a8-3a63-4a5c-9ac8-1db9b34ce8af None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:33.556086 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:33.702046 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432b6f0-46b8-44a3-930a-9121c52326c9 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:33.722296 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065c2a8-3a63-4a5c-9ac8-1db9b34ce8af None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:33.771379 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeecc06f-fa92-4dc7-addd-479d89193223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:33.772624 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecc06f-fa92-4dc7-addd-479d89193223 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:33.773102 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecc06f-fa92-4dc7-addd-479d89193223 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:33.773625 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecc06f-fa92-4dc7-addd-479d89193223 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:33.789838 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeecc06f-fa92-4dc7-addd-479d89193223 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:33.793422 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeecc06f-fa92-4dc7-addd-479d89193223 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:33.813471 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4d374-3884-4cf7-807e-223f0850fa8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:33.814897 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4d374-3884-4cf7-807e-223f0850fa8d None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:33.815610 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4d374-3884-4cf7-807e-223f0850fa8d None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:33.816207 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4d374-3884-4cf7-807e-223f0850fa8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:33.816567 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-aeecc06f-fa92-4dc7-addd-479d89193223 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 22:13:33.816567 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:33.816567 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:33.816567 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:33.816567 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:33.816567 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:33.816567 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:33.816567 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:33.816567 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:33.816567 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:33.816567 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:33.816567 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:33.816567 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:13:33.816567 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:13:33.816567 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:13:33.816567 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:13:33.817801 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:33.817801 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:33.817801 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:13:33.817801 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:33.817801 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:13:33.817801 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:33.817801 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:33.817801 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:33.817801 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:33.817801 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:33.817801 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:33.817801 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:33.817801 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:33.817801 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:33.817801 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:33.817801 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:33.817801 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:33.817801 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:33.818883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:33.818883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:33.818883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:13:33.818883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:13:33.818883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:13:33.818883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:13:33.818883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:13:33.818883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:13:33.818883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 22:13:33.818883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:33.818883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 326/655] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Aug 23 22:13:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:33.820304 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeecc06f-fa92-4dc7-addd-479d89193223 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:33.823310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:33.844227 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4d374-3884-4cf7-807e-223f0850fa8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:33.846978 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4d374-3884-4cf7-807e-223f0850fa8d None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:33.875469 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-2fb4d374-3884-4cf7-807e-223f0850fa8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:33.875469 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:33.875469 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:33.875469 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:33.875469 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:33.875469 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:33.875469 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:33.875469 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:33.875469 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:33.875469 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:33.875469 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:33.875469 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:33.875469 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:33.875469 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:33.875469 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:33.875469 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:33.877910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:33.877910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:33.877910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:33.877910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:33.877910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:33.877910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:33.877910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:33.877910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:33.877910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:33.877910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:33.877910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:33.877910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:33.877910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:33.877910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:33.877910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:33.877910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:33.877910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:33.879831 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:33.879831 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:33.879831 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:33.886489 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 330/656] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:33.889199 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc2f61-bfed-46fd-a05d-f00b8a39e64e None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:33.889682 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc2f61-bfed-46fd-a05d-f00b8a39e64e None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:33.890368 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc2f61-bfed-46fd-a05d-f00b8a39e64e None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:33.898132 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 331/657] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:33 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:33.899208 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc2f61-bfed-46fd-a05d-f00b8a39e64e None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:34.008240 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:34.052717 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeecc06f-fa92-4dc7-addd-479d89193223 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:34.117788 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc2f61-bfed-46fd-a05d-f00b8a39e64e None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:34.128651 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3332b96-01ab-49ce-9ae7-7d72055d65f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:34.129710 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3332b96-01ab-49ce-9ae7-7d72055d65f7 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:34.130140 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3332b96-01ab-49ce-9ae7-7d72055d65f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:34.130618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3332b96-01ab-49ce-9ae7-7d72055d65f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:34.131484 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3332b96-01ab-49ce-9ae7-7d72055d65f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:34.131986 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3332b96-01ab-49ce-9ae7-7d72055d65f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:34.133606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3332b96-01ab-49ce-9ae7-7d72055d65f7 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:34.158014 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 327/658] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:34.158014 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3332b96-01ab-49ce-9ae7-7d72055d65f7 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:34.211248 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b39fd5-f9b8-45ca-94c1-a06534cda6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:34.212293 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b39fd5-f9b8-45ca-94c1-a06534cda6e4 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:34.212794 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b39fd5-f9b8-45ca-94c1-a06534cda6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:34.213275 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b39fd5-f9b8-45ca-94c1-a06534cda6e4 None admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:34.215650 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b39fd5-f9b8-45ca-94c1-a06534cda6e4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:34.216229 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b39fd5-f9b8-45ca-94c1-a06534cda6e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:34.219070 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b39fd5-f9b8-45ca-94c1-a06534cda6e4 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:34.261485 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 332/659] 10.222.0.77 () {56 vars in 1139 bytes} [Tue Aug 23 22:13:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:34.262520 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f147d55-0f83-46c0-8d9f-d7a4d87a7ec3 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:34.263969 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f147d55-0f83-46c0-8d9f-d7a4d87a7ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:34.263969 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f147d55-0f83-46c0-8d9f-d7a4d87a7ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:34.299178 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-9f147d55-0f83-46c0-8d9f-d7a4d87a7ec3 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:34.300461 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-9f147d55-0f83-46c0-8d9f-d7a4d87a7ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:34.353900 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3332b96-01ab-49ce-9ae7-7d72055d65f7 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:34.373841 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:34.416371 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 333/660] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:13:34.418520 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f147d55-0f83-46c0-8d9f-d7a4d87a7ec3 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:34.429939 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6997b-c33d-4ba1-9fad-5737e6b24f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:34.431332 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6997b-c33d-4ba1-9fad-5737e6b24f2d None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:34.432093 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6997b-c33d-4ba1-9fad-5737e6b24f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:34.432858 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6997b-c33d-4ba1-9fad-5737e6b24f2d None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:34.435527 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6997b-c33d-4ba1-9fad-5737e6b24f2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:34.436418 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6997b-c33d-4ba1-9fad-5737e6b24f2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:34.439694 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6997b-c33d-4ba1-9fad-5737e6b24f2d None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:34.463084 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:34.477415 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 328/661] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:34.477415 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6997b-c33d-4ba1-9fad-5737e6b24f2d None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:34.620203 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f147d55-0f83-46c0-8d9f-d7a4d87a7ec3 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:34.676226 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a169b-eacd-4ed7-a5c5-cfd5acc2b11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:34.676909 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a169b-eacd-4ed7-a5c5-cfd5acc2b11f None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:34.677211 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a169b-eacd-4ed7-a5c5-cfd5acc2b11f None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:34.677522 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a169b-eacd-4ed7-a5c5-cfd5acc2b11f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:34.689963 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a169b-eacd-4ed7-a5c5-cfd5acc2b11f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:34.691685 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a169b-eacd-4ed7-a5c5-cfd5acc2b11f None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:34.716035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-a68a169b-eacd-4ed7-a5c5-cfd5acc2b11f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 22:13:34.716035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:34.716035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:34.716035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:34.716035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:34.716035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:34.716035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:34.716035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:34.716035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:34.716035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:34.716035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:34.716035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:34.716035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:13:34.716035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:13:34.716035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:13:34.716035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:13:34.717170 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:34.717170 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:34.717170 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:13:34.717170 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:34.717170 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:13:34.717170 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:34.717170 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:34.717170 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:34.717170 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:34.717170 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:34.717170 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:34.717170 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:34.717170 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:34.717170 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:34.717170 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:34.717170 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:34.717170 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:34.717170 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:34.718418 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:34.718418 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:34.718418 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:13:34.718418 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:13:34.718418 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:13:34.718418 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:13:34.718418 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:13:34.718418 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:13:34.718418 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 22:13:34.718418 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:34.719475 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 334/662] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:13:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:34.729622 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a169b-eacd-4ed7-a5c5-cfd5acc2b11f None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:34.766190 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6997b-c33d-4ba1-9fad-5737e6b24f2d None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:34.779530 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:34.828158 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0ae23-2d0d-4aa4-9574-ffd0daf7b982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:34.829691 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0ae23-2d0d-4aa4-9574-ffd0daf7b982 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:34.830654 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0ae23-2d0d-4aa4-9574-ffd0daf7b982 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:34.831351 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0ae23-2d0d-4aa4-9574-ffd0daf7b982 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:34.866736 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a169b-eacd-4ed7-a5c5-cfd5acc2b11f None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:34.922964 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25fdea-38f5-4101-85f0-0fe7261e3c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:34.924632 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25fdea-38f5-4101-85f0-0fe7261e3c99 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:34.925438 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25fdea-38f5-4101-85f0-0fe7261e3c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:34.926231 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25fdea-38f5-4101-85f0-0fe7261e3c99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:34.939234 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25fdea-38f5-4101-85f0-0fe7261e3c99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:34.942038 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25fdea-38f5-4101-85f0-0fe7261e3c99 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:34.957893 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:34.962355 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0ae23-2d0d-4aa4-9574-ffd0daf7b982 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:34.962541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-ba25fdea-38f5-4101-85f0-0fe7261e3c99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:34.962541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:34.962541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:34.962541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:34.962541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:34.962541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:34.962541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:34.962541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:34.962541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:34.962541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:34.962541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:34.962541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:34.962541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:13:34.962541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:13:34.962541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:13:34.965147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:13:34.965147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:34.965147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:34.965147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:34.965147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:34.965147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:34.965147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:34.965147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:34.965147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:34.965147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:34.965147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:34.965147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:34.965147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:34.965147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:34.965147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:34.965147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:34.965147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:34.969432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:13:34.969432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:13:34.969432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:13:34.969432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:13:34.969432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:13:34.969432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:13:34.969432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:34.969432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:34.969432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 335/663] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:34.969432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25fdea-38f5-4101-85f0-0fe7261e3c99 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:34.976590 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0ae23-2d0d-4aa4-9574-ffd0daf7b982 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:35.149668 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:35.165026 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25fdea-38f5-4101-85f0-0fe7261e3c99 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:35.178810 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 329/664] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:13:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:13:35.180043 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0ae23-2d0d-4aa4-9574-ffd0daf7b982 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:35.232681 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e1fe7-1275-42d6-a1ff-3cd95c824bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:35.233752 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e1fe7-1275-42d6-a1ff-3cd95c824bcf None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:35.234247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e1fe7-1275-42d6-a1ff-3cd95c824bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:35.234739 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e1fe7-1275-42d6-a1ff-3cd95c824bcf None admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:35.236007 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e1fe7-1275-42d6-a1ff-3cd95c824bcf None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:35.236316 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e1fe7-1275-42d6-a1ff-3cd95c824bcf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:35.237865 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e1fe7-1275-42d6-a1ff-3cd95c824bcf None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:35.272974 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 336/665] 10.222.0.77 () {56 vars in 1137 bytes} [Tue Aug 23 22:13:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:35.279709 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e1fe7-1275-42d6-a1ff-3cd95c824bcf None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:35.334300 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:35.340097 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0ae23-2d0d-4aa4-9574-ffd0daf7b982 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:35.412057 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2efbf-40dd-404a-b01c-1eb4d602e177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:35.413584 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2efbf-40dd-404a-b01c-1eb4d602e177 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:35.414162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2efbf-40dd-404a-b01c-1eb4d602e177 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:35.414645 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2efbf-40dd-404a-b01c-1eb4d602e177 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:35.433517 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2efbf-40dd-404a-b01c-1eb4d602e177 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:13:35.441954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-33c2efbf-40dd-404a-b01c-1eb4d602e177 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:13:35.441954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:35.441954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:35.441954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:35.441954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:35.441954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:35.441954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:35.441954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:35.441954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:35.441954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:35.441954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:35.441954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:35.441954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:13:35.441954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:13:35.441954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:13:35.441954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:13:35.443129 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:13:35.443129 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:13:35.443129 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:13:35.443129 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:13:35.443129 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:35.443129 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:35.443129 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:35.443129 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:35.443129 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:35.443129 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:35.443129 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:35.443129 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:35.443129 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:35.443129 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:35.443129 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:35.443129 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:35.444291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:35.444291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:35.444291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:35.444291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:35.444291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:13:35.444291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:13:35.444291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:13:35.444291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:13:35.444291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:13:35.444291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:13:35.444291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:13:35.444291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:35.444291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 330/666] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:13:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:35.446571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2efbf-40dd-404a-b01c-1eb4d602e177 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:35.461247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e1fe7-1275-42d6-a1ff-3cd95c824bcf None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:35.530499 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f17d4-7de0-4440-98f1-03af1f669051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:35.531520 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f17d4-7de0-4440-98f1-03af1f669051 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:35.532108 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f17d4-7de0-4440-98f1-03af1f669051 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:35.532398 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f17d4-7de0-4440-98f1-03af1f669051 None admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:35.533393 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f17d4-7de0-4440-98f1-03af1f669051 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:35.533762 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f17d4-7de0-4440-98f1-03af1f669051 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:35.536182 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f17d4-7de0-4440-98f1-03af1f669051 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:35.565505 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 337/667] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:13:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:35.565505 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f17d4-7de0-4440-98f1-03af1f669051 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:35.597091 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:35.655931 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2efbf-40dd-404a-b01c-1eb4d602e177 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:35.707445 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c14af-146b-4cd3-bad1-c2ce0b804928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:35.708122 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c14af-146b-4cd3-bad1-c2ce0b804928 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:35.708496 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c14af-146b-4cd3-bad1-c2ce0b804928 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:35.708735 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c14af-146b-4cd3-bad1-c2ce0b804928 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:35.726496 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c14af-146b-4cd3-bad1-c2ce0b804928 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:35.728653 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c14af-146b-4cd3-bad1-c2ce0b804928 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:35.749766 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-4d0c14af-146b-4cd3-bad1-c2ce0b804928 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:35.749766 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:35.749766 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:35.749766 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:35.749766 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:35.749766 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:35.749766 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:35.749766 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:35.749766 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:35.749766 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:35.749766 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:35.749766 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:35.749766 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:35.749766 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:35.749766 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:35.749766 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:35.755640 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:35.755640 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:35.755640 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:35.755640 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:35.755640 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:35.755640 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:35.755640 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:35.755640 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:35.755640 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:35.755640 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:35.755640 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:35.755640 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:35.755640 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:35.755640 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:35.755640 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:35.755640 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:35.755640 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:35.757567 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:35.757567 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:35.757567 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:35.757567 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 331/668] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:35.757567 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c14af-146b-4cd3-bad1-c2ce0b804928 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:35.773602 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f17d4-7de0-4440-98f1-03af1f669051 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:35.781568 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:35.838038 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96451ea7-82e8-4686-8295-7f198e023388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:35.838962 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96451ea7-82e8-4686-8295-7f198e023388 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:35.839413 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96451ea7-82e8-4686-8295-7f198e023388 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:35.839866 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96451ea7-82e8-4686-8295-7f198e023388 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:35.942783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96451ea7-82e8-4686-8295-7f198e023388 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:35.943976 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c14af-146b-4cd3-bad1-c2ce0b804928 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:35.945019 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96451ea7-82e8-4686-8295-7f198e023388 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:35.963089 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:35.995961 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96adcfa-18e3-4eaa-8539-114090769a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:35.996990 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96adcfa-18e3-4eaa-8539-114090769a6a None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:35.997546 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96adcfa-18e3-4eaa-8539-114090769a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:35.997932 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96adcfa-18e3-4eaa-8539-114090769a6a None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:35.998714 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96adcfa-18e3-4eaa-8539-114090769a6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:35.999036 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96adcfa-18e3-4eaa-8539-114090769a6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:36.001131 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96adcfa-18e3-4eaa-8539-114090769a6a None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:36.012625 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 332/669] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:13:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:36.013523 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96adcfa-18e3-4eaa-8539-114090769a6a None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:36.116627 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 338/670] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:13:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:13:36.118880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bc5ba-8530-4a78-8f73-e67d8d5be9ba None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:36.119383 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bc5ba-8530-4a78-8f73-e67d8d5be9ba None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:36.119876 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bc5ba-8530-4a78-8f73-e67d8d5be9ba None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:36.122509 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 339/671] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:36.123950 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615bc5ba-8530-4a78-8f73-e67d8d5be9ba None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:36.153982 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:36.195911 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96adcfa-18e3-4eaa-8539-114090769a6a None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:36.249485 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828db34-d6c9-4242-8c75-65e538c3622b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:36.250112 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828db34-d6c9-4242-8c75-65e538c3622b None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:36.250442 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828db34-d6c9-4242-8c75-65e538c3622b None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:36.250748 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828db34-d6c9-4242-8c75-65e538c3622b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:36.251585 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6828db34-d6c9-4242-8c75-65e538c3622b None admin] RBAC: Adding query filter params (role.id=fb1c5c0f0edb47bf828f63bc685f98ba, scope.project.id=da9a86463d68412884746b115667d2fc, user.id=855cbc7a992d4c6697632d2d4d74abfb) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:36.252092 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6828db34-d6c9-4242-8c75-65e538c3622b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:36.254301 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6828db34-d6c9-4242-8c75-65e538c3622b None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:36.261928 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 333/672] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:13:36 2022] GET /identity/v3/role_assignments?user.id=855cbc7a992d4c6697632d2d4d74abfb&scope.project.id=da9a86463d68412884746b115667d2fc&role.id=fb1c5c0f0edb47bf828f63bc685f98ba => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:36.263459 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828db34-d6c9-4242-8c75-65e538c3622b None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:36.319830 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615bc5ba-8530-4a78-8f73-e67d8d5be9ba None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:36.349764 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:36.402994 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2641c9-8ddd-4c47-aa50-b83ee7ac8574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:36.406378 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2641c9-8ddd-4c47-aa50-b83ee7ac8574 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:36.406809 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2641c9-8ddd-4c47-aa50-b83ee7ac8574 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:36.407065 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2641c9-8ddd-4c47-aa50-b83ee7ac8574 None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:36.408057 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2641c9-8ddd-4c47-aa50-b83ee7ac8574 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:36.408501 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2641c9-8ddd-4c47-aa50-b83ee7ac8574 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:36.410631 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2641c9-8ddd-4c47-aa50-b83ee7ac8574 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:36.444225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 340/673] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:36.445076 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2641c9-8ddd-4c47-aa50-b83ee7ac8574 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:36.468347 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828db34-d6c9-4242-8c75-65e538c3622b None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:36.556154 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234cd5d-061f-46d0-b260-d9b2d06df7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:36.557253 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234cd5d-061f-46d0-b260-d9b2d06df7e6 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:36.559795 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234cd5d-061f-46d0-b260-d9b2d06df7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:36.560461 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234cd5d-061f-46d0-b260-d9b2d06df7e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:36.582201 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:36.594928 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234cd5d-061f-46d0-b260-d9b2d06df7e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:36.598889 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234cd5d-061f-46d0-b260-d9b2d06df7e6 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:36.633645 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-a234cd5d-061f-46d0-b260-d9b2d06df7e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:36.633645 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:36.633645 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:36.633645 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:36.633645 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:36.633645 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:36.633645 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:36.633645 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:36.633645 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:36.633645 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:36.633645 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:36.633645 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:36.633645 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:36.633645 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:36.633645 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:36.633645 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:36.640689 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:36.640689 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:36.640689 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:36.640689 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:36.640689 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:36.640689 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:36.640689 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:36.640689 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:36.640689 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:36.640689 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:36.640689 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:36.640689 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:36.640689 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:36.640689 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:36.640689 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:36.640689 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:36.640689 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:36.642463 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:36.642463 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:36.642463 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:36.642463 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 334/674] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:36.642463 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5716512-4197-4fa9-b144-ef8d9cc63b4d None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:36.642463 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5716512-4197-4fa9-b144-ef8d9cc63b4d None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:36.642463 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5716512-4197-4fa9-b144-ef8d9cc63b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:36.665087 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-e5716512-4197-4fa9-b144-ef8d9cc63b4d None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:36.665799 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2641c9-8ddd-4c47-aa50-b83ee7ac8574 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:36.666463 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-e5716512-4197-4fa9-b144-ef8d9cc63b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:36.748456 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d2c08-e0f7-40bb-b4c1-f80f0abfd761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:36.749810 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d2c08-e0f7-40bb-b4c1-f80f0abfd761 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:36.750451 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d2c08-e0f7-40bb-b4c1-f80f0abfd761 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:36.751043 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d2c08-e0f7-40bb-b4c1-f80f0abfd761 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:36.779989 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d2c08-e0f7-40bb-b4c1-f80f0abfd761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:36.783073 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d2c08-e0f7-40bb-b4c1-f80f0abfd761 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:36.812490 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-5e4d2c08-e0f7-40bb-b4c1-f80f0abfd761 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:36.812490 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:36.812490 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:36.812490 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:36.812490 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:36.812490 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:36.812490 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:36.812490 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:36.812490 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:36.812490 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:36.812490 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:36.812490 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:36.812490 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:36.812490 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:36.812490 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:36.812490 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:36.814107 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:36.814107 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:36.814107 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:36.814107 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:36.814107 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:36.814107 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:36.814107 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:36.814107 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:36.814107 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:36.814107 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:36.814107 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:36.814107 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:36.814107 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:36.814107 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:36.814107 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:36.814107 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:36.814107 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:36.822916 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:36.822916 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:36.822916 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:36.822916 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 341/675] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:36.822916 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d2c08-e0f7-40bb-b4c1-f80f0abfd761 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:36.830774 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 335/676] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:13:36.841196 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5716512-4197-4fa9-b144-ef8d9cc63b4d None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:36.869109 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:36.996715 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d2c08-e0f7-40bb-b4c1-f80f0abfd761 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:37.043023 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5716512-4197-4fa9-b144-ef8d9cc63b4d None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:37.046278 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73ad75-2c6e-4ea2-a922-6d649c5ee461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:37.047246 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73ad75-2c6e-4ea2-a922-6d649c5ee461 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:37.047732 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73ad75-2c6e-4ea2-a922-6d649c5ee461 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:37.049247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73ad75-2c6e-4ea2-a922-6d649c5ee461 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:37.057549 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73ad75-2c6e-4ea2-a922-6d649c5ee461 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:37.059511 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73ad75-2c6e-4ea2-a922-6d649c5ee461 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:37.075918 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-4a73ad75-2c6e-4ea2-a922-6d649c5ee461 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:37.075918 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:37.075918 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:37.075918 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:37.075918 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:37.075918 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:37.075918 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:37.075918 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:37.075918 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:37.075918 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:37.075918 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:37.075918 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:37.075918 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:13:37.075918 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:13:37.075918 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:13:37.077898 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:13:37.077898 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:37.077898 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:37.077898 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:37.077898 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:37.077898 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:37.077898 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:37.077898 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:37.077898 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:37.077898 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:37.077898 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:37.077898 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:37.077898 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:37.077898 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:37.077898 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:37.077898 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:37.077898 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:37.080632 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:13:37.080632 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:13:37.080632 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:13:37.080632 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:13:37.080632 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:13:37.080632 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:13:37.080632 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:37.080632 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:37.080632 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 342/677] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:37.080632 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73ad75-2c6e-4ea2-a922-6d649c5ee461 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:37.099220 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:37.131409 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fed2a5-13b9-4f72-974e-c0afcb90627b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:37.133550 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fed2a5-13b9-4f72-974e-c0afcb90627b None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:37.134315 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fed2a5-13b9-4f72-974e-c0afcb90627b None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:37.135071 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fed2a5-13b9-4f72-974e-c0afcb90627b None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:37.137040 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fed2a5-13b9-4f72-974e-c0afcb90627b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:37.137957 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fed2a5-13b9-4f72-974e-c0afcb90627b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:37.140800 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fed2a5-13b9-4f72-974e-c0afcb90627b None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:37.167058 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 336/678] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:37.169449 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fed2a5-13b9-4f72-974e-c0afcb90627b None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:37.204575 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:37.228975 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73ad75-2c6e-4ea2-a922-6d649c5ee461 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:37.308117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1c80b-ad06-438a-bd62-71e0b2965808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:37.308859 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1c80b-ad06-438a-bd62-71e0b2965808 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:37.309230 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1c80b-ad06-438a-bd62-71e0b2965808 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:37.309797 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1c80b-ad06-438a-bd62-71e0b2965808 None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:37.310996 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1c80b-ad06-438a-bd62-71e0b2965808 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:37.311405 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1c80b-ad06-438a-bd62-71e0b2965808 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:37.314630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1c80b-ad06-438a-bd62-71e0b2965808 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:37.338617 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 343/679] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:37.340638 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1c80b-ad06-438a-bd62-71e0b2965808 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:37.404466 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fed2a5-13b9-4f72-974e-c0afcb90627b None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:37.485933 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ebd52-10f0-4046-99dc-61dd80986f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:37.486783 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ebd52-10f0-4046-99dc-61dd80986f85 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:37.487203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ebd52-10f0-4046-99dc-61dd80986f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:37.487551 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ebd52-10f0-4046-99dc-61dd80986f85 None admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:37.488324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ebd52-10f0-4046-99dc-61dd80986f85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:37.488694 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ebd52-10f0-4046-99dc-61dd80986f85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:37.491052 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ebd52-10f0-4046-99dc-61dd80986f85 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:37.509424 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 337/680] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:13:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:37.511971 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ebd52-10f0-4046-99dc-61dd80986f85 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:37.548745 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1c80b-ad06-438a-bd62-71e0b2965808 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:37.599463 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:37.610378 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35653681-f90c-43d4-bb04-1ab676f721ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:37.611487 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35653681-f90c-43d4-bb04-1ab676f721ee None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:37.611913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35653681-f90c-43d4-bb04-1ab676f721ee None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:37.612337 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35653681-f90c-43d4-bb04-1ab676f721ee None admin] PATH_INFO: `/v3/users/nova` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:37.623041 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35653681-f90c-43d4-bb04-1ab676f721ee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:37.624967 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35653681-f90c-43d4-bb04-1ab676f721ee None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:37.647993 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-35653681-f90c-43d4-bb04-1ab676f721ee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:13:37.647993 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:37.647993 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:37.647993 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:37.647993 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:37.647993 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:37.647993 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:37.647993 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:37.647993 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:37.647993 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:37.647993 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:37.647993 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:37.647993 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:13:37.647993 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:13:37.647993 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:13:37.647993 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:13:37.649255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:37.649255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:37.649255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:13:37.649255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:37.649255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:13:37.649255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:37.649255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:37.649255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:37.649255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:37.649255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:37.649255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:37.649255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:37.649255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:37.649255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:37.649255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:37.649255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:37.649255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:37.649255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:37.650933 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:37.650933 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:37.650933 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:13:37.650933 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:13:37.650933 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:13:37.650933 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:13:37.650933 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:13:37.650933 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:13:37.650933 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:13:37.650933 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:37.650933 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 344/681] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Aug 23 22:13:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:37.653280 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35653681-f90c-43d4-bb04-1ab676f721ee None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:37.659187 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:37.710241 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ebd52-10f0-4046-99dc-61dd80986f85 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:37.775885 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04aae9-4ce0-45db-b1a5-f4b75f61bf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:37.776769 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04aae9-4ce0-45db-b1a5-f4b75f61bf35 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:37.777337 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04aae9-4ce0-45db-b1a5-f4b75f61bf35 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:37.777791 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04aae9-4ce0-45db-b1a5-f4b75f61bf35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:37.808460 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f04aae9-4ce0-45db-b1a5-f4b75f61bf35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:13:37.818551 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-6f04aae9-4ce0-45db-b1a5-f4b75f61bf35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:13:37.818551 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:37.818551 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:37.818551 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:37.818551 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:37.818551 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:37.818551 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:37.818551 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:37.818551 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:37.818551 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:37.818551 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:37.818551 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:37.818551 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:13:37.818551 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:13:37.818551 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:13:37.818551 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:13:37.821006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:13:37.821006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:13:37.821006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:13:37.821006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:13:37.821006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:37.821006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:37.821006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:37.821006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:37.821006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:37.821006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:37.821006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:37.821006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:37.821006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:37.821006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:37.821006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:37.821006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:37.822571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:37.822571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:37.822571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:37.822571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:37.822571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:13:37.822571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:13:37.822571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:13:37.822571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:13:37.822571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:13:37.822571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:13:37.822571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:13:37.822571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:37.827820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 338/682] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Aug 23 22:13:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:37.827820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04aae9-4ce0-45db-b1a5-f4b75f61bf35 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:37.877957 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35653681-f90c-43d4-bb04-1ab676f721ee None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:37.937991 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf07215-d4f4-4caf-93e8-461e067aac50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:37.939211 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf07215-d4f4-4caf-93e8-461e067aac50 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:37.939681 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf07215-d4f4-4caf-93e8-461e067aac50 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:37.939978 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf07215-d4f4-4caf-93e8-461e067aac50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:37.955924 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf07215-d4f4-4caf-93e8-461e067aac50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:37.958717 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf07215-d4f4-4caf-93e8-461e067aac50 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:37.979262 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-faf07215-d4f4-4caf-93e8-461e067aac50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:37.979262 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:37.979262 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:37.979262 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:37.979262 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:37.979262 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:37.979262 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:37.979262 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:37.979262 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:37.979262 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:37.979262 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:37.979262 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:37.979262 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:13:37.979262 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:13:37.979262 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:13:37.980770 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:13:37.980770 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:37.980770 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:37.980770 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:37.980770 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:37.980770 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:37.980770 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:37.980770 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:37.980770 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:37.980770 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:37.980770 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:37.980770 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:37.980770 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:37.980770 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:37.980770 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:37.980770 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:37.980770 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:37.982292 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:13:37.982292 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:13:37.982292 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:13:37.982292 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:13:37.982292 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:13:37.982292 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:13:37.982292 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:37.982292 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:37.986203 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 345/683] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:37.987192 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf07215-d4f4-4caf-93e8-461e067aac50 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:38.014923 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:38.021020 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04aae9-4ce0-45db-b1a5-f4b75f61bf35 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:38.094160 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041a465-afb4-44ec-97ee-22c178a3afbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:38.095167 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041a465-afb4-44ec-97ee-22c178a3afbd None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:38.095583 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041a465-afb4-44ec-97ee-22c178a3afbd None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:38.095992 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041a465-afb4-44ec-97ee-22c178a3afbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:38.096998 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041a465-afb4-44ec-97ee-22c178a3afbd None admin] RBAC: Adding query filter params (role.id=fb1c5c0f0edb47bf828f63bc685f98ba, scope.project.id=da9a86463d68412884746b115667d2fc, user.id=84ea6fbc3de84b7db9e62b9ee6055c52) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:38.097525 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041a465-afb4-44ec-97ee-22c178a3afbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:38.099656 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041a465-afb4-44ec-97ee-22c178a3afbd None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:38.102901 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:38.121636 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 339/684] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:13:37 2022] GET /identity/v3/role_assignments?user.id=84ea6fbc3de84b7db9e62b9ee6055c52&scope.project.id=da9a86463d68412884746b115667d2fc&role.id=fb1c5c0f0edb47bf828f63bc685f98ba => generated 608 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:38.121636 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041a465-afb4-44ec-97ee-22c178a3afbd None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:38.188883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf07215-d4f4-4caf-93e8-461e067aac50 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:38.266916 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73e196-503b-4d82-ab43-4c7caebce219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:38.268012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73e196-503b-4d82-ab43-4c7caebce219 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:38.268651 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73e196-503b-4d82-ab43-4c7caebce219 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:38.269121 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73e196-503b-4d82-ab43-4c7caebce219 None admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:38.270682 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73e196-503b-4d82-ab43-4c7caebce219 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:38.271363 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73e196-503b-4d82-ab43-4c7caebce219 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:38.274028 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73e196-503b-4d82-ab43-4c7caebce219 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:38.314951 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 346/685] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Aug 23 22:13:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:38.316917 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73e196-503b-4d82-ab43-4c7caebce219 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:38.321699 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041a465-afb4-44ec-97ee-22c178a3afbd None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:38.384093 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012d271-7ef9-46bf-a33a-1e42055ea18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:38.385249 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012d271-7ef9-46bf-a33a-1e42055ea18f None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:38.386547 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012d271-7ef9-46bf-a33a-1e42055ea18f None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:38.386980 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012d271-7ef9-46bf-a33a-1e42055ea18f None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:38.387839 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012d271-7ef9-46bf-a33a-1e42055ea18f None admin] RBAC: Adding query filter params (name=service) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:38.388149 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012d271-7ef9-46bf-a33a-1e42055ea18f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:38.391621 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012d271-7ef9-46bf-a33a-1e42055ea18f None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:38.402545 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 340/686] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Aug 23 22:13:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:38.407844 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012d271-7ef9-46bf-a33a-1e42055ea18f None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:38.471977 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:38.544705 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73e196-503b-4d82-ab43-4c7caebce219 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:38.594672 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:38.611581 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012d271-7ef9-46bf-a33a-1e42055ea18f None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:38.632437 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22e85b-5cfe-4b5b-a206-caeec20f7eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:38.633851 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22e85b-5cfe-4b5b-a206-caeec20f7eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:38.634394 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22e85b-5cfe-4b5b-a206-caeec20f7eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:38.634965 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22e85b-5cfe-4b5b-a206-caeec20f7eb4 None admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:38.637668 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22e85b-5cfe-4b5b-a206-caeec20f7eb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:38.638488 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22e85b-5cfe-4b5b-a206-caeec20f7eb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:38.641438 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22e85b-5cfe-4b5b-a206-caeec20f7eb4 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:38.667658 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 347/687] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:13:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:38.669238 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6ab69-baed-40bd-8269-652fe8881d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:38.669881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22e85b-5cfe-4b5b-a206-caeec20f7eb4 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:38.670390 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6ab69-baed-40bd-8269-652fe8881d45 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:38.670973 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6ab69-baed-40bd-8269-652fe8881d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:38.671403 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6ab69-baed-40bd-8269-652fe8881d45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:38.807564 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6ab69-baed-40bd-8269-652fe8881d45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:38.810615 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6ab69-baed-40bd-8269-652fe8881d45 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:38.862894 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:38.884182 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22e85b-5cfe-4b5b-a206-caeec20f7eb4 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:38.943425 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044dfdee-ba22-446e-af79-eaead69c2c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:38.944910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044dfdee-ba22-446e-af79-eaead69c2c4d None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:38.945436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044dfdee-ba22-446e-af79-eaead69c2c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:38.945894 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044dfdee-ba22-446e-af79-eaead69c2c4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:38.966128 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044dfdee-ba22-446e-af79-eaead69c2c4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:38.969303 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044dfdee-ba22-446e-af79-eaead69c2c4d None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:38.994447 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-044dfdee-ba22-446e-af79-eaead69c2c4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:38.994447 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:38.994447 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:38.994447 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:38.994447 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:38.994447 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:38.994447 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:38.994447 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:38.994447 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:38.994447 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:38.994447 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:38.994447 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:38.994447 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:38.994447 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:38.994447 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:38.994447 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:38.996535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:38.996535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:38.996535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:38.996535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:38.996535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:38.996535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:38.996535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:38.996535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:38.996535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:38.996535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:38.996535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:38.996535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:38.996535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:38.996535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:38.996535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:38.996535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:38.996535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:38.998465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:38.998465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:38.998465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:39.001634 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 348/688] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:39.004636 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044dfdee-ba22-446e-af79-eaead69c2c4d None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:39.021273 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 341/689] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:13:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:13:39.028355 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ddcd3-6835-4369-bc4a-51b0072203a7 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:39.028355 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ddcd3-6835-4369-bc4a-51b0072203a7 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:39.028355 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ddcd3-6835-4369-bc4a-51b0072203a7 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:39.029972 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 342/690] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:39.031414 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ddcd3-6835-4369-bc4a-51b0072203a7 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:39.079123 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:39.194611 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044dfdee-ba22-446e-af79-eaead69c2c4d None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:39.207146 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ddcd3-6835-4369-bc4a-51b0072203a7 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:39.252251 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c253e4-15c5-4845-82f8-76c2984d8061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:39.253170 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c253e4-15c5-4845-82f8-76c2984d8061 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:39.253504 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c253e4-15c5-4845-82f8-76c2984d8061 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:39.253810 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c253e4-15c5-4845-82f8-76c2984d8061 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:39.254608 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c253e4-15c5-4845-82f8-76c2984d8061 None admin] RBAC: Adding query filter params (role.id=fb1c5c0f0edb47bf828f63bc685f98ba, scope.project.id=da9a86463d68412884746b115667d2fc, user.id=99f6180d62a2415ca4bb7ad55fe33c5b) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:39.254999 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c253e4-15c5-4845-82f8-76c2984d8061 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:39.256701 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c253e4-15c5-4845-82f8-76c2984d8061 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:39.266581 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:39.281413 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 349/691] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:13:39 2022] GET /identity/v3/role_assignments?user.id=99f6180d62a2415ca4bb7ad55fe33c5b&scope.project.id=da9a86463d68412884746b115667d2fc&role.id=fb1c5c0f0edb47bf828f63bc685f98ba => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:39.281413 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c253e4-15c5-4845-82f8-76c2984d8061 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:39.292819 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb632f0-7f9f-40b7-9ce6-b1d22048bef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:39.293988 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb632f0-7f9f-40b7-9ce6-b1d22048bef8 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:39.294400 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb632f0-7f9f-40b7-9ce6-b1d22048bef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:39.294745 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb632f0-7f9f-40b7-9ce6-b1d22048bef8 None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:39.295524 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb632f0-7f9f-40b7-9ce6-b1d22048bef8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:39.295902 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb632f0-7f9f-40b7-9ce6-b1d22048bef8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:39.298023 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb632f0-7f9f-40b7-9ce6-b1d22048bef8 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:39.319596 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 343/692] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:39.322461 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104ec59-2efd-458d-8e18-3db7027ed4bc None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:39.322794 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104ec59-2efd-458d-8e18-3db7027ed4bc None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:39.323210 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104ec59-2efd-458d-8e18-3db7027ed4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:39.355958 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-f104ec59-2efd-458d-8e18-3db7027ed4bc None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:39.358204 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-f104ec59-2efd-458d-8e18-3db7027ed4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:39.459644 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:39.465267 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c253e4-15c5-4845-82f8-76c2984d8061 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:39.509955 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd5bb8-3179-4e4d-800d-88c2f37c88d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:39.510618 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd5bb8-3179-4e4d-800d-88c2f37c88d6 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:39.511622 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd5bb8-3179-4e4d-800d-88c2f37c88d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:39.512198 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd5bb8-3179-4e4d-800d-88c2f37c88d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:39.515738 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 344/693] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:13:39.517767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104ec59-2efd-458d-8e18-3db7027ed4bc None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:39.529470 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd5bb8-3179-4e4d-800d-88c2f37c88d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:39.531867 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd5bb8-3179-4e4d-800d-88c2f37c88d6 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:39.552010 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-02cd5bb8-3179-4e4d-800d-88c2f37c88d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:39.552010 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:39.552010 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:39.552010 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:39.552010 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:39.552010 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:39.552010 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:39.552010 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:39.552010 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:39.552010 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:39.552010 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:39.552010 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:39.552010 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:39.552010 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:39.552010 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:39.552010 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:39.554204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:39.554204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:39.554204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:39.554204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:39.554204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:39.554204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:39.554204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:39.554204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:39.554204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:39.554204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:39.554204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:39.554204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:39.554204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:39.554204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:39.554204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:39.554204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:39.554204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:39.556124 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:39.556124 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:39.556124 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:39.560659 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 350/694] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:39.568189 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd5bb8-3179-4e4d-800d-88c2f37c88d6 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:39.741250 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd5bb8-3179-4e4d-800d-88c2f37c88d6 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:39.797523 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104ec59-2efd-458d-8e18-3db7027ed4bc None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:39.835202 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc657be-d0c2-4364-adbd-af8d371a9b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:39.836094 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:39.836288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc657be-d0c2-4364-adbd-af8d371a9b39 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:39.838180 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc657be-d0c2-4364-adbd-af8d371a9b39 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:39.838180 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc657be-d0c2-4364-adbd-af8d371a9b39 None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:39.838180 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc657be-d0c2-4364-adbd-af8d371a9b39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:39.838180 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc657be-d0c2-4364-adbd-af8d371a9b39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:39.839779 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc657be-d0c2-4364-adbd-af8d371a9b39 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:39.880171 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 351/695] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:13:39.882864 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665898f1-c209-4d4e-959f-0aecda8206dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:39.884286 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665898f1-c209-4d4e-959f-0aecda8206dc None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:39.885156 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665898f1-c209-4d4e-959f-0aecda8206dc None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:39.888307 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665898f1-c209-4d4e-959f-0aecda8206dc None admin] PATH_INFO: `/v3/users/swift` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:39.890703 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc657be-d0c2-4364-adbd-af8d371a9b39 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:39.906462 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665898f1-c209-4d4e-959f-0aecda8206dc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:39.909912 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665898f1-c209-4d4e-959f-0aecda8206dc None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:39.927082 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:39.944877 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-665898f1-c209-4d4e-959f-0aecda8206dc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 22:13:39.944877 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:39.944877 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:39.944877 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:39.944877 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:39.944877 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:39.944877 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:39.944877 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:39.944877 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:39.944877 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:39.944877 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:39.944877 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:39.944877 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:13:39.944877 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:13:39.944877 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:13:39.944877 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:13:39.946848 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:39.946848 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:39.946848 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:13:39.946848 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:39.946848 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:13:39.946848 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:39.946848 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:39.946848 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:39.946848 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:39.946848 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:39.946848 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:39.946848 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:39.946848 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:39.946848 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:39.946848 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:39.946848 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:39.946848 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:39.946848 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:39.949950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:39.949950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:39.949950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:13:39.949950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:13:39.949950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:13:39.949950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:13:39.949950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:13:39.949950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:13:39.949950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 22:13:39.949950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:39.954073 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 345/696] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:13:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 437 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:39.961414 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665898f1-c209-4d4e-959f-0aecda8206dc None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:40.092853 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc657be-d0c2-4364-adbd-af8d371a9b39 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:40.160553 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf0587-644c-4616-b348-5ea9aab76157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:40.161186 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf0587-644c-4616-b348-5ea9aab76157 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:40.161693 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf0587-644c-4616-b348-5ea9aab76157 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:40.162222 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf0587-644c-4616-b348-5ea9aab76157 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:40.176020 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf0587-644c-4616-b348-5ea9aab76157 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:40.178366 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf0587-644c-4616-b348-5ea9aab76157 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:40.196568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-fbbf0587-644c-4616-b348-5ea9aab76157 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:40.196568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:40.196568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:40.196568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:40.196568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:40.196568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:40.196568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:40.196568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:40.196568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:40.196568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:40.196568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:40.196568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:40.196568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:13:40.196568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:13:40.196568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:13:40.198909 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:13:40.198909 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:40.198909 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:40.198909 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:40.198909 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:40.198909 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:40.198909 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:40.198909 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:40.198909 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:40.198909 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:40.198909 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:40.198909 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:40.198909 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:40.198909 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:40.198909 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:40.198909 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:40.198909 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:40.199862 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:13:40.199862 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:13:40.199862 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:13:40.199862 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:13:40.199862 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:13:40.199862 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:13:40.199862 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:40.199862 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:40.199862 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 352/697] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:40.199862 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf0587-644c-4616-b348-5ea9aab76157 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:40.220010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665898f1-c209-4d4e-959f-0aecda8206dc None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:40.281808 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6195173-1de5-4f4c-9139-d7d9818831c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:40.283286 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6195173-1de5-4f4c-9139-d7d9818831c4 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:40.284083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6195173-1de5-4f4c-9139-d7d9818831c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:40.284583 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6195173-1de5-4f4c-9139-d7d9818831c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:40.302480 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6195173-1de5-4f4c-9139-d7d9818831c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:40.305248 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6195173-1de5-4f4c-9139-d7d9818831c4 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:40.316368 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:40.335962 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-d6195173-1de5-4f4c-9139-d7d9818831c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:40.335962 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:40.335962 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:40.335962 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:40.335962 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:40.335962 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:40.335962 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:40.335962 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:40.335962 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:40.335962 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:40.335962 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:40.335962 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:40.335962 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:40.335962 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:40.335962 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:40.335962 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:40.337807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:40.337807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:40.337807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:40.337807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:40.337807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:40.337807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:40.337807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:40.337807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:40.337807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:40.337807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:40.337807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:40.337807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:40.337807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:40.337807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:40.337807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:40.337807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:40.337807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:40.339670 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:40.339670 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:40.339670 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:40.342631 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 346/698] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:40.344392 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6195173-1de5-4f4c-9139-d7d9818831c4 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:40.364370 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf0587-644c-4616-b348-5ea9aab76157 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:40.388588 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:40.427549 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76dd741-06cd-4177-be50-9bf87d615fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:40.428950 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dd741-06cd-4177-be50-9bf87d615fcc None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:40.429798 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dd741-06cd-4177-be50-9bf87d615fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:40.430501 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dd741-06cd-4177-be50-9bf87d615fcc None admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:40.431462 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76dd741-06cd-4177-be50-9bf87d615fcc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:40.432151 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76dd741-06cd-4177-be50-9bf87d615fcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:40.434401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76dd741-06cd-4177-be50-9bf87d615fcc None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:40.458483 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 353/699] 10.222.0.77 () {56 vars in 1135 bytes} [Tue Aug 23 22:13:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:40.459917 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76dd741-06cd-4177-be50-9bf87d615fcc None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:40.519801 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6195173-1de5-4f4c-9139-d7d9818831c4 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:40.585833 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfb4d5-a209-4519-85bb-cc8b6bec0517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:40.586680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfb4d5-a209-4519-85bb-cc8b6bec0517 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:40.587134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfb4d5-a209-4519-85bb-cc8b6bec0517 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:40.587554 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfb4d5-a209-4519-85bb-cc8b6bec0517 None admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:40.588595 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cfb4d5-a209-4519-85bb-cc8b6bec0517 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:40.589586 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cfb4d5-a209-4519-85bb-cc8b6bec0517 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:40.591934 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cfb4d5-a209-4519-85bb-cc8b6bec0517 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:40.613336 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 347/700] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:13:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:40.614514 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfb4d5-a209-4519-85bb-cc8b6bec0517 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:40.664198 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76dd741-06cd-4177-be50-9bf87d615fcc None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:40.726984 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:40.755776 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9805d3b-4281-4c22-a961-2a48ef81d92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:40.757670 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9805d3b-4281-4c22-a961-2a48ef81d92f None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:40.758376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9805d3b-4281-4c22-a961-2a48ef81d92f None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:40.758861 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9805d3b-4281-4c22-a961-2a48ef81d92f None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:40.760200 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9805d3b-4281-4c22-a961-2a48ef81d92f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:40.761320 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9805d3b-4281-4c22-a961-2a48ef81d92f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:40.764242 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9805d3b-4281-4c22-a961-2a48ef81d92f None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:40.799142 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 354/701] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:40.801181 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9805d3b-4281-4c22-a961-2a48ef81d92f None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:40.808518 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:40.841133 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfb4d5-a209-4519-85bb-cc8b6bec0517 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:40.891706 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335573e8-fe89-4774-a9c2-f9c9d4f75bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:40.892862 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335573e8-fe89-4774-a9c2-f9c9d4f75bcd None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:40.893346 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335573e8-fe89-4774-a9c2-f9c9d4f75bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:40.893844 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335573e8-fe89-4774-a9c2-f9c9d4f75bcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:40.975168 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9805d3b-4281-4c22-a961-2a48ef81d92f None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:41.012923 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335573e8-fe89-4774-a9c2-f9c9d4f75bcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:41.014980 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2dd3c-3f1c-421c-96aa-5e725eeb47e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:41.015841 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2dd3c-3f1c-421c-96aa-5e725eeb47e2 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:41.015959 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335573e8-fe89-4774-a9c2-f9c9d4f75bcd None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:41.016410 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2dd3c-3f1c-421c-96aa-5e725eeb47e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:41.016867 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2dd3c-3f1c-421c-96aa-5e725eeb47e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:41.017838 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2dd3c-3f1c-421c-96aa-5e725eeb47e2 None admin] RBAC: Adding query filter params (role.id=e806ce849cf34b92979b5524f3ea9ff6, scope.project.id=da9a86463d68412884746b115667d2fc, user.id=1a0af5bf009b48a8915c7320b16d08dd) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:41.018350 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2dd3c-3f1c-421c-96aa-5e725eeb47e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:41.020201 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2dd3c-3f1c-421c-96aa-5e725eeb47e2 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:41.027824 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 355/702] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:13:40 2022] GET /identity/v3/role_assignments?user.id=1a0af5bf009b48a8915c7320b16d08dd&scope.project.id=da9a86463d68412884746b115667d2fc&role.id=e806ce849cf34b92979b5524f3ea9ff6 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:41.029028 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2dd3c-3f1c-421c-96aa-5e725eeb47e2 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:41.141133 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:41.251323 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:41.260892 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2dd3c-3f1c-421c-96aa-5e725eeb47e2 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:41.278596 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 348/703] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:13:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:13:41.281771 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7b636-0de8-4fd5-9672-3ff1a979eead None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:41.282506 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7b636-0de8-4fd5-9672-3ff1a979eead None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:41.283118 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7b636-0de8-4fd5-9672-3ff1a979eead None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:41.285531 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 349/704] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:41.291125 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7b636-0de8-4fd5-9672-3ff1a979eead None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:41.328758 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0cedc2-cf35-4f57-8219-d730f35860b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:41.329844 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cedc2-cf35-4f57-8219-d730f35860b4 None admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:41.330338 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cedc2-cf35-4f57-8219-d730f35860b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:41.330888 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cedc2-cf35-4f57-8219-d730f35860b4 None admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:41.332032 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0cedc2-cf35-4f57-8219-d730f35860b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:41.334753 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0cedc2-cf35-4f57-8219-d730f35860b4 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:41.377743 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 356/705] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Aug 23 22:13:41 2022] POST /identity/v3/users => generated 254 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:13:41.388329 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832c100-6aff-4e39-8cd2-ab5f7763e402 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:41.388787 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832c100-6aff-4e39-8cd2-ab5f7763e402 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:41.389199 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832c100-6aff-4e39-8cd2-ab5f7763e402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:41.441543 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-9832c100-6aff-4e39-8cd2-ab5f7763e402 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:41.443025 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-9832c100-6aff-4e39-8cd2-ab5f7763e402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:41.543357 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7b636-0de8-4fd5-9672-3ff1a979eead None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:41.630119 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 357/706] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:13:41.644091 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2377111-4d79-455e-9b98-afdeb9ffa6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:41.645138 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2377111-4d79-455e-9b98-afdeb9ffa6bd None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:41.645661 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2377111-4d79-455e-9b98-afdeb9ffa6bd None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:41.646068 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2377111-4d79-455e-9b98-afdeb9ffa6bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:41.663871 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2377111-4d79-455e-9b98-afdeb9ffa6bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:41.666013 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2377111-4d79-455e-9b98-afdeb9ffa6bd None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:41.697487 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-a2377111-4d79-455e-9b98-afdeb9ffa6bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:41.697487 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:41.697487 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:41.697487 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:41.697487 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:41.697487 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:41.697487 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:41.697487 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:41.697487 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:41.697487 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:41.697487 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:41.697487 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:41.697487 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:41.697487 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:41.697487 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:41.697487 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:41.699821 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:41.699821 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:41.699821 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:41.699821 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:41.699821 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:41.699821 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:41.699821 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:41.699821 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:41.699821 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:41.699821 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:41.699821 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:41.699821 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:41.699821 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:41.699821 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:41.699821 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:41.699821 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:41.699821 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:41.701228 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:41.701228 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:41.701228 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:41.701228 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 350/707] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:41.710530 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832c100-6aff-4e39-8cd2-ab5f7763e402 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:41.802108 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:41.864396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f912f36-66ce-4cc4-9fce-cf48c36929ce None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:41.864678 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f912f36-66ce-4cc4-9fce-cf48c36929ce None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:41.864972 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f912f36-66ce-4cc4-9fce-cf48c36929ce None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:41.866760 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 351/708] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:41.878988 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963608c0-fb3e-40bd-8313-f28db6c1dbf1 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:41.879430 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963608c0-fb3e-40bd-8313-f28db6c1dbf1 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:41.879709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963608c0-fb3e-40bd-8313-f28db6c1dbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:41.907908 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-963608c0-fb3e-40bd-8313-f28db6c1dbf1 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:41.908761 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832c100-6aff-4e39-8cd2-ab5f7763e402 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:41.910681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-963608c0-fb3e-40bd-8313-f28db6c1dbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:41.958911 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693eebfb-cb31-45f3-b145-65d6a3433215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:41.960011 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693eebfb-cb31-45f3-b145-65d6a3433215 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:41.960510 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693eebfb-cb31-45f3-b145-65d6a3433215 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:41.960992 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693eebfb-cb31-45f3-b145-65d6a3433215 None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:41.962009 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693eebfb-cb31-45f3-b145-65d6a3433215 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:41.962540 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693eebfb-cb31-45f3-b145-65d6a3433215 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:41.964965 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693eebfb-cb31-45f3-b145-65d6a3433215 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:41.980250 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 358/709] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:41.985323 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693eebfb-cb31-45f3-b145-65d6a3433215 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:41.993967 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:42.082497 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 352/710] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:13:42.082497 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963608c0-fb3e-40bd-8313-f28db6c1dbf1 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:42.259723 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:42.267763 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963608c0-fb3e-40bd-8313-f28db6c1dbf1 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:42.275413 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693eebfb-cb31-45f3-b145-65d6a3433215 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:42.326735 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a7ae3-d74c-4055-8ba2-d6335b8eb1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:42.327830 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a7ae3-d74c-4055-8ba2-d6335b8eb1cb None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:42.328429 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a7ae3-d74c-4055-8ba2-d6335b8eb1cb None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:42.328902 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a7ae3-d74c-4055-8ba2-d6335b8eb1cb None admin] PATH_INFO: `/v3/services/network` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:42.330203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a7ae3-d74c-4055-8ba2-d6335b8eb1cb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:42.332857 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a7ae3-d74c-4055-8ba2-d6335b8eb1cb None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:42.352439 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-2e1a7ae3-d74c-4055-8ba2-d6335b8eb1cb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:13:42.352439 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:42.352439 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:13:42.352439 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:13:42.352439 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:13:42.352439 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:13:42.352439 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:13:42.352439 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:42.352439 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:13:42.352439 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:42.352439 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:13:42.352439 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:42.352439 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:42.352439 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:42.352439 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:42.352439 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:42.352439 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:42.354012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:42.354012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:42.354012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:42.354012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:42.354012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:42.354012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:42.354012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:13:42.354012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:13:42.354012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:13:42.354012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:13:42.354012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:42.354012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:42.354012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:42.354012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:42.354012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:42.354012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:42.355566 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:42.355566 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:42.355566 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:42.355566 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:42.355566 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:42.355566 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:42.355566 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:42.355566 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:42.355566 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:42.355566 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:42.355566 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:13:42.355566 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:42.355566 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:13:42.355566 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:42.355566 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 353/711] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:42 2022] GET /identity/v3/services/network => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:42.360445 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a7ae3-d74c-4055-8ba2-d6335b8eb1cb None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:42.391206 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee4ba7-e4b1-4539-b48d-e05cfc7e729c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:42.391869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee4ba7-e4b1-4539-b48d-e05cfc7e729c None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:42.392193 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee4ba7-e4b1-4539-b48d-e05cfc7e729c None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:42.392509 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee4ba7-e4b1-4539-b48d-e05cfc7e729c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:42.414457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee4ba7-e4b1-4539-b48d-e05cfc7e729c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:42.415994 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee4ba7-e4b1-4539-b48d-e05cfc7e729c None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:42.432250 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:42.445401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-21ee4ba7-e4b1-4539-b48d-e05cfc7e729c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:42.445401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:42.445401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:42.445401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:42.445401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:42.445401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:42.445401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:42.445401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:42.445401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:42.445401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:42.445401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:42.445401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:42.445401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:13:42.445401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:13:42.445401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:13:42.446941 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:13:42.446941 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:42.446941 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:42.446941 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:42.446941 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:42.446941 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:42.446941 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:42.446941 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:42.446941 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:42.446941 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:42.446941 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:42.446941 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:42.446941 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:42.446941 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:42.446941 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:42.446941 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:42.446941 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:42.449947 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:13:42.449947 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:13:42.449947 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:13:42.449947 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:13:42.449947 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:13:42.449947 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:13:42.449947 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:42.449947 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:42.455274 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 359/712] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 470 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:42.467064 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee4ba7-e4b1-4539-b48d-e05cfc7e729c None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:42.520208 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a7ae3-d74c-4055-8ba2-d6335b8eb1cb None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:42.588662 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ae3a1-6669-4ec0-a562-b7de565ae425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:42.589673 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ae3a1-6669-4ec0-a562-b7de565ae425 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:42.590238 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ae3a1-6669-4ec0-a562-b7de565ae425 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:42.590659 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ae3a1-6669-4ec0-a562-b7de565ae425 None admin] PATH_INFO: `/v3/services` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:42.591402 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ae3a1-6669-4ec0-a562-b7de565ae425 None admin] RBAC: Adding query filter params (name=network) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:42.591834 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ae3a1-6669-4ec0-a562-b7de565ae425 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:42.593351 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ae3a1-6669-4ec0-a562-b7de565ae425 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:42.602485 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 354/713] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Aug 23 22:13:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:42.603566 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ae3a1-6669-4ec0-a562-b7de565ae425 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:42.709224 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee4ba7-e4b1-4539-b48d-e05cfc7e729c None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:42.772576 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61979d18-6212-4dae-9970-78b8282926b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:42.778138 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61979d18-6212-4dae-9970-78b8282926b9 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:42.778907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61979d18-6212-4dae-9970-78b8282926b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:42.779397 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61979d18-6212-4dae-9970-78b8282926b9 None admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:42.780463 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61979d18-6212-4dae-9970-78b8282926b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:42.780995 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61979d18-6212-4dae-9970-78b8282926b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:42.782754 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61979d18-6212-4dae-9970-78b8282926b9 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:42.797438 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:42.802293 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 360/714] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:13:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:42.803554 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61979d18-6212-4dae-9970-78b8282926b9 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:42.805517 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ae3a1-6669-4ec0-a562-b7de565ae425 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:42.834243 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:42.881901 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3572a6-35fc-4dc2-a3eb-1774f2962990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:42.883251 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3572a6-35fc-4dc2-a3eb-1774f2962990 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:42.883882 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3572a6-35fc-4dc2-a3eb-1774f2962990 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:42.884507 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3572a6-35fc-4dc2-a3eb-1774f2962990 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:42.886275 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3572a6-35fc-4dc2-a3eb-1774f2962990 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:42.888955 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3572a6-35fc-4dc2-a3eb-1774f2962990 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:42.913492 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-ba3572a6-35fc-4dc2-a3eb-1774f2962990 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:13:42.913492 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:42.913492 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:13:42.913492 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:13:42.913492 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:13:42.913492 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:13:42.913492 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:13:42.913492 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:42.913492 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:13:42.913492 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:42.913492 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:13:42.913492 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:42.913492 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:42.913492 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:42.913492 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:42.913492 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:42.913492 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:42.914642 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:42.914642 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:42.914642 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:42.914642 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:42.914642 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:42.914642 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:42.914642 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:13:42.914642 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:13:42.914642 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:13:42.914642 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:13:42.914642 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:42.914642 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:42.914642 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:42.914642 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:42.914642 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:42.914642 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:42.915593 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:42.915593 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:42.915593 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:42.915593 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:42.915593 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:42.915593 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:42.915593 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:42.915593 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:42.915593 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:42.915593 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:42.915593 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:13:42.915593 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:42.915593 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:13:42.915593 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:42.916444 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 355/715] 10.222.0.77 () {56 vars in 1129 bytes} [Tue Aug 23 22:13:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:42.923098 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3572a6-35fc-4dc2-a3eb-1774f2962990 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:42.971286 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61979d18-6212-4dae-9970-78b8282926b9 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:43.023469 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64842aa7-6c1d-46f3-88f7-1d100ae7243c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:43.024403 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64842aa7-6c1d-46f3-88f7-1d100ae7243c None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:43.024896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64842aa7-6c1d-46f3-88f7-1d100ae7243c None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:43.025388 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64842aa7-6c1d-46f3-88f7-1d100ae7243c None admin] PATH_INFO: `/v3/services` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:43.026301 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64842aa7-6c1d-46f3-88f7-1d100ae7243c None admin] RBAC: Adding query filter params (type=network) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:43.027347 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64842aa7-6c1d-46f3-88f7-1d100ae7243c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:43.029016 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64842aa7-6c1d-46f3-88f7-1d100ae7243c None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:43.038256 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 361/716] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Aug 23 22:13:42 2022] GET /identity/v3/services?type=network => generated 124 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:43.039848 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64842aa7-6c1d-46f3-88f7-1d100ae7243c None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:43.083960 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3572a6-35fc-4dc2-a3eb-1774f2962990 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:43.147091 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92060355-623e-40bc-8c5e-137304023440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:43.149035 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92060355-623e-40bc-8c5e-137304023440 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:43.149531 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92060355-623e-40bc-8c5e-137304023440 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:43.149840 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92060355-623e-40bc-8c5e-137304023440 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:43.150792 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92060355-623e-40bc-8c5e-137304023440 None admin] RBAC: Adding query filter params (role.id=fb1c5c0f0edb47bf828f63bc685f98ba, scope.project.id=da9a86463d68412884746b115667d2fc, user.id=abda1f23a18c4c808483cd6b53952975) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:43.151131 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92060355-623e-40bc-8c5e-137304023440 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:43.155611 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92060355-623e-40bc-8c5e-137304023440 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:43.173294 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 356/717] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:13:42 2022] GET /identity/v3/role_assignments?user.id=abda1f23a18c4c808483cd6b53952975&scope.project.id=da9a86463d68412884746b115667d2fc&role.id=fb1c5c0f0edb47bf828f63bc685f98ba => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:43.248841 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:43.277878 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64842aa7-6c1d-46f3-88f7-1d100ae7243c None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:43.337168 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2923c3-addf-4bae-846e-7e350009d7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:43.338283 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2923c3-addf-4bae-846e-7e350009d7ef None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:43.338918 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2923c3-addf-4bae-846e-7e350009d7ef None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:43.339429 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2923c3-addf-4bae-846e-7e350009d7ef None admin] PATH_INFO: `/v3/services` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:43.340549 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2923c3-addf-4bae-846e-7e350009d7ef None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:43.340908 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2923c3-addf-4bae-846e-7e350009d7ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:43.342890 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2923c3-addf-4bae-846e-7e350009d7ef None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:43.351068 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 362/718] 10.222.0.77 () {56 vars in 1124 bytes} [Tue Aug 23 22:13:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:43.358397 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92060355-623e-40bc-8c5e-137304023440 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:43.393821 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:43.502681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92060355-623e-40bc-8c5e-137304023440 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:43.555938 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48ec86-ff4b-4798-bc91-aff18449fb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:43.556859 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48ec86-ff4b-4798-bc91-aff18449fb6b None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:43.557284 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48ec86-ff4b-4798-bc91-aff18449fb6b None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:43.558277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48ec86-ff4b-4798-bc91-aff18449fb6b None admin] PATH_INFO: `/v3/services` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:43.559387 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba48ec86-ff4b-4798-bc91-aff18449fb6b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:43.559700 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba48ec86-ff4b-4798-bc91-aff18449fb6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:43.561762 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba48ec86-ff4b-4798-bc91-aff18449fb6b None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:43.570658 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 357/719] 10.222.0.77 () {56 vars in 1124 bytes} [Tue Aug 23 22:13:43 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:43.807947 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44294d-04c1-4000-943f-fd0fe0a79bee None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:43.808304 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44294d-04c1-4000-943f-fd0fe0a79bee None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:43.808612 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44294d-04c1-4000-943f-fd0fe0a79bee None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:43.810540 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 363/720] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:43.817330 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d372214-848c-4050-9b77-7c9d417cb1b5 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:43.818101 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d372214-848c-4050-9b77-7c9d417cb1b5 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:43.818559 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d372214-848c-4050-9b77-7c9d417cb1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:43.846608 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-5d372214-848c-4050-9b77-7c9d417cb1b5 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:43.847931 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-5d372214-848c-4050-9b77-7c9d417cb1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:43.945239 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 358/721] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:13:44.369417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de90c0-e857-4630-b5c6-6d9148f9471f None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:44.371037 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de90c0-e857-4630-b5c6-6d9148f9471f None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:44.371819 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de90c0-e857-4630-b5c6-6d9148f9471f None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:44.375229 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 364/722] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:44.384150 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673fc9e-7252-4497-ad3b-1928fa716d76 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:44.385593 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673fc9e-7252-4497-ad3b-1928fa716d76 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:44.386927 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673fc9e-7252-4497-ad3b-1928fa716d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:44.423451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-a673fc9e-7252-4497-ad3b-1928fa716d76 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:44.425105 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-a673fc9e-7252-4497-ad3b-1928fa716d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:44.444321 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:44.530994 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 359/723] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:13:44.576737 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de90c0-e857-4630-b5c6-6d9148f9471f None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:44.838515 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de90c0-e857-4630-b5c6-6d9148f9471f None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:44.928622 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea31853-c46b-4239-8a72-883d602de4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:44.930760 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea31853-c46b-4239-8a72-883d602de4ff None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:44.931594 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea31853-c46b-4239-8a72-883d602de4ff None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:44.932873 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea31853-c46b-4239-8a72-883d602de4ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:44.966869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea31853-c46b-4239-8a72-883d602de4ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:13:44.984238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-fea31853-c46b-4239-8a72-883d602de4ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:13:44.984238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:44.984238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:44.984238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:44.984238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:44.984238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:44.984238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:44.984238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:44.984238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:44.984238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:44.984238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:44.984238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:44.984238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:13:44.984238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:13:44.984238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:13:44.984238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:13:44.986136 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:13:44.986136 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:13:44.986136 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:13:44.986136 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:13:44.986136 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:44.986136 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:44.986136 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:44.986136 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:44.986136 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:44.986136 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:44.986136 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:44.986136 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:44.986136 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:44.986136 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:44.986136 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:44.986136 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:44.987763 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:44.987763 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:44.987763 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:44.987763 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:44.987763 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:13:44.987763 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:13:44.987763 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:13:44.987763 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:13:44.987763 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:13:44.987763 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:13:44.987763 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:13:44.987763 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:44.992542 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 365/724] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:13:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 417 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:45.003233 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673fc9e-7252-4497-ad3b-1928fa716d76 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:45.010252 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea31853-c46b-4239-8a72-883d602de4ff None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:45.037920 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:45.278383 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673fc9e-7252-4497-ad3b-1928fa716d76 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:45.294471 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea31853-c46b-4239-8a72-883d602de4ff None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:45.355720 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a689a-938d-403b-b587-5be7de484c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:45.356351 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a689a-938d-403b-b587-5be7de484c7f None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:45.356643 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a689a-938d-403b-b587-5be7de484c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:45.356911 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a689a-938d-403b-b587-5be7de484c7f None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:45.357579 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a689a-938d-403b-b587-5be7de484c7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:45.357870 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a689a-938d-403b-b587-5be7de484c7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:45.359267 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a689a-938d-403b-b587-5be7de484c7f None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:45.362601 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5319f2-0819-4392-882a-0659a4c6ebd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:45.363250 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5319f2-0819-4392-882a-0659a4c6ebd0 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:45.363524 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5319f2-0819-4392-882a-0659a4c6ebd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:45.363785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5319f2-0819-4392-882a-0659a4c6ebd0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:45.383657 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 360/725] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:13:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:13:45.384848 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5319f2-0819-4392-882a-0659a4c6ebd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:13:45.391904 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-ea5319f2-0819-4392-882a-0659a4c6ebd0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:13:45.391904 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:45.391904 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:45.391904 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:45.391904 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:45.391904 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:45.391904 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:45.391904 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:45.391904 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:45.391904 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:45.391904 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:45.391904 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:45.391904 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:13:45.391904 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:13:45.391904 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:13:45.391904 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:13:45.395881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:13:45.395881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:13:45.395881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:13:45.395881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:13:45.395881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:45.395881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:45.395881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:45.395881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:45.395881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:45.395881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:45.395881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:45.395881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:45.395881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:45.395881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:45.395881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:45.395881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:45.399195 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:45.399195 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:45.399195 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:45.399195 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:45.399195 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:13:45.399195 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:13:45.399195 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:13:45.399195 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:13:45.399195 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:13:45.399195 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:13:45.399195 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:13:45.399195 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:45.399195 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 366/726] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Aug 23 22:13:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:45.405343 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a689a-938d-403b-b587-5be7de484c7f None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:45.406440 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5319f2-0819-4392-882a-0659a4c6ebd0 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:45.470365 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:45.598155 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:45.651394 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a689a-938d-403b-b587-5be7de484c7f None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:45.706451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ce9c2-d744-488f-8048-e34d9c9f68c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:45.707316 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ce9c2-d744-488f-8048-e34d9c9f68c0 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:45.707613 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ce9c2-d744-488f-8048-e34d9c9f68c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:45.707861 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ce9c2-d744-488f-8048-e34d9c9f68c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:45.708547 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ce9c2-d744-488f-8048-e34d9c9f68c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:45.708852 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ce9c2-d744-488f-8048-e34d9c9f68c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:45.710303 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ce9c2-d744-488f-8048-e34d9c9f68c0 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:45.722104 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5319f2-0819-4392-882a-0659a4c6ebd0 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:45.725626 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 361/727] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Aug 23 22:13:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:13:45.728240 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ce9c2-d744-488f-8048-e34d9c9f68c0 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:45.798828 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162f266-9bb5-4d40-9492-e0c04d259cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:45.799505 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162f266-9bb5-4d40-9492-e0c04d259cdb None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:45.799790 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162f266-9bb5-4d40-9492-e0c04d259cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:45.800052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162f266-9bb5-4d40-9492-e0c04d259cdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:45.821993 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162f266-9bb5-4d40-9492-e0c04d259cdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:45.823525 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162f266-9bb5-4d40-9492-e0c04d259cdb None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:45.834672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:45.868736 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ce9c2-d744-488f-8048-e34d9c9f68c0 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:45.879786 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-5162f266-9bb5-4d40-9492-e0c04d259cdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:45.879786 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:45.879786 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:45.879786 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:45.879786 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:45.879786 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:45.879786 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:45.879786 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:45.879786 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:45.879786 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:45.879786 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:45.879786 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:45.879786 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:45.879786 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:45.879786 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:45.879786 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:45.882248 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:45.882248 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:45.882248 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:45.882248 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:45.882248 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:45.882248 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:45.882248 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:45.882248 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:45.882248 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:45.882248 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:45.882248 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:45.882248 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:45.882248 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:45.882248 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:45.882248 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:45.882248 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:45.882248 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:45.884059 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:45.884059 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:45.884059 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:45.884059 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 367/728] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 478 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:45.899092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162f266-9bb5-4d40-9492-e0c04d259cdb None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:45.909623 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecaf91b-39bd-4ce7-a3f3-e5af1a4b833d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:45.910279 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecaf91b-39bd-4ce7-a3f3-e5af1a4b833d None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:45.910565 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecaf91b-39bd-4ce7-a3f3-e5af1a4b833d None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:45.910840 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecaf91b-39bd-4ce7-a3f3-e5af1a4b833d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:45.924176 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecaf91b-39bd-4ce7-a3f3-e5af1a4b833d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:45.925564 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecaf91b-39bd-4ce7-a3f3-e5af1a4b833d None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:45.943555 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-fecaf91b-39bd-4ce7-a3f3-e5af1a4b833d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:45.943555 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:45.943555 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:45.943555 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:45.943555 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:45.943555 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:45.943555 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:45.943555 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:45.943555 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:45.943555 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:45.943555 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:45.943555 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:45.943555 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:45.943555 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:45.943555 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:45.943555 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:45.947664 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:45.947664 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:45.947664 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:45.947664 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:45.947664 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:45.947664 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:45.947664 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:45.947664 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:45.947664 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:45.947664 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:45.947664 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:45.947664 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:45.947664 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:45.947664 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:45.947664 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:45.947664 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:45.947664 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:45.951753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:45.951753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:45.951753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:45.951753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 362/729] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:45.958112 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecaf91b-39bd-4ce7-a3f3-e5af1a4b833d None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:46.076389 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecaf91b-39bd-4ce7-a3f3-e5af1a4b833d None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:46.107254 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:46.119600 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf8a3a-d81b-4206-a389-f7380c9854f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:46.121015 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf8a3a-d81b-4206-a389-f7380c9854f3 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:46.121599 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf8a3a-d81b-4206-a389-f7380c9854f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:46.122116 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf8a3a-d81b-4206-a389-f7380c9854f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:46.122964 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf8a3a-d81b-4206-a389-f7380c9854f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:46.123465 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf8a3a-d81b-4206-a389-f7380c9854f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:46.125225 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf8a3a-d81b-4206-a389-f7380c9854f3 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:46.145204 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 363/730] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:46.147153 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf8a3a-d81b-4206-a389-f7380c9854f3 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:46.271952 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf8a3a-d81b-4206-a389-f7380c9854f3 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:46.309178 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162f266-9bb5-4d40-9492-e0c04d259cdb None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:46.329744 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea913df-ec55-4a2b-91fc-6dca26344dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:46.330789 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea913df-ec55-4a2b-91fc-6dca26344dbd None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:46.331349 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea913df-ec55-4a2b-91fc-6dca26344dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:46.332049 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea913df-ec55-4a2b-91fc-6dca26344dbd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:46.343975 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea913df-ec55-4a2b-91fc-6dca26344dbd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:46.348111 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea913df-ec55-4a2b-91fc-6dca26344dbd None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:46.357752 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:46.366860 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-5ea913df-ec55-4a2b-91fc-6dca26344dbd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 22:13:46.366860 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:46.366860 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:46.366860 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:46.366860 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:46.366860 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:46.366860 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:46.366860 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:46.366860 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:46.366860 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:46.366860 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:46.366860 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:46.366860 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:13:46.366860 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:13:46.366860 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:13:46.366860 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:13:46.368062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:46.368062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:46.368062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:13:46.368062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:46.368062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:13:46.368062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:46.368062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:46.368062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:46.368062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:46.368062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:46.368062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:46.368062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:46.368062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:46.368062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:46.368062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:46.368062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:46.368062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:46.368062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:46.369281 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:46.369281 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:46.369281 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:13:46.369281 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:13:46.369281 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:13:46.369281 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:13:46.369281 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:13:46.369281 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:13:46.369281 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 22:13:46.369281 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:46.372128 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 364/731] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Aug 23 22:13:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:46.373696 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b14db7-e2c1-40c3-a61e-bfad38d372d0 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:46.374146 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b14db7-e2c1-40c3-a61e-bfad38d372d0 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:46.374551 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b14db7-e2c1-40c3-a61e-bfad38d372d0 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:46.381885 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 365/732] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:46.384061 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b14db7-e2c1-40c3-a61e-bfad38d372d0 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:46.390568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7580ee-2272-4a28-9488-12b4980a66c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:46.391368 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7580ee-2272-4a28-9488-12b4980a66c6 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:46.391754 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7580ee-2272-4a28-9488-12b4980a66c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:46.392198 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7580ee-2272-4a28-9488-12b4980a66c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:46.393117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7580ee-2272-4a28-9488-12b4980a66c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:46.393564 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7580ee-2272-4a28-9488-12b4980a66c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:46.395240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7580ee-2272-4a28-9488-12b4980a66c6 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:46.414468 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 368/733] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 516 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:46.416952 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9559c9-664b-4db2-ac8c-aad46899a1e4 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:46.417399 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9559c9-664b-4db2-ac8c-aad46899a1e4 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:46.417931 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9559c9-664b-4db2-ac8c-aad46899a1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:46.446216 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-ce9559c9-664b-4db2-ac8c-aad46899a1e4 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:46.448545 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-ce9559c9-664b-4db2-ac8c-aad46899a1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:46.453694 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:46.534994 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b14db7-e2c1-40c3-a61e-bfad38d372d0 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:46.560294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 369/734] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:13:46.562298 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9559c9-664b-4db2-ac8c-aad46899a1e4 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:46.602683 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506334e-39c3-46f4-ab93-bd681a33fdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:46.603288 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506334e-39c3-46f4-ab93-bd681a33fdbb None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:46.603650 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506334e-39c3-46f4-ab93-bd681a33fdbb None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:46.603928 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506334e-39c3-46f4-ab93-bd681a33fdbb None admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:46.605239 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506334e-39c3-46f4-ab93-bd681a33fdbb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:46.605631 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506334e-39c3-46f4-ab93-bd681a33fdbb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:46.607413 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506334e-39c3-46f4-ab93-bd681a33fdbb None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:46.656616 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 366/735] 10.222.0.77 () {56 vars in 1149 bytes} [Tue Aug 23 22:13:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:46.658089 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea88e94-a492-4f5d-8ad9-4e4c6bcc61b8 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:46.658514 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea88e94-a492-4f5d-8ad9-4e4c6bcc61b8 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:46.658806 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea88e94-a492-4f5d-8ad9-4e4c6bcc61b8 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:46.665278 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 367/736] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:46.667846 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea88e94-a492-4f5d-8ad9-4e4c6bcc61b8 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:46.763763 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9559c9-664b-4db2-ac8c-aad46899a1e4 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:46.786867 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:46.825560 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea88e94-a492-4f5d-8ad9-4e4c6bcc61b8 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:46.829343 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:46.838568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8c037-2d30-4718-b8f3-d47949c030f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:46.840529 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8c037-2d30-4718-b8f3-d47949c030f9 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:46.841023 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8c037-2d30-4718-b8f3-d47949c030f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:46.841553 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8c037-2d30-4718-b8f3-d47949c030f9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:46.856372 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8c037-2d30-4718-b8f3-d47949c030f9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:46.859860 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8c037-2d30-4718-b8f3-d47949c030f9 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:46.878985 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d0e93-bf9a-47f6-8671-f0dd6d8ef0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:46.879677 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d0e93-bf9a-47f6-8671-f0dd6d8ef0d7 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:46.879956 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d0e93-bf9a-47f6-8671-f0dd6d8ef0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:46.880242 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d0e93-bf9a-47f6-8671-f0dd6d8ef0d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:46.883422 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-bab8c037-2d30-4718-b8f3-d47949c030f9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:13:46.883422 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:46.883422 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:46.883422 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:46.883422 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:46.883422 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:46.883422 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:46.883422 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:46.883422 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:46.883422 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:46.883422 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:46.883422 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:46.883422 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:13:46.883422 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:13:46.883422 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:13:46.883422 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:13:46.884599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:46.884599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:46.884599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:13:46.884599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:46.884599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:13:46.884599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:46.884599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:46.884599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:46.884599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:46.884599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:46.884599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:46.884599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:46.884599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:46.884599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:46.884599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:46.884599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:46.884599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:46.884599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:46.887376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:46.887376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:46.887376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:13:46.887376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:13:46.887376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:13:46.887376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:13:46.887376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:13:46.887376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:13:46.887376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:13:46.887376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:46.887376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 370/737] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Aug 23 22:13:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:46.889482 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd9baf-5b74-43ce-8215-4f8cbfd52613 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:46.889482 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd9baf-5b74-43ce-8215-4f8cbfd52613 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:46.889482 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd9baf-5b74-43ce-8215-4f8cbfd52613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:46.922189 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-f6bd9baf-5b74-43ce-8215-4f8cbfd52613 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:46.923973 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-f6bd9baf-5b74-43ce-8215-4f8cbfd52613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:46.991010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d0e93-bf9a-47f6-8671-f0dd6d8ef0d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:46.993753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d0e93-bf9a-47f6-8671-f0dd6d8ef0d7 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:47.018005 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 371/738] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:13:47.022082 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550caa8-030d-4652-86b3-2f9e4554efe7 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:47.022082 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550caa8-030d-4652-86b3-2f9e4554efe7 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:47.022082 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550caa8-030d-4652-86b3-2f9e4554efe7 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:47.022082 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 372/739] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:47.022850 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550caa8-030d-4652-86b3-2f9e4554efe7 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:47.146730 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 368/740] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:13:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:13:47.147973 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d0e93-bf9a-47f6-8671-f0dd6d8ef0d7 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:47.153668 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:47.175640 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:47.181706 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550caa8-030d-4652-86b3-2f9e4554efe7 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:47.235849 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b4090-d788-4f79-9962-43a6c0030ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:47.236604 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b4090-d788-4f79-9962-43a6c0030ebb None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:47.236887 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b4090-d788-4f79-9962-43a6c0030ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:47.237176 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b4090-d788-4f79-9962-43a6c0030ebb None admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:47.238047 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b4090-d788-4f79-9962-43a6c0030ebb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:47.238371 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b4090-d788-4f79-9962-43a6c0030ebb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:47.239949 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b4090-d788-4f79-9962-43a6c0030ebb None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:47.269542 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 373/741] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Aug 23 22:13:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:47.269921 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894af11d-4df4-46dc-b4ec-0f04f1c72632 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:47.270301 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894af11d-4df4-46dc-b4ec-0f04f1c72632 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:47.270690 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894af11d-4df4-46dc-b4ec-0f04f1c72632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:47.300129 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-894af11d-4df4-46dc-b4ec-0f04f1c72632 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:47.302853 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-894af11d-4df4-46dc-b4ec-0f04f1c72632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:47.315775 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d0e93-bf9a-47f6-8671-f0dd6d8ef0d7 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:47.357592 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5e4ac-a4aa-49cf-99b5-b79861279efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:47.358462 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5e4ac-a4aa-49cf-99b5-b79861279efd None admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:47.358777 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5e4ac-a4aa-49cf-99b5-b79861279efd None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:47.359182 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5e4ac-a4aa-49cf-99b5-b79861279efd None admin] PATH_INFO: `/v3/services` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:47.360000 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5e4ac-a4aa-49cf-99b5-b79861279efd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:47.361458 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5e4ac-a4aa-49cf-99b5-b79861279efd None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:47.382011 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 369/742] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Aug 23 22:13:47 2022] POST /identity/v3/services => generated 240 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:13:47.382885 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5e4ac-a4aa-49cf-99b5-b79861279efd None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:47.427316 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 374/743] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:47 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:13:47.427316 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894af11d-4df4-46dc-b4ec-0f04f1c72632 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:47.500599 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:47.560302 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5e4ac-a4aa-49cf-99b5-b79861279efd None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:47.618929 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:47.625961 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb2730-dfbb-4ae2-998e-594ffd6f736b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:47.627329 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb2730-dfbb-4ae2-998e-594ffd6f736b None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:47.628032 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb2730-dfbb-4ae2-998e-594ffd6f736b None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:47.628524 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb2730-dfbb-4ae2-998e-594ffd6f736b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:47.646468 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb2730-dfbb-4ae2-998e-594ffd6f736b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:47.649508 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb2730-dfbb-4ae2-998e-594ffd6f736b None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:47.662029 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894af11d-4df4-46dc-b4ec-0f04f1c72632 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:47.673031 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-42cb2730-dfbb-4ae2-998e-594ffd6f736b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:47.673031 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:47.673031 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:47.673031 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:47.673031 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:47.673031 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:47.673031 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:47.673031 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:47.673031 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:47.673031 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:47.673031 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:47.673031 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:47.673031 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:47.673031 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:47.673031 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:47.673031 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:47.674696 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:47.674696 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:47.674696 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:47.674696 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:47.674696 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:47.674696 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:47.674696 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:47.674696 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:47.674696 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:47.674696 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:47.674696 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:47.674696 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:47.674696 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:47.674696 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:47.674696 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:47.674696 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:47.674696 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:47.676051 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:47.676051 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:47.676051 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:47.678432 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 370/744] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:47.679903 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb2730-dfbb-4ae2-998e-594ffd6f736b None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:47.716339 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbd081-5ea5-4f5d-b85a-65d308674513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:47.717107 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbd081-5ea5-4f5d-b85a-65d308674513 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:47.717513 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbd081-5ea5-4f5d-b85a-65d308674513 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:47.717862 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbd081-5ea5-4f5d-b85a-65d308674513 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:47.741876 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbbd081-5ea5-4f5d-b85a-65d308674513 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:47.745410 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbbd081-5ea5-4f5d-b85a-65d308674513 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:47.781438 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-3cbbd081-5ea5-4f5d-b85a-65d308674513 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:47.781438 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:47.781438 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:47.781438 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:47.781438 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:47.781438 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:47.781438 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:47.781438 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:47.781438 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:47.781438 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:47.781438 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:47.781438 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:47.781438 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:47.781438 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:47.781438 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:47.781438 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:47.783402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:47.783402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:47.783402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:47.783402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:47.783402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:47.783402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:47.783402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:47.783402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:47.783402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:47.783402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:47.783402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:47.783402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:47.783402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:47.783402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:47.783402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:47.783402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:47.783402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:47.785273 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:47.785273 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:47.785273 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:47.785273 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 375/745] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:47.785273 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbd081-5ea5-4f5d-b85a-65d308674513 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:47.890799 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb2730-dfbb-4ae2-998e-594ffd6f736b None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:47.921120 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:47.950224 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee1dcb-54a3-4f05-b162-0444b8ca5e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:47.950815 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee1dcb-54a3-4f05-b162-0444b8ca5e3d None admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:47.951229 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee1dcb-54a3-4f05-b162-0444b8ca5e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:47.951440 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee1dcb-54a3-4f05-b162-0444b8ca5e3d None admin] PATH_INFO: `/v3/services` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:47.952136 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee1dcb-54a3-4f05-b162-0444b8ca5e3d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:47.953728 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee1dcb-54a3-4f05-b162-0444b8ca5e3d None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:47.970212 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbd081-5ea5-4f5d-b85a-65d308674513 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:47.971146 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 371/746] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Aug 23 22:13:47 2022] POST /identity/v3/services => generated 251 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:13:47.972014 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee1dcb-54a3-4f05-b162-0444b8ca5e3d None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:48.024229 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:48.038876 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c93e4e-001c-4d19-bd03-8483c7e82e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:48.040155 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c93e4e-001c-4d19-bd03-8483c7e82e31 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:48.042300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c93e4e-001c-4d19-bd03-8483c7e82e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:48.042300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c93e4e-001c-4d19-bd03-8483c7e82e31 None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:48.042866 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c93e4e-001c-4d19-bd03-8483c7e82e31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:48.043505 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c93e4e-001c-4d19-bd03-8483c7e82e31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:48.045741 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c93e4e-001c-4d19-bd03-8483c7e82e31 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:48.064788 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 376/747] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:48.065483 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c93e4e-001c-4d19-bd03-8483c7e82e31 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:48.152545 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee1dcb-54a3-4f05-b162-0444b8ca5e3d None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:48.211031 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcd297-7d1c-4f7c-bc82-fb6c0fe1a2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:48.212406 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcd297-7d1c-4f7c-bc82-fb6c0fe1a2e3 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:48.213158 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcd297-7d1c-4f7c-bc82-fb6c0fe1a2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:48.214602 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcd297-7d1c-4f7c-bc82-fb6c0fe1a2e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:48.216776 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bcd297-7d1c-4f7c-bc82-fb6c0fe1a2e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:48.217657 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bcd297-7d1c-4f7c-bc82-fb6c0fe1a2e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:48.218429 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c93e4e-001c-4d19-bd03-8483c7e82e31 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:48.220333 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bcd297-7d1c-4f7c-bc82-fb6c0fe1a2e3 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:48.247513 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 372/748] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:48.247897 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcd297-7d1c-4f7c-bc82-fb6c0fe1a2e3 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:48.287365 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b473e8-4291-43e6-b68d-efa7cbb46e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:48.288191 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b473e8-4291-43e6-b68d-efa7cbb46e4a None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:48.288466 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b473e8-4291-43e6-b68d-efa7cbb46e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:48.289120 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b473e8-4291-43e6-b68d-efa7cbb46e4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:48.307691 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b473e8-4291-43e6-b68d-efa7cbb46e4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:13:48.315070 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-a8b473e8-4291-43e6-b68d-efa7cbb46e4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:13:48.315070 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:48.315070 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:48.315070 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:48.315070 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:48.315070 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:48.315070 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:48.315070 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:48.315070 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:48.315070 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:48.315070 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:48.315070 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:48.315070 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:13:48.315070 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:13:48.315070 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:13:48.315070 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:13:48.316541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:13:48.316541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:13:48.316541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:13:48.316541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:13:48.316541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:48.316541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:48.316541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:48.316541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:48.316541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:48.316541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:48.316541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:48.316541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:48.316541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:48.316541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:48.316541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:48.316541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:48.317757 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:48.317757 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:48.317757 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:48.317757 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:48.317757 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:13:48.317757 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:13:48.317757 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:13:48.317757 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:13:48.317757 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:13:48.317757 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:13:48.317757 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:13:48.317757 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:48.317757 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 377/749] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:13:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:48.317757 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b473e8-4291-43e6-b68d-efa7cbb46e4a None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:48.325052 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:48.406216 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:48.417873 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcd297-7d1c-4f7c-bc82-fb6c0fe1a2e3 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:48.466158 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da924a9c-e3f1-4305-9ca6-44eb4a759b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:48.467393 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da924a9c-e3f1-4305-9ca6-44eb4a759b33 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:48.467694 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da924a9c-e3f1-4305-9ca6-44eb4a759b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:48.468100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da924a9c-e3f1-4305-9ca6-44eb4a759b33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:48.481791 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da924a9c-e3f1-4305-9ca6-44eb4a759b33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:48.483540 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da924a9c-e3f1-4305-9ca6-44eb4a759b33 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:48.485745 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b473e8-4291-43e6-b68d-efa7cbb46e4a None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:48.501083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-da924a9c-e3f1-4305-9ca6-44eb4a759b33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:48.501083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:48.501083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:48.501083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:48.501083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:48.501083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:48.501083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:48.501083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:48.501083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:48.501083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:48.501083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:48.501083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:48.501083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:13:48.501083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:13:48.501083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:13:48.502502 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:13:48.502502 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:48.502502 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:48.502502 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:48.502502 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:48.502502 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:48.502502 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:48.502502 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:48.502502 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:48.502502 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:48.502502 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:48.502502 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:48.502502 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:48.502502 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:48.502502 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:48.502502 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:48.502502 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:48.503436 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:13:48.503436 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:13:48.503436 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:13:48.503436 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:13:48.503436 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:13:48.503436 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:13:48.503436 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:48.503436 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:48.507720 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 373/750] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:48.508927 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da924a9c-e3f1-4305-9ca6-44eb4a759b33 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:48.538271 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190408c-2c0c-4d18-806e-fb3e80c905cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:48.539779 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190408c-2c0c-4d18-806e-fb3e80c905cc None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:48.540539 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190408c-2c0c-4d18-806e-fb3e80c905cc None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:48.541450 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190408c-2c0c-4d18-806e-fb3e80c905cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:48.552224 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190408c-2c0c-4d18-806e-fb3e80c905cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:48.554555 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190408c-2c0c-4d18-806e-fb3e80c905cc None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:48.570845 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-0190408c-2c0c-4d18-806e-fb3e80c905cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:48.570845 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:48.570845 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:48.570845 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:48.570845 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:48.570845 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:48.570845 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:48.570845 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:48.570845 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:48.570845 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:48.570845 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:48.570845 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:48.570845 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:13:48.570845 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:13:48.570845 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:13:48.572048 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:13:48.572048 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:48.572048 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:48.572048 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:48.572048 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:48.572048 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:48.572048 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:48.572048 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:48.572048 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:48.572048 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:48.572048 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:48.572048 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:48.572048 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:48.572048 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:48.572048 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:48.572048 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:48.572048 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:48.573326 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:13:48.573326 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:13:48.573326 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:13:48.573326 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:13:48.573326 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:13:48.573326 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:13:48.573326 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:48.573326 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:48.576550 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 378/751] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:48.577867 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190408c-2c0c-4d18-806e-fb3e80c905cc None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:48.668226 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:48.680203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da924a9c-e3f1-4305-9ca6-44eb4a759b33 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:48.755200 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e92fc-4eaf-4cf6-9e48-a20aa7a80b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:48.756944 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e92fc-4eaf-4cf6-9e48-a20aa7a80b10 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:48.757514 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e92fc-4eaf-4cf6-9e48-a20aa7a80b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:48.758441 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e92fc-4eaf-4cf6-9e48-a20aa7a80b10 None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:48.759694 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3e92fc-4eaf-4cf6-9e48-a20aa7a80b10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:48.760219 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3e92fc-4eaf-4cf6-9e48-a20aa7a80b10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:48.762355 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3e92fc-4eaf-4cf6-9e48-a20aa7a80b10 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:48.778625 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 374/752] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:13:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:48.780105 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e92fc-4eaf-4cf6-9e48-a20aa7a80b10 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:48.799342 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190408c-2c0c-4d18-806e-fb3e80c905cc None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:48.816200 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:48.854890 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8b6fb-0f13-443b-8c04-f08bbc89354d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:48.857632 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8b6fb-0f13-443b-8c04-f08bbc89354d None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:48.858206 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8b6fb-0f13-443b-8c04-f08bbc89354d None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:48.858872 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8b6fb-0f13-443b-8c04-f08bbc89354d None admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:48.860363 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc8b6fb-0f13-443b-8c04-f08bbc89354d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:48.860888 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc8b6fb-0f13-443b-8c04-f08bbc89354d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:48.863819 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc8b6fb-0f13-443b-8c04-f08bbc89354d None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:48.892315 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 379/753] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:13:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:48.903053 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8b6fb-0f13-443b-8c04-f08bbc89354d None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:48.979373 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e92fc-4eaf-4cf6-9e48-a20aa7a80b10 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:49.061081 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27b7f5-2f44-4a0f-bcad-b1ae6066f60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:49.062546 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27b7f5-2f44-4a0f-bcad-b1ae6066f60d None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:49.063000 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27b7f5-2f44-4a0f-bcad-b1ae6066f60d None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:49.067311 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27b7f5-2f44-4a0f-bcad-b1ae6066f60d None admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:49.069731 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27b7f5-2f44-4a0f-bcad-b1ae6066f60d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:49.070606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27b7f5-2f44-4a0f-bcad-b1ae6066f60d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:49.075329 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27b7f5-2f44-4a0f-bcad-b1ae6066f60d None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:49.097582 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 375/754] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:13:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:49.099156 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27b7f5-2f44-4a0f-bcad-b1ae6066f60d None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:49.129083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:49.130962 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8b6fb-0f13-443b-8c04-f08bbc89354d None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:49.188723 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01dffbb-eb88-48dc-b1fc-750ec4c22ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:49.190255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dffbb-eb88-48dc-b1fc-750ec4c22ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:49.190854 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dffbb-eb88-48dc-b1fc-750ec4c22ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:49.191378 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dffbb-eb88-48dc-b1fc-750ec4c22ff7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:49.208587 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01dffbb-eb88-48dc-b1fc-750ec4c22ff7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:49.212041 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01dffbb-eb88-48dc-b1fc-750ec4c22ff7 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:49.237141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-d01dffbb-eb88-48dc-b1fc-750ec4c22ff7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:49.237141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:49.237141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:49.237141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:49.237141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:49.237141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:49.237141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:49.237141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:49.237141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:49.237141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:49.237141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:49.237141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:49.237141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:49.237141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:49.237141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:49.237141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:49.238184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:49.238184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:49.238184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:49.238184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:49.238184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:49.238184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:49.238184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:49.238184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:49.238184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:49.238184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:49.238184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:49.238184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:49.238184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:49.238184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:49.238184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:49.238184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:49.238184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:49.239160 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:49.239160 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:49.239160 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:49.240980 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 380/755] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:49.242498 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01dffbb-eb88-48dc-b1fc-750ec4c22ff7 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:49.257236 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27b7f5-2f44-4a0f-bcad-b1ae6066f60d None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:49.300936 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc9be2-320d-4202-a10e-28ba342ccd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:49.302408 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:49.302787 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc9be2-320d-4202-a10e-28ba342ccd00 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:49.304476 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc9be2-320d-4202-a10e-28ba342ccd00 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:49.305403 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc9be2-320d-4202-a10e-28ba342ccd00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:49.306835 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc9be2-320d-4202-a10e-28ba342ccd00 None admin] RBAC: Adding query filter params (role.id=fb1c5c0f0edb47bf828f63bc685f98ba, scope.project.id=da9a86463d68412884746b115667d2fc, user.id=02e415eb75984daa97ee79fc0146f318) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:49.308834 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc9be2-320d-4202-a10e-28ba342ccd00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:49.312066 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc9be2-320d-4202-a10e-28ba342ccd00 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:49.321042 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 376/756] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:13:49 2022] GET /identity/v3/role_assignments?user.id=02e415eb75984daa97ee79fc0146f318&scope.project.id=da9a86463d68412884746b115667d2fc&role.id=fb1c5c0f0edb47bf828f63bc685f98ba => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:49.322360 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc9be2-320d-4202-a10e-28ba342ccd00 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:49.465819 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01dffbb-eb88-48dc-b1fc-750ec4c22ff7 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:49.536277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:49.558119 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc9be2-320d-4202-a10e-28ba342ccd00 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:49.566156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f56abc-f75e-47a7-83e3-60412d333017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:49.566888 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f56abc-f75e-47a7-83e3-60412d333017 None admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:49.567484 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f56abc-f75e-47a7-83e3-60412d333017 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:49.567883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f56abc-f75e-47a7-83e3-60412d333017 None admin] PATH_INFO: `/v3/projects/da9a86463d68412884746b115667d2fc/users/1a0af5bf009b48a8915c7320b16d08dd/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:49.570723 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f56abc-f75e-47a7-83e3-60412d333017 None admin] RBAC: Authorizing `identity:create_grant(project_id=da9a86463d68412884746b115667d2fc, user_id=1a0af5bf009b48a8915c7320b16d08dd, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:49.572540 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f56abc-f75e-47a7-83e3-60412d333017 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:49.631063 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437efaa4-a6c4-4379-97d4-8eb741005f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:49.637405 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437efaa4-a6c4-4379-97d4-8eb741005f44 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:49.637625 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 381/757] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Aug 23 22:13:49 2022] PUT /identity/v3/projects/da9a86463d68412884746b115667d2fc/users/1a0af5bf009b48a8915c7320b16d08dd/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:13:49.638415 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437efaa4-a6c4-4379-97d4-8eb741005f44 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:49.638984 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437efaa4-a6c4-4379-97d4-8eb741005f44 None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:49.640198 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437efaa4-a6c4-4379-97d4-8eb741005f44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:49.640779 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437efaa4-a6c4-4379-97d4-8eb741005f44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:49.643001 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437efaa4-a6c4-4379-97d4-8eb741005f44 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:49.658583 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a446aa-a0c7-4438-975c-f084bd86af3f None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:49.659348 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a446aa-a0c7-4438-975c-f084bd86af3f None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:49.660036 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a446aa-a0c7-4438-975c-f084bd86af3f None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:49.673419 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 382/758] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:49 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:49.674370 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 377/759] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:49.678263 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437efaa4-a6c4-4379-97d4-8eb741005f44 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:49.679120 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304d98b-098f-40b1-8c2b-4e20c1292cd7 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:49.679996 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304d98b-098f-40b1-8c2b-4e20c1292cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:49.680948 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304d98b-098f-40b1-8c2b-4e20c1292cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:49.730012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-e304d98b-098f-40b1-8c2b-4e20c1292cd7 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:49.746021 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-e304d98b-098f-40b1-8c2b-4e20c1292cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:49.936112 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437efaa4-a6c4-4379-97d4-8eb741005f44 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:49.953974 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 383/760] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:13:50.009764 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f603df-7720-4e73-a2d7-102ab52620f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:50.011088 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f603df-7720-4e73-a2d7-102ab52620f4 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:50.011596 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f603df-7720-4e73-a2d7-102ab52620f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:50.012098 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f603df-7720-4e73-a2d7-102ab52620f4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:50.024396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f603df-7720-4e73-a2d7-102ab52620f4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:50.026268 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f603df-7720-4e73-a2d7-102ab52620f4 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:50.044881 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-b9f603df-7720-4e73-a2d7-102ab52620f4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 22:13:50.044881 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:50.044881 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:50.044881 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:50.044881 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:50.044881 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:50.044881 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:50.044881 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:50.044881 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:50.044881 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:50.044881 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:50.044881 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:50.044881 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:13:50.044881 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:13:50.044881 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:13:50.044881 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:13:50.046231 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:50.046231 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:50.046231 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:13:50.046231 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:50.046231 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:13:50.046231 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:50.046231 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:50.046231 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:50.046231 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:50.046231 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:50.046231 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:50.046231 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:50.046231 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:50.046231 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:50.046231 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:50.046231 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:50.046231 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:50.046231 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:50.047501 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:50.047501 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:50.047501 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:13:50.047501 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:13:50.047501 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:13:50.047501 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:13:50.047501 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:13:50.047501 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:13:50.047501 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 22:13:50.047501 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:50.047501 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 378/761] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:13:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:50.057982 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304d98b-098f-40b1-8c2b-4e20c1292cd7 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:50.094959 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:50.248481 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304d98b-098f-40b1-8c2b-4e20c1292cd7 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:50.324712 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb62bd-610a-475d-bafd-ed5b79c6daee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:50.326519 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb62bd-610a-475d-bafd-ed5b79c6daee None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:50.327450 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb62bd-610a-475d-bafd-ed5b79c6daee None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:50.328315 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb62bd-610a-475d-bafd-ed5b79c6daee None admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:50.330206 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb62bd-610a-475d-bafd-ed5b79c6daee None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:50.331032 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb62bd-610a-475d-bafd-ed5b79c6daee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:50.332397 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f603df-7720-4e73-a2d7-102ab52620f4 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:50.335348 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb62bd-610a-475d-bafd-ed5b79c6daee None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:50.337400 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:50.377302 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 384/762] 10.222.0.77 () {56 vars in 1135 bytes} [Tue Aug 23 22:13:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:50.388130 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb62bd-610a-475d-bafd-ed5b79c6daee None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:50.545185 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:50.626033 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb62bd-610a-475d-bafd-ed5b79c6daee None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:50.707754 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425930c-be66-4e07-8702-d33b8c1b1c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:50.708349 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f603df-7720-4e73-a2d7-102ab52620f4 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:50.711767 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425930c-be66-4e07-8702-d33b8c1b1c9b None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:50.712441 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425930c-be66-4e07-8702-d33b8c1b1c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:50.713189 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425930c-be66-4e07-8702-d33b8c1b1c9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:50.822803 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425930c-be66-4e07-8702-d33b8c1b1c9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:50.824979 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f253bb-75f7-47aa-aafd-379d39c0a86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:50.825754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f253bb-75f7-47aa-aafd-379d39c0a86d None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:50.826037 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f253bb-75f7-47aa-aafd-379d39c0a86d None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:50.826311 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f253bb-75f7-47aa-aafd-379d39c0a86d None admin] PATH_INFO: `/v3/services/network` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:50.826908 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f253bb-75f7-47aa-aafd-379d39c0a86d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:50.827240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425930c-be66-4e07-8702-d33b8c1b1c9b None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:50.828308 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f253bb-75f7-47aa-aafd-379d39c0a86d None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:50.850774 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-a2f253bb-75f7-47aa-aafd-379d39c0a86d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:13:50.850774 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:50.850774 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:13:50.850774 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:13:50.850774 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:13:50.850774 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:13:50.850774 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:13:50.850774 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:50.850774 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:13:50.850774 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:50.850774 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:13:50.850774 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:50.850774 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:50.850774 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:50.850774 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:50.850774 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:50.850774 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:50.852504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:50.852504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:50.852504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:50.852504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:50.852504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:50.852504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:50.852504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:13:50.852504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:13:50.852504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:13:50.852504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:13:50.852504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:50.852504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:50.852504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:50.852504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:50.852504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:50.852504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:50.854538 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:50.854538 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:50.854538 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:50.854538 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:50.854538 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:50.854538 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:50.854538 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:50.854538 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:50.854538 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:50.854538 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:50.854538 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:13:50.854538 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:50.854538 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:13:50.854538 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:50.854538 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 379/763] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:50 2022] GET /identity/v3/services/network => generated 88 bytes in 521 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:50.866814 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f253bb-75f7-47aa-aafd-379d39c0a86d None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:50.942157 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:50.993161 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 385/764] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:13:50 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 22:13:50.996005 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76382e-8a6f-4db4-8551-ddb65ae9cdd6 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:50.996344 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76382e-8a6f-4db4-8551-ddb65ae9cdd6 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:50.996674 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76382e-8a6f-4db4-8551-ddb65ae9cdd6 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:51.003074 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 386/765] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:51.004157 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:51.006124 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76382e-8a6f-4db4-8551-ddb65ae9cdd6 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:51.063328 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f253bb-75f7-47aa-aafd-379d39c0a86d None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:51.130566 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f394ed2-74fa-4799-a79a-0be111090380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:51.131358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f394ed2-74fa-4799-a79a-0be111090380 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:51.131864 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f394ed2-74fa-4799-a79a-0be111090380 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:51.132231 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f394ed2-74fa-4799-a79a-0be111090380 None admin] PATH_INFO: `/v3/services` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:51.133104 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f394ed2-74fa-4799-a79a-0be111090380 None admin] RBAC: Adding query filter params (name=network) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:51.133849 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f394ed2-74fa-4799-a79a-0be111090380 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:51.136254 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f394ed2-74fa-4799-a79a-0be111090380 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:51.147210 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 380/766] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Aug 23 22:13:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:51.150551 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8350f7-f005-42a3-8922-9c97450fcc52 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:51.151511 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8350f7-f005-42a3-8922-9c97450fcc52 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:51.152165 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8350f7-f005-42a3-8922-9c97450fcc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:51.186078 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-8a8350f7-f005-42a3-8922-9c97450fcc52 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:51.187789 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-8a8350f7-f005-42a3-8922-9c97450fcc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:51.197221 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76382e-8a6f-4db4-8551-ddb65ae9cdd6 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:51.263317 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0ae23-190e-4bd3-bc6f-568e95a8db3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:51.264466 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0ae23-190e-4bd3-bc6f-568e95a8db3f None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:51.265095 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0ae23-190e-4bd3-bc6f-568e95a8db3f None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:51.265646 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0ae23-190e-4bd3-bc6f-568e95a8db3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:51.286115 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0ae23-190e-4bd3-bc6f-568e95a8db3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:51.289720 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0ae23-190e-4bd3-bc6f-568e95a8db3f None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:51.319700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-1dc0ae23-190e-4bd3-bc6f-568e95a8db3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:51.319700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:51.319700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:51.319700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:51.319700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:51.319700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:51.319700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:51.319700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:51.319700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:51.319700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:51.319700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:51.319700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:51.319700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:51.319700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:51.319700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:51.319700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:51.320877 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:51.320877 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:51.320877 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:51.320877 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:51.320877 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:51.320877 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:51.320877 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:51.320877 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:51.320877 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:51.320877 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:51.320877 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:51.320877 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:51.320877 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:51.320877 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:51.320877 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:51.320877 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:51.320877 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:51.322037 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:51.322037 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:51.322037 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:51.323646 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 387/767] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:51.324468 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0ae23-190e-4bd3-bc6f-568e95a8db3f None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:51.334585 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 381/768] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:13:51.335990 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8350f7-f005-42a3-8922-9c97450fcc52 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:51.367806 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:51.451356 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:51.518277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8350f7-f005-42a3-8922-9c97450fcc52 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:51.638938 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0ae23-190e-4bd3-bc6f-568e95a8db3f None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:51.652480 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dab81c-d47c-4c9d-ab49-6a40ec28583b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:51.653582 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dab81c-d47c-4c9d-ab49-6a40ec28583b None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:51.653869 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dab81c-d47c-4c9d-ab49-6a40ec28583b None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:51.654229 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dab81c-d47c-4c9d-ab49-6a40ec28583b None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:51.655274 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dab81c-d47c-4c9d-ab49-6a40ec28583b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:51.655594 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dab81c-d47c-4c9d-ab49-6a40ec28583b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:51.657905 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dab81c-d47c-4c9d-ab49-6a40ec28583b None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:51.692005 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 382/769] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:51.693120 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dab81c-d47c-4c9d-ab49-6a40ec28583b None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:51.720621 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37e3ab-64d0-4d8e-ada7-d734834e68dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:51.720880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37e3ab-64d0-4d8e-ada7-d734834e68dd None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:51.721215 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37e3ab-64d0-4d8e-ada7-d734834e68dd None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:51.721795 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37e3ab-64d0-4d8e-ada7-d734834e68dd None admin] PATH_INFO: `/v3/services` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:51.722464 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37e3ab-64d0-4d8e-ada7-d734834e68dd None admin] RBAC: Adding query filter params (type=network) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:51.722782 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37e3ab-64d0-4d8e-ada7-d734834e68dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:51.724426 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37e3ab-64d0-4d8e-ada7-d734834e68dd None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:51.738431 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 388/770] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Aug 23 22:13:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:51.739602 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37e3ab-64d0-4d8e-ada7-d734834e68dd None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:51.899088 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dab81c-d47c-4c9d-ab49-6a40ec28583b None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:51.929456 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:51.940644 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:51.965522 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37e3ab-64d0-4d8e-ada7-d734834e68dd None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:51.968247 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb6c5e-6819-4fd0-83ab-d01ac738a997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:51.969465 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb6c5e-6819-4fd0-83ab-d01ac738a997 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:51.971123 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb6c5e-6819-4fd0-83ab-d01ac738a997 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:51.971681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb6c5e-6819-4fd0-83ab-d01ac738a997 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:51.972686 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb6c5e-6819-4fd0-83ab-d01ac738a997 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:51.974863 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb6c5e-6819-4fd0-83ab-d01ac738a997 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:51.990327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-f0cb6c5e-6819-4fd0-83ab-d01ac738a997 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:13:51.990327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:51.990327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:13:51.990327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:13:51.990327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:13:51.990327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:13:51.990327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:13:51.990327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:51.990327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:13:51.990327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:51.990327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:13:51.990327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:51.990327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:51.990327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:51.990327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:51.990327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:51.990327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:51.991754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:51.991754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:51.991754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:51.991754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:51.991754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:51.991754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:51.991754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:13:51.991754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:13:51.991754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:13:51.991754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:13:51.991754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:51.991754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:51.991754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:51.991754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:51.991754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:51.991754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:51.992681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:51.992681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:51.992681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:51.992681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:51.992681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:51.992681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:51.992681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:51.992681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:51.992681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:51.992681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:51.992681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:13:51.992681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:51.992681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:13:51.992681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:52.004615 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 383/771] 10.222.0.77 () {56 vars in 1129 bytes} [Tue Aug 23 22:13:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:52.004615 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb6c5e-6819-4fd0-83ab-d01ac738a997 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:52.047171 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47273b69-bd4a-4ce6-ae0b-6020fccdf3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:52.048400 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47273b69-bd4a-4ce6-ae0b-6020fccdf3a8 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:52.049040 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47273b69-bd4a-4ce6-ae0b-6020fccdf3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:52.049828 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47273b69-bd4a-4ce6-ae0b-6020fccdf3a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:52.060822 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47273b69-bd4a-4ce6-ae0b-6020fccdf3a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:52.063030 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47273b69-bd4a-4ce6-ae0b-6020fccdf3a8 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:52.081641 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-47273b69-bd4a-4ce6-ae0b-6020fccdf3a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:52.081641 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:52.081641 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:52.081641 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:52.081641 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:52.081641 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:52.081641 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:52.081641 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:52.081641 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:52.081641 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:52.081641 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:52.081641 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:52.081641 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:13:52.081641 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:13:52.081641 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:13:52.082660 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:13:52.082660 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:52.082660 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:52.082660 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:52.082660 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:52.082660 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:52.082660 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:52.082660 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:52.082660 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:52.082660 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:52.082660 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:52.082660 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:52.082660 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:52.082660 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:52.082660 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:52.082660 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:52.082660 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:52.084228 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:13:52.084228 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:13:52.084228 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:13:52.084228 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:13:52.084228 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:13:52.084228 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:13:52.084228 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:52.084228 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:52.088009 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 389/772] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:52.089899 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47273b69-bd4a-4ce6-ae0b-6020fccdf3a8 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:52.187130 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb6c5e-6819-4fd0-83ab-d01ac738a997 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:52.243628 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47273b69-bd4a-4ce6-ae0b-6020fccdf3a8 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:52.247904 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd52dc9-843e-4a87-9789-b1a373529378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:52.248600 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd52dc9-843e-4a87-9789-b1a373529378 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:52.249012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd52dc9-843e-4a87-9789-b1a373529378 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:52.249596 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd52dc9-843e-4a87-9789-b1a373529378 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:52.252249 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd52dc9-843e-4a87-9789-b1a373529378 None admin] RBAC: Adding query filter params (interface=public, service_id=ec9739fb4f394c9ca4ae720ad359ee4c, region_id=RegionOne) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:52.252867 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd52dc9-843e-4a87-9789-b1a373529378 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:52.255716 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd52dc9-843e-4a87-9789-b1a373529378 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:52.284227 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 384/773] 10.222.0.77 () {56 vars in 1251 bytes} [Tue Aug 23 22:13:51 2022] GET /identity/v3/endpoints?service_id=ec9739fb4f394c9ca4ae720ad359ee4c&interface=public®ion_id=RegionOne => generated 194 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:52.284227 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd52dc9-843e-4a87-9789-b1a373529378 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:52.318434 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62091a61-8fdd-4e1e-8f53-d3d5c5db6dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:52.319704 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62091a61-8fdd-4e1e-8f53-d3d5c5db6dfc None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:52.320464 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62091a61-8fdd-4e1e-8f53-d3d5c5db6dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:52.321256 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62091a61-8fdd-4e1e-8f53-d3d5c5db6dfc None admin] PATH_INFO: `/v3/services` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:52.322629 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62091a61-8fdd-4e1e-8f53-d3d5c5db6dfc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:52.323378 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62091a61-8fdd-4e1e-8f53-d3d5c5db6dfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:52.325652 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62091a61-8fdd-4e1e-8f53-d3d5c5db6dfc None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:52.340364 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 390/774] 10.222.0.77 () {56 vars in 1124 bytes} [Tue Aug 23 22:13:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:52.342338 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62091a61-8fdd-4e1e-8f53-d3d5c5db6dfc None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:52.366791 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:52.367533 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:52.459719 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd52dc9-843e-4a87-9789-b1a373529378 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:52.520461 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8cc33-91be-4f0a-a605-3d994e18b559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:52.521008 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8cc33-91be-4f0a-a605-3d994e18b559 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:52.521402 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8cc33-91be-4f0a-a605-3d994e18b559 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:52.521694 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8cc33-91be-4f0a-a605-3d994e18b559 None admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:52.522412 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8cc33-91be-4f0a-a605-3d994e18b559 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:52.522821 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8cc33-91be-4f0a-a605-3d994e18b559 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:52.524995 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8cc33-91be-4f0a-a605-3d994e18b559 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:52.539517 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 385/775] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:13:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:52.541003 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307bfa9-e621-487c-b0d3-fd07af8bcae2 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:52.541324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307bfa9-e621-487c-b0d3-fd07af8bcae2 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:52.541985 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307bfa9-e621-487c-b0d3-fd07af8bcae2 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:52.544103 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 386/776] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:52.549120 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307bfa9-e621-487c-b0d3-fd07af8bcae2 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:52.551087 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62091a61-8fdd-4e1e-8f53-d3d5c5db6dfc None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:52.629668 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3699e6-60ac-44b3-b9c6-3fd9d2a86c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:52.630728 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3699e6-60ac-44b3-b9c6-3fd9d2a86c83 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:52.631147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3699e6-60ac-44b3-b9c6-3fd9d2a86c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:52.631716 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3699e6-60ac-44b3-b9c6-3fd9d2a86c83 None admin] PATH_INFO: `/v3/services` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:52.632541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3699e6-60ac-44b3-b9c6-3fd9d2a86c83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:52.635279 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3699e6-60ac-44b3-b9c6-3fd9d2a86c83 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:52.644594 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 391/777] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Aug 23 22:13:52 2022] GET /identity/v3/services => generated 772 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:52.648021 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3699e6-60ac-44b3-b9c6-3fd9d2a86c83 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:52.754237 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307bfa9-e621-487c-b0d3-fd07af8bcae2 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:52.782353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:52.798965 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:52.820111 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7892a695-6ea9-4dec-9f39-e5cc91e62585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:52.821680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892a695-6ea9-4dec-9f39-e5cc91e62585 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:52.822167 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892a695-6ea9-4dec-9f39-e5cc91e62585 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:52.822764 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892a695-6ea9-4dec-9f39-e5cc91e62585 None admin] PATH_INFO: `/v3/services` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:52.825406 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7892a695-6ea9-4dec-9f39-e5cc91e62585 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:52.825716 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7892a695-6ea9-4dec-9f39-e5cc91e62585 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:52.827998 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7892a695-6ea9-4dec-9f39-e5cc91e62585 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:52.840227 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 387/778] 10.222.0.77 () {56 vars in 1124 bytes} [Tue Aug 23 22:13:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:52.842720 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58059b32-d779-4d29-bc8f-5eff615631b1 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:52.843219 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58059b32-d779-4d29-bc8f-5eff615631b1 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:52.843702 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58059b32-d779-4d29-bc8f-5eff615631b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:52.844824 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3699e6-60ac-44b3-b9c6-3fd9d2a86c83 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:52.871757 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-58059b32-d779-4d29-bc8f-5eff615631b1 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:52.873261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-58059b32-d779-4d29-bc8f-5eff615631b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:52.909742 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9bec7-d0f5-4e78-ab4b-a42f4fc5fca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:52.911839 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9bec7-d0f5-4e78-ab4b-a42f4fc5fca7 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:52.912367 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9bec7-d0f5-4e78-ab4b-a42f4fc5fca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:52.912794 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9bec7-d0f5-4e78-ab4b-a42f4fc5fca7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:52.914171 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad9bec7-d0f5-4e78-ab4b-a42f4fc5fca7 None admin] RBAC: Adding query filter params (role.id=e806ce849cf34b92979b5524f3ea9ff6, scope.project.id=da9a86463d68412884746b115667d2fc, user.id=abda1f23a18c4c808483cd6b53952975) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:52.914687 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad9bec7-d0f5-4e78-ab4b-a42f4fc5fca7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:52.917861 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad9bec7-d0f5-4e78-ab4b-a42f4fc5fca7 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:52.928725 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 392/779] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:13:52 2022] GET /identity/v3/role_assignments?user.id=abda1f23a18c4c808483cd6b53952975&scope.project.id=da9a86463d68412884746b115667d2fc&role.id=e806ce849cf34b92979b5524f3ea9ff6 => generated 259 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:52.930436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706a966-5a75-42cc-bbb7-43f29cbacdfe None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:52.930874 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706a966-5a75-42cc-bbb7-43f29cbacdfe None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:52.931398 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706a966-5a75-42cc-bbb7-43f29cbacdfe None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:52.937456 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 393/780] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:52.937456 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706a966-5a75-42cc-bbb7-43f29cbacdfe None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:53.022613 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 388/781] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:13:53.032514 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c33fd9-6f6d-4eb7-93e9-28b28759ebf4 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:53.033188 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c33fd9-6f6d-4eb7-93e9-28b28759ebf4 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:53.033783 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c33fd9-6f6d-4eb7-93e9-28b28759ebf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:53.086707 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-18c33fd9-6f6d-4eb7-93e9-28b28759ebf4 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:53.089083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-18c33fd9-6f6d-4eb7-93e9-28b28759ebf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:53.201928 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706a966-5a75-42cc-bbb7-43f29cbacdfe None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:53.235359 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 389/782] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:13:53.271418 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980fc6c-3d49-490a-b039-075d15ec3c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:53.272238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980fc6c-3d49-490a-b039-075d15ec3c27 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:53.272885 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980fc6c-3d49-490a-b039-075d15ec3c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:53.273756 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980fc6c-3d49-490a-b039-075d15ec3c27 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:53.275036 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980fc6c-3d49-490a-b039-075d15ec3c27 None admin] RBAC: Adding query filter params (interface=public, service_id=1d740375f9a5475a8ddce603d96f3f49, region_id=RegionOne) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:53.275370 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980fc6c-3d49-490a-b039-075d15ec3c27 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:53.278568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980fc6c-3d49-490a-b039-075d15ec3c27 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:53.289226 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 394/783] 10.222.0.77 () {56 vars in 1251 bytes} [Tue Aug 23 22:13:52 2022] GET /identity/v3/endpoints?service_id=1d740375f9a5475a8ddce603d96f3f49&interface=public®ion_id=RegionOne => generated 194 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:53.296802 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c33fd9-6f6d-4eb7-93e9-28b28759ebf4 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:53.377161 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:53.492583 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c33fd9-6f6d-4eb7-93e9-28b28759ebf4 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:53.523112 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980fc6c-3d49-490a-b039-075d15ec3c27 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:53.527569 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:53.556442 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7928e7-48e4-4986-b6a8-733936284cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:53.557223 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7928e7-48e4-4986-b6a8-733936284cbc None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:53.557736 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7928e7-48e4-4986-b6a8-733936284cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:53.558222 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7928e7-48e4-4986-b6a8-733936284cbc None admin] PATH_INFO: `/v3/services` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:53.559347 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7928e7-48e4-4986-b6a8-733936284cbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:53.561616 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7928e7-48e4-4986-b6a8-733936284cbc None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:53.573917 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 390/784] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Aug 23 22:13:53 2022] GET /identity/v3/services => generated 772 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:13:53.631527 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7928e7-48e4-4986-b6a8-733936284cbc None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:53.774139 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980fc6c-3d49-490a-b039-075d15ec3c27 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:53.843283 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430c92f-3639-4a6c-a1a9-ccc68ddf9cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:53.844470 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430c92f-3639-4a6c-a1a9-ccc68ddf9cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:53.844980 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430c92f-3639-4a6c-a1a9-ccc68ddf9cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:53.846276 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430c92f-3639-4a6c-a1a9-ccc68ddf9cc2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:53.861695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430c92f-3639-4a6c-a1a9-ccc68ddf9cc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:13:53.867268 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:53.871310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-3430c92f-3639-4a6c-a1a9-ccc68ddf9cc2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:13:53.871310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:53.871310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:53.871310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:53.871310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:53.871310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:53.871310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:53.871310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:53.871310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:53.871310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:53.871310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:53.871310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:53.871310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:13:53.871310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:13:53.871310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:13:53.871310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:13:53.872341 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:13:53.872341 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:13:53.872341 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:13:53.872341 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:13:53.872341 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:53.872341 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:53.872341 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:53.872341 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:53.872341 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:53.872341 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:53.872341 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:53.872341 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:53.872341 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:53.872341 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:53.872341 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:53.872341 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:53.873195 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:53.873195 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:53.873195 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:53.873195 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:53.873195 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:13:53.873195 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:13:53.873195 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:13:53.873195 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:13:53.873195 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:13:53.873195 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:13:53.873195 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:13:53.873195 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:53.883999 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 395/785] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Aug 23 22:13:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:53.883999 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430c92f-3639-4a6c-a1a9-ccc68ddf9cc2 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:53.887715 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7928e7-48e4-4986-b6a8-733936284cbc None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:53.940584 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f874f5a-0065-4484-9d1e-e95ef206e9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:53.941589 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f874f5a-0065-4484-9d1e-e95ef206e9d2 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:53.942203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f874f5a-0065-4484-9d1e-e95ef206e9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:53.942461 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f874f5a-0065-4484-9d1e-e95ef206e9d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:53.961421 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f874f5a-0065-4484-9d1e-e95ef206e9d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:13:53.967734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-4f874f5a-0065-4484-9d1e-e95ef206e9d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:13:53.967734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:53.967734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:53.967734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:53.967734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:53.967734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:53.967734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:53.967734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:53.967734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:53.967734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:53.967734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:53.967734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:53.967734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:13:53.967734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:13:53.967734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:13:53.967734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:13:53.968853 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:13:53.968853 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:13:53.968853 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:13:53.968853 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:13:53.968853 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:53.968853 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:53.968853 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:53.968853 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:53.968853 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:53.968853 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:53.968853 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:53.968853 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:53.968853 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:53.968853 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:53.968853 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:53.968853 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:53.970819 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:53.970819 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:53.970819 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:53.970819 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:53.970819 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:13:53.970819 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:13:53.970819 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:13:53.970819 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:13:53.970819 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:13:53.970819 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:13:53.970819 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:13:53.970819 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:53.970819 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 391/786] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:13:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:53.976353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f874f5a-0065-4484-9d1e-e95ef206e9d2 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:54.011494 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:54.096530 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430c92f-3639-4a6c-a1a9-ccc68ddf9cc2 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:54.174307 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7266278-9386-42eb-b36a-5a39c53214fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:54.176499 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7266278-9386-42eb-b36a-5a39c53214fb None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:54.177212 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7266278-9386-42eb-b36a-5a39c53214fb None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:54.177826 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7266278-9386-42eb-b36a-5a39c53214fb None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:54.178988 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7266278-9386-42eb-b36a-5a39c53214fb None admin] RBAC: Adding query filter params (name=service) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:54.179496 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7266278-9386-42eb-b36a-5a39c53214fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:54.184367 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7266278-9386-42eb-b36a-5a39c53214fb None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:54.203002 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 396/787] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Aug 23 22:13:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:54.209013 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7266278-9386-42eb-b36a-5a39c53214fb None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:54.300789 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f874f5a-0065-4484-9d1e-e95ef206e9d2 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:54.347348 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3f82c-06b5-42f7-9fee-df8603ee0b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:54.348367 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3f82c-06b5-42f7-9fee-df8603ee0b84 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:54.348857 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3f82c-06b5-42f7-9fee-df8603ee0b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:54.349350 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3f82c-06b5-42f7-9fee-df8603ee0b84 None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:54.350264 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae3f82c-06b5-42f7-9fee-df8603ee0b84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:54.350800 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae3f82c-06b5-42f7-9fee-df8603ee0b84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:54.352403 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae3f82c-06b5-42f7-9fee-df8603ee0b84 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:54.372877 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 392/788] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:13:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:54.374949 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3f82c-06b5-42f7-9fee-df8603ee0b84 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:54.411316 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7266278-9386-42eb-b36a-5a39c53214fb None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:54.423015 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:54.445782 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:54.459307 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0abf13-da3d-4851-9d5d-9af518b4912c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:54.459955 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0abf13-da3d-4851-9d5d-9af518b4912c None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:54.460240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0abf13-da3d-4851-9d5d-9af518b4912c None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:54.460514 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0abf13-da3d-4851-9d5d-9af518b4912c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:54.475053 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0abf13-da3d-4851-9d5d-9af518b4912c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:54.476659 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0abf13-da3d-4851-9d5d-9af518b4912c None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:54.496643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-6a0abf13-da3d-4851-9d5d-9af518b4912c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:54.496643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:54.496643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:54.496643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:54.496643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:54.496643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:54.496643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:54.496643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:54.496643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:54.496643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:54.496643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:54.496643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:54.496643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:54.496643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:54.496643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:54.496643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:54.499023 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:54.499023 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:54.499023 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:54.499023 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:54.499023 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:54.499023 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:54.499023 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:54.499023 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:54.499023 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:54.499023 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:54.499023 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:54.499023 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:54.499023 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:54.499023 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:54.499023 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:54.499023 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:54.499023 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:54.501515 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:54.501515 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:54.501515 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:54.501515 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 397/789] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:54.511271 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0abf13-da3d-4851-9d5d-9af518b4912c None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:54.595880 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3f82c-06b5-42f7-9fee-df8603ee0b84 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:54.690592 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838c752-0dc1-43ef-a79d-96d9cd6d3ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:54.691642 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838c752-0dc1-43ef-a79d-96d9cd6d3ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:54.692102 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838c752-0dc1-43ef-a79d-96d9cd6d3ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:54.692553 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838c752-0dc1-43ef-a79d-96d9cd6d3ed2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:54.709901 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0abf13-da3d-4851-9d5d-9af518b4912c None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:54.732147 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838c752-0dc1-43ef-a79d-96d9cd6d3ed2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:54.736932 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838c752-0dc1-43ef-a79d-96d9cd6d3ed2 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:54.751890 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f9c64-d78e-49d3-8c32-f002a7e94a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:54.752516 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f9c64-d78e-49d3-8c32-f002a7e94a10 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:54.752796 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f9c64-d78e-49d3-8c32-f002a7e94a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:54.753113 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f9c64-d78e-49d3-8c32-f002a7e94a10 None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:54.753898 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f9c64-d78e-49d3-8c32-f002a7e94a10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:54.754236 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f9c64-d78e-49d3-8c32-f002a7e94a10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:54.755653 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f9c64-d78e-49d3-8c32-f002a7e94a10 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:54.770577 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 398/790] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:54.776817 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f9c64-d78e-49d3-8c32-f002a7e94a10 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:54.782417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-f838c752-0dc1-43ef-a79d-96d9cd6d3ed2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:54.782417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:54.782417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:54.782417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:54.782417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:54.782417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:54.782417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:54.782417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:54.782417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:54.782417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:54.782417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:54.782417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:54.782417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:54.782417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:54.782417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:54.782417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:54.783451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:54.783451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:54.783451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:54.783451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:54.783451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:54.783451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:54.783451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:54.783451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:54.783451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:54.783451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:54.783451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:54.783451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:54.783451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:54.783451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:54.783451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:54.783451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:54.783451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:54.790173 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:54.790173 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:54.790173 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:54.790173 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 393/791] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:54.790781 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838c752-0dc1-43ef-a79d-96d9cd6d3ed2 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:54.814711 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:54.897396 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f9c64-d78e-49d3-8c32-f002a7e94a10 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:54.911616 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:54.969576 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838c752-0dc1-43ef-a79d-96d9cd6d3ed2 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:55.003041 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b1f3c-c2cb-4616-911c-eed3dfd7d483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:55.004109 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b1f3c-c2cb-4616-911c-eed3dfd7d483 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:55.004601 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b1f3c-c2cb-4616-911c-eed3dfd7d483 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:55.005084 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b1f3c-c2cb-4616-911c-eed3dfd7d483 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:55.020362 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b1f3c-c2cb-4616-911c-eed3dfd7d483 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:55.023510 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b1f3c-c2cb-4616-911c-eed3dfd7d483 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:55.025167 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147de6ef-d49e-4b69-a54e-6cf3f0adf06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:55.026242 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147de6ef-d49e-4b69-a54e-6cf3f0adf06b None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:55.026792 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147de6ef-d49e-4b69-a54e-6cf3f0adf06b None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:55.027286 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147de6ef-d49e-4b69-a54e-6cf3f0adf06b None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:55.028583 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147de6ef-d49e-4b69-a54e-6cf3f0adf06b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:55.029139 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147de6ef-d49e-4b69-a54e-6cf3f0adf06b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:55.030838 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147de6ef-d49e-4b69-a54e-6cf3f0adf06b None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:55.053335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 394/792] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:55.059237 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147de6ef-d49e-4b69-a54e-6cf3f0adf06b None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:55.063695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-579b1f3c-c2cb-4616-911c-eed3dfd7d483 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 22:13:55.063695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:55.063695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:55.063695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:55.063695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:55.063695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:55.063695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:55.063695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:55.063695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:55.063695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:55.063695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:55.063695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:55.063695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:13:55.063695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:13:55.063695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:13:55.063695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:13:55.064869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:55.064869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:55.064869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:13:55.064869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:55.064869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:13:55.064869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:55.064869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:55.064869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:55.064869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:55.064869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:55.064869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:55.064869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:55.064869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:55.064869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:55.064869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:55.064869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:55.064869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:55.064869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:55.065883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:55.065883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:55.065883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:13:55.065883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:13:55.065883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:13:55.065883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:13:55.065883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:13:55.065883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:13:55.065883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 22:13:55.065883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:55.066443 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 399/793] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Aug 23 22:13:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:55.077256 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b1f3c-c2cb-4616-911c-eed3dfd7d483 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:55.274864 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:55.286978 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b1f3c-c2cb-4616-911c-eed3dfd7d483 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:55.297004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147de6ef-d49e-4b69-a54e-6cf3f0adf06b None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:55.341815 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea9e2a-8c9d-4123-92c1-fd5fe199e989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:55.343151 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea9e2a-8c9d-4123-92c1-fd5fe199e989 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:55.343764 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea9e2a-8c9d-4123-92c1-fd5fe199e989 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:55.344492 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea9e2a-8c9d-4123-92c1-fd5fe199e989 None admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:55.345691 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea9e2a-8c9d-4123-92c1-fd5fe199e989 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:55.346409 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea9e2a-8c9d-4123-92c1-fd5fe199e989 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:55.348833 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea9e2a-8c9d-4123-92c1-fd5fe199e989 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:55.373939 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:55.376974 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 400/794] 10.222.0.77 () {56 vars in 1149 bytes} [Tue Aug 23 22:13:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:55.384470 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea9e2a-8c9d-4123-92c1-fd5fe199e989 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:55.387987 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55137c-deec-4e26-8ebf-e330c88bd5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:55.389014 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55137c-deec-4e26-8ebf-e330c88bd5b9 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:55.389583 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55137c-deec-4e26-8ebf-e330c88bd5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:55.390015 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55137c-deec-4e26-8ebf-e330c88bd5b9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:55.400281 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f55137c-deec-4e26-8ebf-e330c88bd5b9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:55.408682 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f55137c-deec-4e26-8ebf-e330c88bd5b9 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:55.439186 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-0f55137c-deec-4e26-8ebf-e330c88bd5b9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:13:55.439186 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:55.439186 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:55.439186 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:55.439186 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:55.439186 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:55.439186 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:55.439186 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:55.439186 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:55.439186 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:55.439186 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:55.439186 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:55.439186 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:13:55.439186 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:13:55.439186 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:13:55.439186 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:13:55.440277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:55.440277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:55.440277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:13:55.440277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:55.440277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:13:55.440277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:55.440277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:55.440277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:55.440277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:55.440277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:55.440277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:55.440277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:55.440277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:55.440277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:55.440277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:55.440277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:55.440277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:55.440277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:55.441233 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:55.441233 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:55.441233 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:13:55.441233 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:13:55.441233 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:13:55.441233 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:13:55.441233 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:13:55.441233 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:13:55.441233 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:13:55.441233 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:55.447283 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 395/795] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Aug 23 22:13:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:55.452631 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55137c-deec-4e26-8ebf-e330c88bd5b9 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:55.535897 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea9e2a-8c9d-4123-92c1-fd5fe199e989 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:55.592528 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bea01-fb1c-4a5c-a21a-4820b6cf3ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:55.593678 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bea01-fb1c-4a5c-a21a-4820b6cf3ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:55.594169 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bea01-fb1c-4a5c-a21a-4820b6cf3ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:55.594681 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bea01-fb1c-4a5c-a21a-4820b6cf3ac0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:55.608172 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bea01-fb1c-4a5c-a21a-4820b6cf3ac0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:55.610262 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bea01-fb1c-4a5c-a21a-4820b6cf3ac0 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:55.636286 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-036bea01-fb1c-4a5c-a21a-4820b6cf3ac0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:55.636286 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:55.636286 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:55.636286 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:55.636286 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:55.636286 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:55.636286 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:55.636286 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:55.636286 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:55.636286 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:55.636286 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:55.636286 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:55.636286 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:55.636286 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:55.636286 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:55.636286 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:55.638154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:55.638154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:55.638154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:55.638154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:55.638154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:55.638154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:55.638154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:55.638154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:55.638154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:55.638154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:55.638154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:55.638154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:55.638154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:55.638154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:55.638154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:55.638154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:55.638154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:55.639536 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:55.639536 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:55.639536 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:55.642245 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 401/796] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:55.649307 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bea01-fb1c-4a5c-a21a-4820b6cf3ac0 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:55.661891 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:55.711860 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55137c-deec-4e26-8ebf-e330c88bd5b9 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:55.769618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3c043-a5b9-4ff6-8537-67e71bc4a8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:55.774635 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3c043-a5b9-4ff6-8537-67e71bc4a8fb None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:55.774635 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3c043-a5b9-4ff6-8537-67e71bc4a8fb None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:55.774635 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3c043-a5b9-4ff6-8537-67e71bc4a8fb None admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:55.774635 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3c043-a5b9-4ff6-8537-67e71bc4a8fb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:55.774635 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3c043-a5b9-4ff6-8537-67e71bc4a8fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:55.775483 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bea01-fb1c-4a5c-a21a-4820b6cf3ac0 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:55.779477 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3c043-a5b9-4ff6-8537-67e71bc4a8fb None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:55.805341 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 396/797] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Aug 23 22:13:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:13:55.806969 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40344151-2276-4353-97fe-ad2ac6e14527 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:55.807327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40344151-2276-4353-97fe-ad2ac6e14527 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:55.808150 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40344151-2276-4353-97fe-ad2ac6e14527 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:55.811094 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 397/798] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:55.820398 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac4a9d-abe8-4139-b4f9-574d3926eeef None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:55.820825 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac4a9d-abe8-4139-b4f9-574d3926eeef None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:55.821193 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac4a9d-abe8-4139-b4f9-574d3926eeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:55.835344 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60627a-b1d0-490e-914f-d14c14259552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:55.836953 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60627a-b1d0-490e-914f-d14c14259552 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:55.837555 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60627a-b1d0-490e-914f-d14c14259552 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:55.838191 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60627a-b1d0-490e-914f-d14c14259552 None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:55.839220 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60627a-b1d0-490e-914f-d14c14259552 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:55.839792 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60627a-b1d0-490e-914f-d14c14259552 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:55.852485 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60627a-b1d0-490e-914f-d14c14259552 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:55.859482 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 402/799] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:55.860119 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-6eac4a9d-abe8-4139-b4f9-574d3926eeef None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:55.860620 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60627a-b1d0-490e-914f-d14c14259552 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:55.863000 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-6eac4a9d-abe8-4139-b4f9-574d3926eeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:55.933648 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:55.960386 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:55.964431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 398/800] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:13:55.966040 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac4a9d-abe8-4139-b4f9-574d3926eeef None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:56.011639 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60627a-b1d0-490e-914f-d14c14259552 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:56.101483 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c6646-fe8e-47b0-97b0-b97b4052124b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:56.102635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c6646-fe8e-47b0-97b0-b97b4052124b None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:56.103295 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c6646-fe8e-47b0-97b0-b97b4052124b None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:56.103779 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c6646-fe8e-47b0-97b0-b97b4052124b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:56.105575 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac4a9d-abe8-4139-b4f9-574d3926eeef None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:56.292555 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5761606-467c-4a4f-8800-46c201c71e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:56.294208 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5761606-467c-4a4f-8800-46c201c71e4f None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:56.294951 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5761606-467c-4a4f-8800-46c201c71e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:56.295666 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5761606-467c-4a4f-8800-46c201c71e4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:56.305900 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c6646-fe8e-47b0-97b0-b97b4052124b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:56.307785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c6646-fe8e-47b0-97b0-b97b4052124b None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:56.309618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5761606-467c-4a4f-8800-46c201c71e4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:56.312800 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5761606-467c-4a4f-8800-46c201c71e4f None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:56.333396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-e5761606-467c-4a4f-8800-46c201c71e4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:56.333396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:56.333396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:56.333396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:56.333396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:56.333396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:56.333396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:56.333396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:56.333396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:56.333396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:56.333396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:56.333396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:56.333396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:13:56.333396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:13:56.333396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:13:56.334497 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:13:56.334497 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:56.334497 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:56.334497 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:56.334497 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:56.334497 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:56.334497 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:56.334497 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:56.334497 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:56.334497 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:56.334497 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:56.334497 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:56.334497 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:56.334497 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:56.334497 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:56.334497 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:56.334497 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:56.335541 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:13:56.335541 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:13:56.335541 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:13:56.335541 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:13:56.335541 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:13:56.335541 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:13:56.335541 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:56.335541 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:56.338908 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 399/801] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:56.341586 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46db349-433c-4548-9677-f0fe04be05db None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:56.342175 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46db349-433c-4548-9677-f0fe04be05db None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:56.342721 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46db349-433c-4548-9677-f0fe04be05db None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:56.350006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 400/802] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:56.352234 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46db349-433c-4548-9677-f0fe04be05db None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:56.413343 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:56.439743 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:56.483818 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 403/803] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:13:55 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:13:56.486346 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89215ff3-4c84-41d1-8f77-5ddb3127e402 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:56.486859 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89215ff3-4c84-41d1-8f77-5ddb3127e402 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:56.487407 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89215ff3-4c84-41d1-8f77-5ddb3127e402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:56.517437 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-89215ff3-4c84-41d1-8f77-5ddb3127e402 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:56.519006 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-89215ff3-4c84-41d1-8f77-5ddb3127e402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:56.542063 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46db349-433c-4548-9677-f0fe04be05db None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:56.606354 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1ed69-a53e-491e-8132-e53403ea8411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:56.607853 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1ed69-a53e-491e-8132-e53403ea8411 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:56.608637 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1ed69-a53e-491e-8132-e53403ea8411 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:56.609457 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1ed69-a53e-491e-8132-e53403ea8411 None admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:56.611108 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b1ed69-a53e-491e-8132-e53403ea8411 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:56.612041 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b1ed69-a53e-491e-8132-e53403ea8411 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:56.615138 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b1ed69-a53e-491e-8132-e53403ea8411 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:56.641172 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 401/804] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:13:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:56.641949 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 404/805] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:13:56.643555 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89215ff3-4c84-41d1-8f77-5ddb3127e402 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:56.644171 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1ed69-a53e-491e-8132-e53403ea8411 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:56.851213 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:56.864781 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1ed69-a53e-491e-8132-e53403ea8411 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:56.872470 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:56.886996 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89215ff3-4c84-41d1-8f77-5ddb3127e402 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:56.938672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3a86f-babb-4cf8-94f8-6a5b968f609b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:56.939334 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3a86f-babb-4cf8-94f8-6a5b968f609b None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:56.939610 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3a86f-babb-4cf8-94f8-6a5b968f609b None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:56.939931 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3a86f-babb-4cf8-94f8-6a5b968f609b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:56.949553 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0aeed-17aa-4d62-b7f1-d36c6a7acd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:56.950232 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0aeed-17aa-4d62-b7f1-d36c6a7acd2a None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:56.950516 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0aeed-17aa-4d62-b7f1-d36c6a7acd2a None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:56.950793 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0aeed-17aa-4d62-b7f1-d36c6a7acd2a None admin] PATH_INFO: `/v3/services/network` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:56.951413 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0aeed-17aa-4d62-b7f1-d36c6a7acd2a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:56.953142 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0aeed-17aa-4d62-b7f1-d36c6a7acd2a None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:56.958545 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3a86f-babb-4cf8-94f8-6a5b968f609b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:56.959996 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3a86f-babb-4cf8-94f8-6a5b968f609b None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:56.965910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-37e0aeed-17aa-4d62-b7f1-d36c6a7acd2a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:13:56.965910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:56.965910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:13:56.965910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:13:56.965910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:13:56.965910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:13:56.965910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:13:56.965910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:56.965910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:13:56.965910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:56.965910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:13:56.965910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:56.965910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:56.965910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:56.965910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:56.965910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:56.965910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:56.966989 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:56.966989 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:56.966989 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:56.966989 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:56.966989 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:56.966989 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:56.966989 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:13:56.966989 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:13:56.966989 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:13:56.966989 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:13:56.966989 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:56.966989 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:56.966989 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:56.966989 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:56.966989 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:56.966989 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:56.967942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:56.967942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:56.967942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:56.967942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:56.967942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:56.967942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:56.967942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:56.967942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:56.967942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:56.967942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:56.967942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:13:56.967942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:56.967942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:13:56.967942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:56.967942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 405/806] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:56 2022] GET /identity/v3/services/network => generated 88 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:56.968782 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0aeed-17aa-4d62-b7f1-d36c6a7acd2a None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:56.984074 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-7ab3a86f-babb-4cf8-94f8-6a5b968f609b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:56.984074 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:56.984074 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:56.984074 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:56.984074 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:56.984074 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:56.984074 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:56.984074 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:56.984074 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:56.984074 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:56.984074 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:56.984074 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:56.984074 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:56.984074 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:56.984074 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:56.984074 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:56.985163 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:56.985163 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:56.985163 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:56.985163 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:56.985163 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:56.985163 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:56.985163 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:56.985163 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:56.985163 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:56.985163 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:56.985163 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:56.985163 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:56.985163 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:56.985163 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:56.985163 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:56.985163 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:56.985163 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:56.986231 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:56.986231 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:56.986231 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:56.990897 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 402/807] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:56.992407 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243b009-aa72-41e2-9350-7ea91eeccc03 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:56.992695 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243b009-aa72-41e2-9350-7ea91eeccc03 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:56.993565 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243b009-aa72-41e2-9350-7ea91eeccc03 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:56.995721 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 403/808] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:56.997028 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243b009-aa72-41e2-9350-7ea91eeccc03 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:57.147865 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0aeed-17aa-4d62-b7f1-d36c6a7acd2a None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:57.154900 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243b009-aa72-41e2-9350-7ea91eeccc03 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:57.193043 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4a094-13ec-4554-a7cf-b368fa1c70d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:57.193763 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4a094-13ec-4554-a7cf-b368fa1c70d3 None admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:57.194084 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4a094-13ec-4554-a7cf-b368fa1c70d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:57.194363 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4a094-13ec-4554-a7cf-b368fa1c70d3 None admin] PATH_INFO: `/v3/projects/da9a86463d68412884746b115667d2fc/users/02e415eb75984daa97ee79fc0146f318/roles/fb1c5c0f0edb47bf828f63bc685f98ba` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:57.196706 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213669bc-0bbe-4ea5-8a16-253af21b6ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:57.197335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213669bc-0bbe-4ea5-8a16-253af21b6ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:57.197647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213669bc-0bbe-4ea5-8a16-253af21b6ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:57.198445 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213669bc-0bbe-4ea5-8a16-253af21b6ad9 None admin] PATH_INFO: `/v3/services` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:57.199096 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213669bc-0bbe-4ea5-8a16-253af21b6ad9 None admin] RBAC: Adding query filter params (name=network) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:57.199393 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213669bc-0bbe-4ea5-8a16-253af21b6ad9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:57.200799 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213669bc-0bbe-4ea5-8a16-253af21b6ad9 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:57.205852 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 404/809] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Aug 23 22:13:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:57.206806 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213669bc-0bbe-4ea5-8a16-253af21b6ad9 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:57.218336 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4a094-13ec-4554-a7cf-b368fa1c70d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=da9a86463d68412884746b115667d2fc, user_id=02e415eb75984daa97ee79fc0146f318, role_id=fb1c5c0f0edb47bf828f63bc685f98ba)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:57.219826 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4a094-13ec-4554-a7cf-b368fa1c70d3 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:57.224911 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:57.237866 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 406/810] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Aug 23 22:13:56 2022] PUT /identity/v3/projects/da9a86463d68412884746b115667d2fc/users/02e415eb75984daa97ee79fc0146f318/roles/fb1c5c0f0edb47bf828f63bc685f98ba => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:13:57.239244 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9367b2-f37c-4f84-86da-9c0cd270950a None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:57.239540 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9367b2-f37c-4f84-86da-9c0cd270950a None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:57.239822 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9367b2-f37c-4f84-86da-9c0cd270950a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:57.274023 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-6b9367b2-f37c-4f84-86da-9c0cd270950a None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:57.275842 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-6b9367b2-f37c-4f84-86da-9c0cd270950a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:57.281584 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:57.373416 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213669bc-0bbe-4ea5-8a16-253af21b6ad9 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:57.401875 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 407/811] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:13:57.401875 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9367b2-f37c-4f84-86da-9c0cd270950a None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:57.458384 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acaaa1-0af1-4dee-a8bf-e76037970178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:57.459106 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acaaa1-0af1-4dee-a8bf-e76037970178 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:57.459368 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acaaa1-0af1-4dee-a8bf-e76037970178 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:57.459866 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acaaa1-0af1-4dee-a8bf-e76037970178 None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:57.461412 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2acaaa1-0af1-4dee-a8bf-e76037970178 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:57.461412 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2acaaa1-0af1-4dee-a8bf-e76037970178 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:57.464540 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2acaaa1-0af1-4dee-a8bf-e76037970178 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:57.484771 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 405/812] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:57.486250 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acaaa1-0af1-4dee-a8bf-e76037970178 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:57.587837 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9367b2-f37c-4f84-86da-9c0cd270950a None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:57.639195 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:57.664978 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45303d-3a3a-4a8c-bee9-f4c4a7c375b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:57.666297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45303d-3a3a-4a8c-bee9-f4c4a7c375b5 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:57.666815 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45303d-3a3a-4a8c-bee9-f4c4a7c375b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:57.667463 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45303d-3a3a-4a8c-bee9-f4c4a7c375b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:57.695093 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45303d-3a3a-4a8c-bee9-f4c4a7c375b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:13:57.695538 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acaaa1-0af1-4dee-a8bf-e76037970178 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:57.704193 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-1a45303d-3a3a-4a8c-bee9-f4c4a7c375b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:13:57.704193 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:57.704193 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:57.704193 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:57.704193 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:57.704193 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:57.704193 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:57.704193 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:57.704193 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:57.704193 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:57.704193 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:57.704193 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:57.704193 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:13:57.704193 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:13:57.704193 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:13:57.704193 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:13:57.705321 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:13:57.705321 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:13:57.705321 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:13:57.705321 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:13:57.705321 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:57.705321 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:57.705321 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:57.705321 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:57.705321 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:57.705321 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:57.705321 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:57.705321 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:57.705321 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:57.705321 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:57.705321 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:57.705321 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:57.706217 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:57.706217 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:57.706217 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:57.706217 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:57.706217 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:13:57.706217 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:13:57.706217 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:13:57.706217 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:13:57.706217 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:13:57.706217 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:13:57.706217 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:13:57.706217 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:57.706217 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 408/813] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:13:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:57.706923 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45303d-3a3a-4a8c-bee9-f4c4a7c375b5 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:57.721766 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:57.750751 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcfd20-475b-4e82-bf40-0d01380ba1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:57.751703 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcfd20-475b-4e82-bf40-0d01380ba1a4 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:57.752342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcfd20-475b-4e82-bf40-0d01380ba1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:57.752802 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcfd20-475b-4e82-bf40-0d01380ba1a4 None admin] PATH_INFO: `/v3/services` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:57.753742 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fcfd20-475b-4e82-bf40-0d01380ba1a4 None admin] RBAC: Adding query filter params (type=network) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:57.754547 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fcfd20-475b-4e82-bf40-0d01380ba1a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:57.757316 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fcfd20-475b-4e82-bf40-0d01380ba1a4 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:57.773960 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 406/814] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Aug 23 22:13:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:57.775629 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcfd20-475b-4e82-bf40-0d01380ba1a4 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:57.874608 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45303d-3a3a-4a8c-bee9-f4c4a7c375b5 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:57.922778 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355deb7-53ac-4e7b-9c0b-9cc9bbe31f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:57.923422 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355deb7-53ac-4e7b-9c0b-9cc9bbe31f0d None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:57.923803 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355deb7-53ac-4e7b-9c0b-9cc9bbe31f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:57.924149 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355deb7-53ac-4e7b-9c0b-9cc9bbe31f0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:57.925509 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcfd20-475b-4e82-bf40-0d01380ba1a4 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:57.932286 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355deb7-53ac-4e7b-9c0b-9cc9bbe31f0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:57.933812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355deb7-53ac-4e7b-9c0b-9cc9bbe31f0d None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:57.947436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-7355deb7-53ac-4e7b-9c0b-9cc9bbe31f0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:57.947436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:57.947436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:57.947436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:57.947436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:57.947436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:57.947436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:57.947436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:57.947436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:57.947436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:57.947436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:57.947436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:57.947436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:13:57.947436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:13:57.947436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:13:57.949707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:13:57.949707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:57.949707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:57.949707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:57.949707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:57.949707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:57.949707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:57.949707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:57.949707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:57.949707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:57.949707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:57.949707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:57.949707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:57.949707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:57.949707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:57.949707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:57.949707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:57.951435 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:13:57.951435 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:13:57.951435 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:13:57.951435 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:13:57.951435 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:13:57.951435 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:13:57.951435 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:57.951435 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:57.951435 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 409/815] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:57.951435 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355deb7-53ac-4e7b-9c0b-9cc9bbe31f0d None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:57.982476 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dbf52-c6a9-46f7-b051-e2466607e9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:57.983484 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dbf52-c6a9-46f7-b051-e2466607e9fb None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:57.983957 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dbf52-c6a9-46f7-b051-e2466607e9fb None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:57.984414 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dbf52-c6a9-46f7-b051-e2466607e9fb None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:57.985491 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048dbf52-c6a9-46f7-b051-e2466607e9fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:57.985838 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048dbf52-c6a9-46f7-b051-e2466607e9fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:57.987264 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048dbf52-c6a9-46f7-b051-e2466607e9fb None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:57.993212 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:58.003863 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 407/816] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:13:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:58.004802 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dbf52-c6a9-46f7-b051-e2466607e9fb None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:58.035561 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:58.096952 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355deb7-53ac-4e7b-9c0b-9cc9bbe31f0d None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:58.154351 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3cfe2-3536-4ebc-ba43-4769761ee2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:58.155850 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3cfe2-3536-4ebc-ba43-4769761ee2c3 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:58.156693 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3cfe2-3536-4ebc-ba43-4769761ee2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:58.157447 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3cfe2-3536-4ebc-ba43-4769761ee2c3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:58.158736 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a3cfe2-3536-4ebc-ba43-4769761ee2c3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:58.161489 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a3cfe2-3536-4ebc-ba43-4769761ee2c3 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:58.177968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-86a3cfe2-3536-4ebc-ba43-4769761ee2c3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:13:58.177968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:58.177968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:13:58.177968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:13:58.177968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:13:58.177968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:13:58.177968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:13:58.177968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:58.177968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:13:58.177968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:58.177968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:13:58.177968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:58.177968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:58.177968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:58.177968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:58.177968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:58.177968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:58.179077 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:58.179077 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:58.179077 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:58.179077 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:58.179077 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:58.179077 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:58.179077 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:13:58.179077 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:13:58.179077 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:13:58.179077 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:13:58.179077 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:58.179077 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:58.179077 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:58.179077 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:58.179077 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:58.179077 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:58.179972 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:58.179972 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:58.179972 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:58.179972 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:58.179972 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:58.179972 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:58.179972 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:58.179972 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:58.179972 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:58.179972 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:58.179972 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:13:58.179972 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:58.179972 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:13:58.179972 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:58.181318 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dbf52-c6a9-46f7-b051-e2466607e9fb None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:58.181471 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 410/817] 10.222.0.77 () {56 vars in 1129 bytes} [Tue Aug 23 22:13:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:58.188651 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3cfe2-3536-4ebc-ba43-4769761ee2c3 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:58.244583 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62c103-b66b-48bb-97f3-198041c69bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:58.246265 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62c103-b66b-48bb-97f3-198041c69bc0 None admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:58.246692 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62c103-b66b-48bb-97f3-198041c69bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:58.247452 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62c103-b66b-48bb-97f3-198041c69bc0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:58.248445 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62c103-b66b-48bb-97f3-198041c69bc0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:58.250982 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62c103-b66b-48bb-97f3-198041c69bc0 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:58.294487 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 408/818] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:13:58 2022] POST /identity/v3/endpoints => generated 337 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:13:58.303276 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62c103-b66b-48bb-97f3-198041c69bc0 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:58.357929 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3cfe2-3536-4ebc-ba43-4769761ee2c3 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:58.396215 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:58.425409 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2deb0b9-5a6c-4bf5-8c65-589bff587689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:58.426198 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2deb0b9-5a6c-4bf5-8c65-589bff587689 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:58.426555 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2deb0b9-5a6c-4bf5-8c65-589bff587689 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:58.426960 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2deb0b9-5a6c-4bf5-8c65-589bff587689 None admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:58.428110 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2deb0b9-5a6c-4bf5-8c65-589bff587689 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:58.428537 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2deb0b9-5a6c-4bf5-8c65-589bff587689 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:58.428874 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:58.431052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2deb0b9-5a6c-4bf5-8c65-589bff587689 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:58.454589 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 411/819] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:13:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:58.455699 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2deb0b9-5a6c-4bf5-8c65-589bff587689 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:58.507523 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62c103-b66b-48bb-97f3-198041c69bc0 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:58.560248 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ba90b-ade7-41b7-b0c5-0f26f85570c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:58.561449 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ba90b-ade7-41b7-b0c5-0f26f85570c2 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:58.561907 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ba90b-ade7-41b7-b0c5-0f26f85570c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:58.562339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ba90b-ade7-41b7-b0c5-0f26f85570c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:58.577154 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ba90b-ade7-41b7-b0c5-0f26f85570c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:58.579049 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ba90b-ade7-41b7-b0c5-0f26f85570c2 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:58.609413 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-608ba90b-ade7-41b7-b0c5-0f26f85570c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:58.609413 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:58.609413 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:58.609413 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:58.609413 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:58.609413 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:58.609413 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:58.609413 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:58.609413 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:58.609413 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:58.609413 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:58.609413 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:58.609413 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:58.609413 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:58.609413 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:58.609413 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:58.610680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:58.610680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:58.610680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:58.610680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:58.610680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:58.610680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:58.610680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:58.610680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:58.610680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:58.610680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:58.610680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:58.610680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:58.610680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:58.610680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:58.610680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:58.610680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:58.610680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:58.611708 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:58.611708 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:58.611708 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:58.613081 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 409/820] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:58.614504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ba90b-ade7-41b7-b0c5-0f26f85570c2 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:58.622959 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2deb0b9-5a6c-4bf5-8c65-589bff587689 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:58.669525 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f5c4a-8a4c-423d-923f-a6f0455f819d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:58.670498 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f5c4a-8a4c-423d-923f-a6f0455f819d None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:58.671016 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f5c4a-8a4c-423d-923f-a6f0455f819d None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:58.671362 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f5c4a-8a4c-423d-923f-a6f0455f819d None admin] PATH_INFO: `/v3/services` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:58.672024 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f5c4a-8a4c-423d-923f-a6f0455f819d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:58.672334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f5c4a-8a4c-423d-923f-a6f0455f819d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:58.674323 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f5c4a-8a4c-423d-923f-a6f0455f819d None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:58.679831 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 412/821] 10.222.0.77 () {56 vars in 1124 bytes} [Tue Aug 23 22:13:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:58.682437 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f5c4a-8a4c-423d-923f-a6f0455f819d None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:58.744280 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ba90b-ade7-41b7-b0c5-0f26f85570c2 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:58.745194 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:58.759166 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:58.801710 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a914e-6d16-4b0f-9777-ca9689ad9670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:58.802669 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a914e-6d16-4b0f-9777-ca9689ad9670 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:58.803141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a914e-6d16-4b0f-9777-ca9689ad9670 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:58.803596 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a914e-6d16-4b0f-9777-ca9689ad9670 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:58.804789 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a914e-6d16-4b0f-9777-ca9689ad9670 None admin] RBAC: Adding query filter params (role.id=e806ce849cf34b92979b5524f3ea9ff6, scope.project.id=da9a86463d68412884746b115667d2fc, user.id=1a0af5bf009b48a8915c7320b16d08dd) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:58.805309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a914e-6d16-4b0f-9777-ca9689ad9670 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:58.809020 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a914e-6d16-4b0f-9777-ca9689ad9670 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:58.819048 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 410/822] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:13:58 2022] GET /identity/v3/role_assignments?user.id=1a0af5bf009b48a8915c7320b16d08dd&scope.project.id=da9a86463d68412884746b115667d2fc&role.id=e806ce849cf34b92979b5524f3ea9ff6 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:58.820365 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a914e-6d16-4b0f-9777-ca9689ad9670 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:58.851550 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f5c4a-8a4c-423d-923f-a6f0455f819d None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:58.914260 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc32a0b-f6d0-4213-9e03-5973a3744919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:58.915266 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc32a0b-f6d0-4213-9e03-5973a3744919 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:58.915266 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc32a0b-f6d0-4213-9e03-5973a3744919 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:58.915581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc32a0b-f6d0-4213-9e03-5973a3744919 None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:58.916130 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc32a0b-f6d0-4213-9e03-5973a3744919 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:58.916991 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc32a0b-f6d0-4213-9e03-5973a3744919 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:58.918578 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc32a0b-f6d0-4213-9e03-5973a3744919 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:58.938751 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 413/823] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:58.943118 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc32a0b-f6d0-4213-9e03-5973a3744919 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:59.009455 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a914e-6d16-4b0f-9777-ca9689ad9670 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:59.071196 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591d03d-22bd-4389-8b5b-40884b4f290b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:59.075031 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591d03d-22bd-4389-8b5b-40884b4f290b None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:59.076868 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591d03d-22bd-4389-8b5b-40884b4f290b None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:59.076868 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591d03d-22bd-4389-8b5b-40884b4f290b None admin] PATH_INFO: `/v3/services` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:59.077202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591d03d-22bd-4389-8b5b-40884b4f290b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:59.077529 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591d03d-22bd-4389-8b5b-40884b4f290b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:59.080206 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591d03d-22bd-4389-8b5b-40884b4f290b None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:59.094626 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 411/824] 10.222.0.77 () {56 vars in 1124 bytes} [Tue Aug 23 22:13:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:59.105566 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591d03d-22bd-4389-8b5b-40884b4f290b None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:59.123279 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc32a0b-f6d0-4213-9e03-5973a3744919 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:59.126283 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:59.166217 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:59.175448 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c9b45-e71e-4fd6-8692-1d2156d8a008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:59.177419 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c9b45-e71e-4fd6-8692-1d2156d8a008 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:59.178162 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c9b45-e71e-4fd6-8692-1d2156d8a008 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:59.179278 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c9b45-e71e-4fd6-8692-1d2156d8a008 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:59.199500 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c9b45-e71e-4fd6-8692-1d2156d8a008 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:59.203524 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c9b45-e71e-4fd6-8692-1d2156d8a008 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:59.228896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-ab8c9b45-e71e-4fd6-8692-1d2156d8a008 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 22:13:59.228896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:59.228896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:59.228896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:59.228896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:59.228896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:59.228896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:59.228896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:59.228896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:59.228896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:59.228896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:59.228896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:59.228896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:13:59.228896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:13:59.228896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:13:59.228896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:13:59.230738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:59.230738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:59.230738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:13:59.230738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:59.230738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:13:59.230738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:59.230738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:59.230738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:59.230738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:59.230738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:59.230738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:59.230738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:59.230738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:59.230738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:59.230738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:59.230738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:59.230738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:59.230738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:59.231667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:59.231667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:59.231667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:13:59.231667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:13:59.231667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:13:59.231667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:13:59.231667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:13:59.231667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:13:59.231667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 22:13:59.231667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:13:59.232227 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 414/825] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:13:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:59.238312 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c9b45-e71e-4fd6-8692-1d2156d8a008 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:59.261657 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591d03d-22bd-4389-8b5b-40884b4f290b None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:59.304381 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121b6b5-7c9a-4fff-9669-b25dc549af92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:59.305162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121b6b5-7c9a-4fff-9669-b25dc549af92 None admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:59.305565 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121b6b5-7c9a-4fff-9669-b25dc549af92 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:59.305933 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121b6b5-7c9a-4fff-9669-b25dc549af92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:59.306767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f121b6b5-7c9a-4fff-9669-b25dc549af92 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:59.308374 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f121b6b5-7c9a-4fff-9669-b25dc549af92 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:59.333632 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 412/826] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:13:59 2022] POST /identity/v3/endpoints => generated 346 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:13:59.413333 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c9b45-e71e-4fd6-8692-1d2156d8a008 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:59.483961 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218958c-6593-4138-8f95-1f1a8ce3f8f7 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:59.484229 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218958c-6593-4138-8f95-1f1a8ce3f8f7 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:59.484646 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218958c-6593-4138-8f95-1f1a8ce3f8f7 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:59.486807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 413/827] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:13:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:59.493101 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6dab3-2a5f-4bfb-8bc4-d1c9e33b871a None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:59.493872 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6dab3-2a5f-4bfb-8bc4-d1c9e33b871a None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:59.494398 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6dab3-2a5f-4bfb-8bc4-d1c9e33b871a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:59.497719 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bef668-c5aa-48d3-93d3-86e9f94fe74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:59.498479 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bef668-c5aa-48d3-93d3-86e9f94fe74d None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:59.498780 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bef668-c5aa-48d3-93d3-86e9f94fe74d None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:59.499215 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bef668-c5aa-48d3-93d3-86e9f94fe74d None admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:59.500511 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bef668-c5aa-48d3-93d3-86e9f94fe74d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:59.500906 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bef668-c5aa-48d3-93d3-86e9f94fe74d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:59.502937 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bef668-c5aa-48d3-93d3-86e9f94fe74d None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:59.524403 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-d6b6dab3-2a5f-4bfb-8bc4-d1c9e33b871a None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:59.526998 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-d6b6dab3-2a5f-4bfb-8bc4-d1c9e33b871a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:59.656812 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 414/828] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:13:59.689317 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 415/829] 10.222.0.77 () {56 vars in 1135 bytes} [Tue Aug 23 22:13:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:59.695065 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6dab3-2a5f-4bfb-8bc4-d1c9e33b871a None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:59.726442 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:59.844982 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6dab3-2a5f-4bfb-8bc4-d1c9e33b871a None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:59.885823 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae8c1c-f6b3-4dca-92b2-7ca12f0d36b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:59.887000 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae8c1c-f6b3-4dca-92b2-7ca12f0d36b2 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:59.887572 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae8c1c-f6b3-4dca-92b2-7ca12f0d36b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:59.888046 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae8c1c-f6b3-4dca-92b2-7ca12f0d36b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:59.900074 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae8c1c-f6b3-4dca-92b2-7ca12f0d36b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:59.902951 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae8c1c-f6b3-4dca-92b2-7ca12f0d36b2 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:59.921840 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-fdae8c1c-f6b3-4dca-92b2-7ca12f0d36b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:59.921840 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:59.921840 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:59.921840 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:59.921840 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:59.921840 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:59.921840 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:59.921840 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:59.921840 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:59.921840 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:59.921840 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:59.921840 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:59.921840 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:59.921840 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:59.921840 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:59.921840 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:59.923009 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:59.923009 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:59.923009 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:59.923009 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:59.923009 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:59.923009 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:59.923009 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:59.923009 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:59.923009 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:59.923009 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:59.923009 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:59.923009 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:59.923009 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:59.923009 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:59.923009 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:59.923009 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:59.923009 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:59.923922 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:59.923922 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:59.923922 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:13:59.926245 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 415/830] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:59.937394 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bef668-c5aa-48d3-93d3-86e9f94fe74d None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:59.958398 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:00.028165 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae8c1c-f6b3-4dca-92b2-7ca12f0d36b2 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:00.066840 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bef668-c5aa-48d3-93d3-86e9f94fe74d None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:00.139811 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a617ac9-eace-41bd-add3-cf95a4355f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:00.140890 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a617ac9-eace-41bd-add3-cf95a4355f56 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:00.141787 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:00.142098 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a617ac9-eace-41bd-add3-cf95a4355f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:00.142621 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a617ac9-eace-41bd-add3-cf95a4355f56 None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:00.143858 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a617ac9-eace-41bd-add3-cf95a4355f56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:00.144652 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a617ac9-eace-41bd-add3-cf95a4355f56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:00.146535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a617ac9-eace-41bd-add3-cf95a4355f56 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:00.163433 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 416/831] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:00.174800 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a617ac9-eace-41bd-add3-cf95a4355f56 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:00.181114 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae8c1c-f6b3-4dca-92b2-7ca12f0d36b2 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:00.234660 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57778d79-08d7-47a8-8151-acb72b09999b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:00.235431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57778d79-08d7-47a8-8151-acb72b09999b None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:00.235853 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57778d79-08d7-47a8-8151-acb72b09999b None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:00.236311 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57778d79-08d7-47a8-8151-acb72b09999b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:00.254851 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57778d79-08d7-47a8-8151-acb72b09999b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:14:00.261705 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-57778d79-08d7-47a8-8151-acb72b09999b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:14:00.261705 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:00.261705 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:00.261705 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:00.261705 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:00.261705 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:00.261705 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:00.261705 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:00.261705 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:00.261705 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:00.261705 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:00.261705 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:00.261705 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:14:00.261705 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:14:00.261705 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:14:00.261705 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:14:00.262739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:14:00.262739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:14:00.262739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:14:00.262739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:14:00.262739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:00.262739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:00.262739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:00.262739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:00.262739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:00.262739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:00.262739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:00.262739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:00.262739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:00.262739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:00.262739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:00.262739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:00.263581 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:00.263581 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:00.263581 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:00.263581 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:00.263581 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:14:00.263581 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:14:00.263581 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:14:00.263581 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:14:00.263581 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:14:00.263581 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:14:00.263581 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:14:00.263581 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:00.263581 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 416/832] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Aug 23 22:14:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:00.272408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57778d79-08d7-47a8-8151-acb72b09999b None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:00.284245 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:00.310559 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a617ac9-eace-41bd-add3-cf95a4355f56 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:00.362180 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f15f3c-7431-49ec-ab93-108bef735fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:00.362834 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f15f3c-7431-49ec-ab93-108bef735fcf None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:00.363116 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f15f3c-7431-49ec-ab93-108bef735fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:00.363390 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f15f3c-7431-49ec-ab93-108bef735fcf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:00.373768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f15f3c-7431-49ec-ab93-108bef735fcf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:00.375983 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f15f3c-7431-49ec-ab93-108bef735fcf None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:00.393224 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-30f15f3c-7431-49ec-ab93-108bef735fcf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:14:00.393224 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:00.393224 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:00.393224 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:00.393224 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:00.393224 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:00.393224 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:00.393224 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:00.393224 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:00.393224 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:00.393224 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:00.393224 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:00.393224 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:14:00.393224 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:14:00.393224 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:14:00.394247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:14:00.394247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:00.394247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:00.394247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:00.394247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:00.394247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:00.394247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:00.394247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:00.394247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:00.394247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:00.394247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:00.394247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:00.394247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:00.394247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:00.394247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:00.394247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:00.394247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:00.395157 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:14:00.395157 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:14:00.395157 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:14:00.395157 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:14:00.395157 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:14:00.395157 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:14:00.395157 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:14:00.395157 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:00.395157 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 417/833] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:14:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:00.401716 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f15f3c-7431-49ec-ab93-108bef735fcf None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:00.442682 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57778d79-08d7-47a8-8151-acb72b09999b None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:00.502065 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b73389-0970-41d9-9a6a-219d4d26037e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:00.502700 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b73389-0970-41d9-9a6a-219d4d26037e None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:00.502979 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b73389-0970-41d9-9a6a-219d4d26037e None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:00.503263 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b73389-0970-41d9-9a6a-219d4d26037e None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:00.503932 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b73389-0970-41d9-9a6a-219d4d26037e None admin] RBAC: Adding query filter params (name=service) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:00.504239 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b73389-0970-41d9-9a6a-219d4d26037e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:00.505740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b73389-0970-41d9-9a6a-219d4d26037e None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:00.507434 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:00.529629 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 417/834] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Aug 23 22:14:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:00.533427 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b73389-0970-41d9-9a6a-219d4d26037e None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:00.545401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f15f3c-7431-49ec-ab93-108bef735fcf None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:00.588821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5463d-3019-4e83-91ef-60a331d840a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:00.589610 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5463d-3019-4e83-91ef-60a331d840a3 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:00.589887 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5463d-3019-4e83-91ef-60a331d840a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:00.590088 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5463d-3019-4e83-91ef-60a331d840a3 None admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:00.590717 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5463d-3019-4e83-91ef-60a331d840a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:00.591029 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5463d-3019-4e83-91ef-60a331d840a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:00.592550 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5463d-3019-4e83-91ef-60a331d840a3 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:00.602883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:00.614175 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 418/835] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:14:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:00.615653 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5463d-3019-4e83-91ef-60a331d840a3 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:00.695438 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b73389-0970-41d9-9a6a-219d4d26037e None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:00.741821 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5ca9f-c0fc-4056-8338-af71e9318197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:00.742880 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5ca9f-c0fc-4056-8338-af71e9318197 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:00.743367 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5ca9f-c0fc-4056-8338-af71e9318197 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:00.743843 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5ca9f-c0fc-4056-8338-af71e9318197 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:00.746034 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5463d-3019-4e83-91ef-60a331d840a3 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:00.758360 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f5ca9f-c0fc-4056-8338-af71e9318197 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:00.760858 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f5ca9f-c0fc-4056-8338-af71e9318197 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:00.787484 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-18f5ca9f-c0fc-4056-8338-af71e9318197 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:14:00.787484 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:00.787484 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:00.787484 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:00.787484 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:00.787484 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:00.787484 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:00.787484 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:00.787484 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:00.787484 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:00.787484 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:00.787484 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:00.787484 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:14:00.787484 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:14:00.787484 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:14:00.787484 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:14:00.788500 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:00.788500 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:00.788500 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:00.788500 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:00.788500 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:00.788500 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:00.788500 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:00.788500 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:00.788500 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:00.788500 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:00.788500 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:00.788500 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:00.788500 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:00.788500 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:00.788500 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:00.788500 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:00.788500 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:14:00.789453 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:14:00.789453 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:14:00.789453 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:00.789624 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d6322-4382-4815-8091-47f8ae8f4c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:00.789624 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d6322-4382-4815-8091-47f8ae8f4c72 None admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:00.791150 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d6322-4382-4815-8091-47f8ae8f4c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:00.792313 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d6322-4382-4815-8091-47f8ae8f4c72 None admin] PATH_INFO: `/v3/projects/da9a86463d68412884746b115667d2fc/users/abda1f23a18c4c808483cd6b53952975/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:00.797557 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d6322-4382-4815-8091-47f8ae8f4c72 None admin] RBAC: Authorizing `identity:create_grant(project_id=da9a86463d68412884746b115667d2fc, user_id=abda1f23a18c4c808483cd6b53952975, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:00.797557 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d6322-4382-4815-8091-47f8ae8f4c72 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:00.798397 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 418/836] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:14:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:14:00.802019 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5ca9f-c0fc-4056-8338-af71e9318197 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:00.821402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 419/837] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Aug 23 22:14:00 2022] PUT /identity/v3/projects/da9a86463d68412884746b115667d2fc/users/abda1f23a18c4c808483cd6b53952975/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:14:00.885854 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:00.935282 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5ca9f-c0fc-4056-8338-af71e9318197 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:00.976544 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c095b0-fab2-4bb2-b85e-b536ad5dd000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:00.977168 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c095b0-fab2-4bb2-b85e-b536ad5dd000 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:00.977483 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c095b0-fab2-4bb2-b85e-b536ad5dd000 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:00.977808 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c095b0-fab2-4bb2-b85e-b536ad5dd000 None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:00.978555 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c095b0-fab2-4bb2-b85e-b536ad5dd000 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:00.979446 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c095b0-fab2-4bb2-b85e-b536ad5dd000 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:00.981598 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c095b0-fab2-4bb2-b85e-b536ad5dd000 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:00.995865 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 419/838] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:01.002484 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d6322-4382-4815-8091-47f8ae8f4c72 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:01.087104 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:01.136110 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d6322-4382-4815-8091-47f8ae8f4c72 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:01.173652 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4deda60-554f-4924-b2a9-afc6f59e7e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:01.174287 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4deda60-554f-4924-b2a9-afc6f59e7e87 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:01.174562 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4deda60-554f-4924-b2a9-afc6f59e7e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:01.174827 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4deda60-554f-4924-b2a9-afc6f59e7e87 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:01.183123 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4deda60-554f-4924-b2a9-afc6f59e7e87 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:01.184737 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4deda60-554f-4924-b2a9-afc6f59e7e87 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:01.197182 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-a4deda60-554f-4924-b2a9-afc6f59e7e87 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 22:14:01.197182 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:01.197182 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:01.197182 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:01.197182 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:01.197182 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:01.197182 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:01.197182 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:01.197182 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:01.197182 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:01.197182 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:01.197182 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:01.197182 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:14:01.197182 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:14:01.197182 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:14:01.197182 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:14:01.198901 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:01.198901 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:01.198901 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:14:01.198901 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:14:01.198901 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:14:01.198901 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:14:01.198901 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:01.198901 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:01.198901 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:01.198901 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:01.198901 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:01.198901 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:01.198901 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:01.198901 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:01.198901 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:01.198901 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:01.198901 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:01.198901 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:01.199976 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:01.199976 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:01.199976 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:14:01.199976 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:14:01.199976 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:14:01.199976 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:14:01.199976 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:14:01.199976 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:14:01.199976 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 22:14:01.199976 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:01.199976 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 420/839] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Aug 23 22:14:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:01.209839 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c095b0-fab2-4bb2-b85e-b536ad5dd000 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:01.373314 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c095b0-fab2-4bb2-b85e-b536ad5dd000 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:01.389665 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:01.424121 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec90f71-f6ea-4b0b-a618-38efd3e142e4 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:01.424505 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec90f71-f6ea-4b0b-a618-38efd3e142e4 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:01.424727 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec90f71-f6ea-4b0b-a618-38efd3e142e4 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:01.431441 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 421/840] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:01.433729 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97597414-4b51-44d5-b29f-4f13e5abaf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:01.434429 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c13620-dd5c-4eda-b8a7-1883d7a2448c None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:01.434710 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97597414-4b51-44d5-b29f-4f13e5abaf6f None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:01.434990 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c13620-dd5c-4eda-b8a7-1883d7a2448c None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:01.434990 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c13620-dd5c-4eda-b8a7-1883d7a2448c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:01.435507 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97597414-4b51-44d5-b29f-4f13e5abaf6f None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:01.435751 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97597414-4b51-44d5-b29f-4f13e5abaf6f None admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:01.437444 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97597414-4b51-44d5-b29f-4f13e5abaf6f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:01.438016 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97597414-4b51-44d5-b29f-4f13e5abaf6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:01.440758 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97597414-4b51-44d5-b29f-4f13e5abaf6f None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:01.462701 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-47c13620-dd5c-4eda-b8a7-1883d7a2448c None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:01.464131 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-47c13620-dd5c-4eda-b8a7-1883d7a2448c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:01.477040 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 420/841] 10.222.0.77 () {56 vars in 1149 bytes} [Tue Aug 23 22:14:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:01.485160 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97597414-4b51-44d5-b29f-4f13e5abaf6f None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:01.564183 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 422/842] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:14:01.691591 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97597414-4b51-44d5-b29f-4f13e5abaf6f None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:01.762243 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97075798-b85f-40a8-b630-ab781cf8b1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:01.763265 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97075798-b85f-40a8-b630-ab781cf8b1e1 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:01.763817 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97075798-b85f-40a8-b630-ab781cf8b1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:01.764360 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97075798-b85f-40a8-b630-ab781cf8b1e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:01.833004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:01.883892 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90f762-03ba-4829-bfdd-87fb8d35171f None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:01.884547 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90f762-03ba-4829-bfdd-87fb8d35171f None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:01.885060 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90f762-03ba-4829-bfdd-87fb8d35171f None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:01.887770 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 423/843] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:14:01.893884 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a01ca-00f2-46e2-8175-0726b1204ad4 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:01.894491 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a01ca-00f2-46e2-8175-0726b1204ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:01.894976 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a01ca-00f2-46e2-8175-0726b1204ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:01.902605 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97075798-b85f-40a8-b630-ab781cf8b1e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:01.907109 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97075798-b85f-40a8-b630-ab781cf8b1e1 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:01.922937 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-2e5a01ca-00f2-46e2-8175-0726b1204ad4 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:01.925883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-2e5a01ca-00f2-46e2-8175-0726b1204ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:02.032965 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:02.042646 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 421/844] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:14:01 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:14:02.050837 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97075798-b85f-40a8-b630-ab781cf8b1e1 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:02.083391 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 424/845] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:14:02.084203 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a01ca-00f2-46e2-8175-0726b1204ad4 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:02.150419 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:02.199714 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97075798-b85f-40a8-b630-ab781cf8b1e1 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:02.257235 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18d39e-7052-4118-8111-1cc1336b7f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:02.258330 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18d39e-7052-4118-8111-1cc1336b7f9c None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:02.258877 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18d39e-7052-4118-8111-1cc1336b7f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:02.259377 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18d39e-7052-4118-8111-1cc1336b7f9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:02.259809 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a01ca-00f2-46e2-8175-0726b1204ad4 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:02.277439 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18d39e-7052-4118-8111-1cc1336b7f9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:02.278613 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18d39e-7052-4118-8111-1cc1336b7f9c None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:02.305724 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-0e18d39e-7052-4118-8111-1cc1336b7f9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:14:02.305724 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:02.305724 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:02.305724 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:02.305724 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:02.305724 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:02.305724 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:02.305724 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:02.305724 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:02.305724 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:02.305724 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:02.305724 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:02.305724 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:14:02.305724 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:14:02.305724 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:14:02.305724 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:14:02.306698 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:02.306698 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:02.306698 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:02.306698 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:02.306698 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:02.306698 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:02.306698 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:02.306698 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:02.306698 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:02.306698 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:02.306698 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:02.306698 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:02.306698 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:02.306698 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:02.306698 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:02.306698 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:02.306698 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:14:02.309081 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:14:02.309081 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:14:02.309081 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:02.313232 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 422/846] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:14:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:02.315487 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18d39e-7052-4118-8111-1cc1336b7f9c None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:02.323860 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4195fe4-0789-4b62-8729-78f88bb4ab9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:02.325091 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4195fe4-0789-4b62-8729-78f88bb4ab9b None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:02.325913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4195fe4-0789-4b62-8729-78f88bb4ab9b None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:02.326508 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4195fe4-0789-4b62-8729-78f88bb4ab9b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:02.327723 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4195fe4-0789-4b62-8729-78f88bb4ab9b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:02.329997 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4195fe4-0789-4b62-8729-78f88bb4ab9b None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:02.345623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-f4195fe4-0789-4b62-8729-78f88bb4ab9b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:14:02.345623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:02.345623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:14:02.345623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:14:02.345623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:14:02.345623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:14:02.345623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:14:02.345623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:14:02.345623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:14:02.345623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:02.345623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:14:02.345623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:02.345623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:02.345623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:02.345623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:02.345623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:02.347478 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:02.347478 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:02.347478 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:02.347478 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:02.347478 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:02.347478 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:02.347478 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:02.347478 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:14:02.347478 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:14:02.347478 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:14:02.347478 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:14:02.347478 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:02.347478 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:02.347478 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:02.347478 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:02.347478 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:02.347478 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:02.349180 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:02.349180 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:02.349180 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:02.349180 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:02.349180 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:02.349180 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:02.349180 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:02.349180 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:02.349180 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:02.349180 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:02.349180 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:14:02.349180 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:14:02.349180 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:14:02.349180 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:02.355551 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 425/847] 10.222.0.77 () {56 vars in 1132 bytes} [Tue Aug 23 22:14:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:02.362633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4195fe4-0789-4b62-8729-78f88bb4ab9b None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:02.424865 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:02.472994 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18d39e-7052-4118-8111-1cc1336b7f9c None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:02.500767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:02.527714 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a82e2-0f21-41fd-b821-351d765646a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:02.528162 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4195fe4-0789-4b62-8729-78f88bb4ab9b None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:02.528641 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a82e2-0f21-41fd-b821-351d765646a3 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:02.529051 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a82e2-0f21-41fd-b821-351d765646a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:02.529510 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a82e2-0f21-41fd-b821-351d765646a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:02.530342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a82e2-0f21-41fd-b821-351d765646a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:02.530863 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a82e2-0f21-41fd-b821-351d765646a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:02.532636 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a82e2-0f21-41fd-b821-351d765646a3 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:02.548719 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 423/848] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:14:02.548719 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a82e2-0f21-41fd-b821-351d765646a3 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:02.588356 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d16962-cf96-4c0b-9fab-dbf72adcca96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:02.589702 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d16962-cf96-4c0b-9fab-dbf72adcca96 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:02.590036 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d16962-cf96-4c0b-9fab-dbf72adcca96 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:02.590382 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d16962-cf96-4c0b-9fab-dbf72adcca96 None admin] PATH_INFO: `/v3/services` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:02.591127 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d16962-cf96-4c0b-9fab-dbf72adcca96 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:02.591537 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d16962-cf96-4c0b-9fab-dbf72adcca96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:02.593546 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d16962-cf96-4c0b-9fab-dbf72adcca96 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:02.605685 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 426/849] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Aug 23 22:14:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:14:02.607290 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d16962-cf96-4c0b-9fab-dbf72adcca96 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:02.719816 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a82e2-0f21-41fd-b821-351d765646a3 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:02.773936 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d16962-cf96-4c0b-9fab-dbf72adcca96 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:02.774980 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188b983-8076-4695-b807-39b307357a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:02.777409 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188b983-8076-4695-b807-39b307357a07 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:02.777739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188b983-8076-4695-b807-39b307357a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:02.778091 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188b983-8076-4695-b807-39b307357a07 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:02.778700 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188b983-8076-4695-b807-39b307357a07 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:02.780148 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188b983-8076-4695-b807-39b307357a07 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:02.782319 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:02.794744 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-e188b983-8076-4695-b807-39b307357a07 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:14:02.794744 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:02.794744 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:14:02.794744 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:14:02.794744 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:14:02.794744 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:14:02.794744 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:14:02.794744 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:14:02.794744 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:14:02.794744 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:02.794744 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:14:02.794744 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:02.794744 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:02.794744 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:02.794744 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:02.794744 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:02.794744 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:02.796489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:02.796489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:02.796489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:02.796489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:02.796489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:02.796489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:02.796489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:14:02.796489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:14:02.796489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:14:02.796489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:14:02.796489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:02.796489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:02.796489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:02.796489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:02.796489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:02.796489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:02.799134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:02.799134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:02.799134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:02.799134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:02.799134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:02.799134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:02.799134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:02.799134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:02.799134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:02.799134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:02.799134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:14:02.799134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:14:02.799134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:14:02.799134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:02.799134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 424/850] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Aug 23 22:14:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:02.800709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188b983-8076-4695-b807-39b307357a07 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:02.830459 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d745ef9-5f4d-4d5c-883e-a35623016452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:02.831509 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d745ef9-5f4d-4d5c-883e-a35623016452 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:02.832153 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d745ef9-5f4d-4d5c-883e-a35623016452 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:02.832601 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d745ef9-5f4d-4d5c-883e-a35623016452 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:02.845343 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d745ef9-5f4d-4d5c-883e-a35623016452 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:02.846767 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d745ef9-5f4d-4d5c-883e-a35623016452 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:02.870638 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-8d745ef9-5f4d-4d5c-883e-a35623016452 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:14:02.870638 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:02.870638 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:02.870638 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:02.870638 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:02.870638 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:02.870638 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:02.870638 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:02.870638 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:02.870638 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:02.870638 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:02.870638 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:02.870638 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:14:02.870638 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:14:02.870638 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:14:02.871614 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:14:02.871614 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:02.871614 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:02.871614 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:02.871614 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:02.871614 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:02.871614 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:02.871614 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:02.871614 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:02.871614 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:02.871614 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:02.871614 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:02.871614 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:02.871614 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:02.871614 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:02.871614 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:02.871614 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:02.872519 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:14:02.872519 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:14:02.872519 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:14:02.872519 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:14:02.872519 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:14:02.872519 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:14:02.872519 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:14:02.872519 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:02.878619 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 427/851] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:14:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:02.878619 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d745ef9-5f4d-4d5c-883e-a35623016452 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:02.879202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:02.953464 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188b983-8076-4695-b807-39b307357a07 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:03.002375 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a9cc0-fc98-4082-9a71-a22a3c4c1144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:03.003746 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a9cc0-fc98-4082-9a71-a22a3c4c1144 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:03.004090 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a9cc0-fc98-4082-9a71-a22a3c4c1144 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:03.004484 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a9cc0-fc98-4082-9a71-a22a3c4c1144 None admin] PATH_INFO: `/v3/services` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:03.005337 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a9cc0-fc98-4082-9a71-a22a3c4c1144 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:03.006117 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a9cc0-fc98-4082-9a71-a22a3c4c1144 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:03.007935 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a9cc0-fc98-4082-9a71-a22a3c4c1144 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:03.021438 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 425/852] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Aug 23 22:14:02 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:03.021438 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a9cc0-fc98-4082-9a71-a22a3c4c1144 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:03.059465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d745ef9-5f4d-4d5c-883e-a35623016452 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:03.126215 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b46ac-d2de-40f4-b8f4-0ab182e7937a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:03.127150 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b46ac-d2de-40f4-b8f4-0ab182e7937a None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:03.127776 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b46ac-d2de-40f4-b8f4-0ab182e7937a None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:03.128282 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b46ac-d2de-40f4-b8f4-0ab182e7937a None admin] PATH_INFO: `/v3/services` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:03.129436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b46ac-d2de-40f4-b8f4-0ab182e7937a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:03.129958 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b46ac-d2de-40f4-b8f4-0ab182e7937a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:03.132885 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b46ac-d2de-40f4-b8f4-0ab182e7937a None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:03.144014 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 428/853] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Aug 23 22:14:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:03.151686 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b46ac-d2de-40f4-b8f4-0ab182e7937a None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:03.188975 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a9cc0-fc98-4082-9a71-a22a3c4c1144 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:03.195350 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:03.198986 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:03.235983 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24700a75-3c51-4bed-8d23-a188a8acee77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:03.236306 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24700a75-3c51-4bed-8d23-a188a8acee77 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:03.236463 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24700a75-3c51-4bed-8d23-a188a8acee77 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:03.236775 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24700a75-3c51-4bed-8d23-a188a8acee77 None admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:03.238334 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24700a75-3c51-4bed-8d23-a188a8acee77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:03.238515 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24700a75-3c51-4bed-8d23-a188a8acee77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:03.240240 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24700a75-3c51-4bed-8d23-a188a8acee77 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:03.261469 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 426/854] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:14:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:03.262781 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d2e7f-307c-4da3-877d-b7a1b49dfd50 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:03.263067 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d2e7f-307c-4da3-877d-b7a1b49dfd50 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:03.263341 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d2e7f-307c-4da3-877d-b7a1b49dfd50 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:03.265404 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 427/855] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:03.268175 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d2e7f-307c-4da3-877d-b7a1b49dfd50 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:03.293713 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b46ac-d2de-40f4-b8f4-0ab182e7937a None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:03.341539 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23907dab-d4a8-4b74-82aa-38458e944ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:03.342500 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23907dab-d4a8-4b74-82aa-38458e944ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:03.342651 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23907dab-d4a8-4b74-82aa-38458e944ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:03.342883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23907dab-d4a8-4b74-82aa-38458e944ee7 None admin] PATH_INFO: `/v3/services` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:03.343565 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23907dab-d4a8-4b74-82aa-38458e944ee7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:03.343858 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23907dab-d4a8-4b74-82aa-38458e944ee7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:03.345266 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23907dab-d4a8-4b74-82aa-38458e944ee7 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:03.350539 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 429/856] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Aug 23 22:14:03 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:03.351774 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db047c-2490-4902-8e4d-8078d8c3a2f0 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:03.352063 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db047c-2490-4902-8e4d-8078d8c3a2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:03.352323 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db047c-2490-4902-8e4d-8078d8c3a2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:03.379087 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-26db047c-2490-4902-8e4d-8078d8c3a2f0 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:03.383295 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-26db047c-2490-4902-8e4d-8078d8c3a2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:03.421985 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d2e7f-307c-4da3-877d-b7a1b49dfd50 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:03.477910 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652d2e6-c83b-489d-aeb0-97848272e199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:03.479403 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652d2e6-c83b-489d-aeb0-97848272e199 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:03.479950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652d2e6-c83b-489d-aeb0-97848272e199 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:03.480369 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652d2e6-c83b-489d-aeb0-97848272e199 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:03.481525 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7652d2e6-c83b-489d-aeb0-97848272e199 None admin] RBAC: Adding query filter params (role.id=fb1c5c0f0edb47bf828f63bc685f98ba, scope.project.id=da9a86463d68412884746b115667d2fc, user.id=02e415eb75984daa97ee79fc0146f318) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:03.481995 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7652d2e6-c83b-489d-aeb0-97848272e199 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:03.483789 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7652d2e6-c83b-489d-aeb0-97848272e199 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:03.489936 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 430/857] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:14:03.492853 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 428/858] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:14:03 2022] GET /identity/v3/role_assignments?user.id=02e415eb75984daa97ee79fc0146f318&scope.project.id=da9a86463d68412884746b115667d2fc&role.id=fb1c5c0f0edb47bf828f63bc685f98ba => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:14:03.840493 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db047c-2490-4902-8e4d-8078d8c3a2f0 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:03.870016 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:04.010823 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db047c-2490-4902-8e4d-8078d8c3a2f0 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:04.074903 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36337d12-d474-4180-b816-1a22e00c5dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:04.075959 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36337d12-d474-4180-b816-1a22e00c5dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:04.076456 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36337d12-d474-4180-b816-1a22e00c5dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:04.076918 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36337d12-d474-4180-b816-1a22e00c5dd1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:04.097345 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36337d12-d474-4180-b816-1a22e00c5dd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:14:04.107623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-36337d12-d474-4180-b816-1a22e00c5dd1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:14:04.107623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:04.107623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:04.107623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:04.107623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:04.107623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:04.107623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:04.107623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:04.107623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:04.107623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:04.107623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:04.107623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:04.107623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:14:04.107623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:14:04.107623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:14:04.107623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:14:04.108808 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:14:04.108808 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:14:04.108808 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:14:04.108808 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:14:04.108808 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:04.108808 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:04.108808 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:04.108808 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:04.108808 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:04.108808 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:04.108808 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:04.108808 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:04.108808 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:04.108808 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:04.108808 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:04.108808 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:04.110849 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:04.110849 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:04.110849 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:04.110849 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:04.110849 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:14:04.110849 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:14:04.110849 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:14:04.110849 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:14:04.110849 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:14:04.110849 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:14:04.110849 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:14:04.110849 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:04.110849 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 431/859] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:14:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:04.115585 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652d2e6-c83b-489d-aeb0-97848272e199 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:04.163400 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:04.249760 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652d2e6-c83b-489d-aeb0-97848272e199 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:04.289054 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54337a8c-b6d3-48e1-b8bd-90175f284986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:04.289618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54337a8c-b6d3-48e1-b8bd-90175f284986 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:04.289896 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54337a8c-b6d3-48e1-b8bd-90175f284986 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:04.290270 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54337a8c-b6d3-48e1-b8bd-90175f284986 None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:04.290999 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54337a8c-b6d3-48e1-b8bd-90175f284986 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:04.291962 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54337a8c-b6d3-48e1-b8bd-90175f284986 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:04.293351 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54337a8c-b6d3-48e1-b8bd-90175f284986 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:04.304032 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 429/860] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:14:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:04.310174 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36337d12-d474-4180-b816-1a22e00c5dd1 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:04.425571 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:04.444883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36337d12-d474-4180-b816-1a22e00c5dd1 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:04.483493 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea1659-32a7-44b3-8164-d0650b9e0bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:04.484153 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea1659-32a7-44b3-8164-d0650b9e0bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:04.484435 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea1659-32a7-44b3-8164-d0650b9e0bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:04.484713 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea1659-32a7-44b3-8164-d0650b9e0bd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:04.496417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea1659-32a7-44b3-8164-d0650b9e0bd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:04.497938 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea1659-32a7-44b3-8164-d0650b9e0bd7 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:04.514061 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-d7ea1659-32a7-44b3-8164-d0650b9e0bd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:14:04.514061 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:04.514061 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:04.514061 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:04.514061 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:04.514061 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:04.514061 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:04.514061 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:04.514061 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:04.514061 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:04.514061 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:04.514061 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:04.514061 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:14:04.514061 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:14:04.514061 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:14:04.514061 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:14:04.516362 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:04.516362 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:04.516362 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:04.516362 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:04.516362 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:04.516362 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:04.516362 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:04.516362 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:04.516362 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:04.516362 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:04.516362 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:04.516362 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:04.516362 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:04.516362 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:04.516362 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:04.516362 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:04.516362 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:14:04.518596 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:14:04.518596 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:14:04.518596 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:04.518596 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 432/861] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:14:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:04.524555 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54337a8c-b6d3-48e1-b8bd-90175f284986 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:04.638204 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:04.649567 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54337a8c-b6d3-48e1-b8bd-90175f284986 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:04.694624 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed273ba1-4fec-40e0-94fc-71410663baa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:04.695360 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed273ba1-4fec-40e0-94fc-71410663baa9 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:04.695650 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed273ba1-4fec-40e0-94fc-71410663baa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:04.695991 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed273ba1-4fec-40e0-94fc-71410663baa9 None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:04.696935 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed273ba1-4fec-40e0-94fc-71410663baa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:04.697247 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed273ba1-4fec-40e0-94fc-71410663baa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:04.699601 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed273ba1-4fec-40e0-94fc-71410663baa9 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:04.716027 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 430/862] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:04.722687 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea1659-32a7-44b3-8164-d0650b9e0bd7 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:04.852341 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea1659-32a7-44b3-8164-d0650b9e0bd7 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:04.893177 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed61d7-8539-455a-b5ca-e84bb3b4551a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:04.893769 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed61d7-8539-455a-b5ca-e84bb3b4551a None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:04.894196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed61d7-8539-455a-b5ca-e84bb3b4551a None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:04.894472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed61d7-8539-455a-b5ca-e84bb3b4551a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:04.897721 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:04.905257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed61d7-8539-455a-b5ca-e84bb3b4551a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:04.906773 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed61d7-8539-455a-b5ca-e84bb3b4551a None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:04.920758 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-baed61d7-8539-455a-b5ca-e84bb3b4551a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 22:14:04.920758 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:04.920758 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:04.920758 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:04.920758 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:04.920758 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:04.920758 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:04.920758 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:04.920758 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:04.920758 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:04.920758 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:04.920758 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:04.920758 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:14:04.920758 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:14:04.920758 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:14:04.920758 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:14:04.923154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:04.923154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:04.923154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:14:04.923154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:14:04.923154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:14:04.923154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:14:04.923154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:04.923154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:04.923154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:04.923154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:04.923154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:04.923154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:04.923154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:04.923154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:04.923154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:04.923154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:04.923154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:04.923154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:04.925357 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:04.925357 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:04.925357 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:14:04.925357 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:14:04.925357 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:14:04.925357 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:14:04.925357 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:14:04.925357 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:14:04.925357 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 22:14:04.925357 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:04.925357 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 433/863] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:14:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:04.929394 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed273ba1-4fec-40e0-94fc-71410663baa9 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:05.054371 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed273ba1-4fec-40e0-94fc-71410663baa9 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:05.096520 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cebeac-4e0b-4e09-b207-e607768f9a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:05.097151 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cebeac-4e0b-4e09-b207-e607768f9a93 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:05.097459 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cebeac-4e0b-4e09-b207-e607768f9a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:05.097733 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cebeac-4e0b-4e09-b207-e607768f9a93 None admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:05.098596 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cebeac-4e0b-4e09-b207-e607768f9a93 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:05.098903 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cebeac-4e0b-4e09-b207-e607768f9a93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:05.100470 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cebeac-4e0b-4e09-b207-e607768f9a93 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:05.121508 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 431/864] 10.222.0.77 () {56 vars in 1135 bytes} [Tue Aug 23 22:14:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:05.127024 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed61d7-8539-455a-b5ca-e84bb3b4551a None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:05.250339 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed61d7-8539-455a-b5ca-e84bb3b4551a None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:05.267408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ef7e1-1588-451f-b65a-4ec5cd7633b4 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:05.267733 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ef7e1-1588-451f-b65a-4ec5cd7633b4 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:05.268053 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ef7e1-1588-451f-b65a-4ec5cd7633b4 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:05.274510 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 432/865] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:14:05.276659 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab39c13-d076-45d7-87f4-28d3a0328985 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:05.277191 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab39c13-d076-45d7-87f4-28d3a0328985 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:05.277717 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab39c13-d076-45d7-87f4-28d3a0328985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:05.293916 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169ed8b-9143-4efe-815f-f1f7473dd6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:05.294605 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169ed8b-9143-4efe-815f-f1f7473dd6f9 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:05.294886 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169ed8b-9143-4efe-815f-f1f7473dd6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:05.295158 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169ed8b-9143-4efe-815f-f1f7473dd6f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:05.298252 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-8ab39c13-d076-45d7-87f4-28d3a0328985 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:05.299699 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-8ab39c13-d076-45d7-87f4-28d3a0328985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:05.308976 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:05.373939 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:05.382101 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169ed8b-9143-4efe-815f-f1f7473dd6f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:05.389395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169ed8b-9143-4efe-815f-f1f7473dd6f9 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:05.390089 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 433/866] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:14:05.496605 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 434/867] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:14:05 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:14:05.502277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab39c13-d076-45d7-87f4-28d3a0328985 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:05.618615 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab39c13-d076-45d7-87f4-28d3a0328985 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:05.663676 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f4420-3db9-4073-a0ff-9fa722897032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:05.664846 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f4420-3db9-4073-a0ff-9fa722897032 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:05.665333 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f4420-3db9-4073-a0ff-9fa722897032 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:05.665885 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f4420-3db9-4073-a0ff-9fa722897032 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:05.676413 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:05.679485 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f4420-3db9-4073-a0ff-9fa722897032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:05.681317 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f4420-3db9-4073-a0ff-9fa722897032 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:05.684447 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169ed8b-9143-4efe-815f-f1f7473dd6f9 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:05.703125 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-c19f4420-3db9-4073-a0ff-9fa722897032 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:14:05.703125 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:05.703125 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:05.703125 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:05.703125 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:05.703125 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:05.703125 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:05.703125 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:05.703125 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:05.703125 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:05.703125 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:05.703125 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:05.703125 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:14:05.703125 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:14:05.703125 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:14:05.703125 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:14:05.704327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:05.704327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:05.704327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:05.704327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:05.704327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:05.704327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:05.704327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:05.704327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:05.704327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:05.704327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:05.704327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:05.704327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:05.704327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:05.704327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:05.704327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:05.704327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:05.704327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:14:05.705250 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:14:05.705250 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:14:05.705250 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:05.705250 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 434/868] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:05.711684 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f4420-3db9-4073-a0ff-9fa722897032 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:05.861589 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f4420-3db9-4073-a0ff-9fa722897032 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:05.862736 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:05.872504 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169ed8b-9143-4efe-815f-f1f7473dd6f9 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:05.903925 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b3746-1633-4624-ac6e-4af4e07eaad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:05.904573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b3746-1633-4624-ac6e-4af4e07eaad3 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:05.904855 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b3746-1633-4624-ac6e-4af4e07eaad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:05.905127 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b3746-1633-4624-ac6e-4af4e07eaad3 None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:05.905795 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b3746-1633-4624-ac6e-4af4e07eaad3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:05.906097 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b3746-1633-4624-ac6e-4af4e07eaad3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:05.907477 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b3746-1633-4624-ac6e-4af4e07eaad3 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:05.915705 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc3b00-b798-4f94-966d-1bc2984a29c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:05.917186 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc3b00-b798-4f94-966d-1bc2984a29c4 None admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:05.917776 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc3b00-b798-4f94-966d-1bc2984a29c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:05.918113 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc3b00-b798-4f94-966d-1bc2984a29c4 None admin] PATH_INFO: `/v3/services` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:05.918771 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc3b00-b798-4f94-966d-1bc2984a29c4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:05.920159 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc3b00-b798-4f94-966d-1bc2984a29c4 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:05.925876 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 435/869] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:05.925876 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e924a71-23cb-4307-8f09-efdc624379cd None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:05.925876 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e924a71-23cb-4307-8f09-efdc624379cd None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:05.925876 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e924a71-23cb-4307-8f09-efdc624379cd None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:05.925876 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 436/870] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:05.931031 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e924a71-23cb-4307-8f09-efdc624379cd None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:05.949434 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 435/871] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Aug 23 22:14:05 2022] POST /identity/v3/services => generated 269 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:14:05.949434 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c3c5f-f4a2-4aea-92d0-ac331f03cfe5 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:05.949434 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c3c5f-f4a2-4aea-92d0-ac331f03cfe5 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:05.949434 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c3c5f-f4a2-4aea-92d0-ac331f03cfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:05.978471 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-1d7c3c5f-f4a2-4aea-92d0-ac331f03cfe5 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:05.980980 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-1d7c3c5f-f4a2-4aea-92d0-ac331f03cfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:06.010049 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:06.082953 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 436/872] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:05 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:14:06.084832 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49f533-9e38-4be1-bafd-5656bcfa4160 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:06.085441 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49f533-9e38-4be1-bafd-5656bcfa4160 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:06.085953 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49f533-9e38-4be1-bafd-5656bcfa4160 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:06.087605 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 437/873] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:06.094818 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaded36-1ec5-4a57-96b0-46c2055386ec None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:06.095143 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e924a71-23cb-4307-8f09-efdc624379cd None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:06.095653 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaded36-1ec5-4a57-96b0-46c2055386ec None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:06.096212 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaded36-1ec5-4a57-96b0-46c2055386ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:06.120079 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-baaded36-1ec5-4a57-96b0-46c2055386ec None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:06.120887 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-baaded36-1ec5-4a57-96b0-46c2055386ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:06.145897 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94400aa-af04-4972-837e-2a9449a54e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:06.147339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94400aa-af04-4972-837e-2a9449a54e4e None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:06.147849 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94400aa-af04-4972-837e-2a9449a54e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:06.148387 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94400aa-af04-4972-837e-2a9449a54e4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:06.158233 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94400aa-af04-4972-837e-2a9449a54e4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:06.159719 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94400aa-af04-4972-837e-2a9449a54e4e None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:06.176200 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-e94400aa-af04-4972-837e-2a9449a54e4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:14:06.176200 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:06.176200 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:06.176200 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:06.176200 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:06.176200 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:06.176200 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:06.176200 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:06.176200 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:06.176200 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:06.176200 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:06.176200 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:06.176200 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:14:06.176200 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:14:06.176200 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:14:06.177261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:14:06.177261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:06.177261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:06.177261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:06.177261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:06.177261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:06.177261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:06.177261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:06.177261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:06.177261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:06.177261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:06.177261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:06.177261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:06.177261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:06.177261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:06.177261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:06.177261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:06.179273 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:14:06.179273 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:14:06.179273 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:14:06.179273 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:14:06.179273 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:14:06.179273 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:14:06.179273 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:14:06.179273 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:06.179273 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 437/874] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:14:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:06.184349 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94400aa-af04-4972-837e-2a9449a54e4e None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:06.229559 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 438/875] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:06 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:14:06.322856 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94400aa-af04-4972-837e-2a9449a54e4e None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:06.334246 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:06.367893 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b552a6e-a09d-4360-86fc-48046bb2bceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:06.368511 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b552a6e-a09d-4360-86fc-48046bb2bceb None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:06.368792 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b552a6e-a09d-4360-86fc-48046bb2bceb None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:06.369064 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b552a6e-a09d-4360-86fc-48046bb2bceb None admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:06.370472 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b552a6e-a09d-4360-86fc-48046bb2bceb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:06.370722 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b552a6e-a09d-4360-86fc-48046bb2bceb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:06.372169 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b552a6e-a09d-4360-86fc-48046bb2bceb None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:06.386490 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 438/876] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:14:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:14:06.392422 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaded36-1ec5-4a57-96b0-46c2055386ec None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:06.392996 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b552a6e-a09d-4360-86fc-48046bb2bceb None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:06.409328 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:06.503203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b552a6e-a09d-4360-86fc-48046bb2bceb None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:06.511536 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaded36-1ec5-4a57-96b0-46c2055386ec None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:06.545927 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af73d5-c062-4d9b-a7c7-820ee2a3317c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:06.546663 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af73d5-c062-4d9b-a7c7-820ee2a3317c None admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:06.546950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af73d5-c062-4d9b-a7c7-820ee2a3317c None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:06.547222 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af73d5-c062-4d9b-a7c7-820ee2a3317c None admin] PATH_INFO: `/v3/services` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:06.547885 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0af73d5-c062-4d9b-a7c7-820ee2a3317c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:06.548331 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb914cab-ad03-4774-b8b4-37bd25d6f28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:06.548938 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb914cab-ad03-4774-b8b4-37bd25d6f28e None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:06.549214 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb914cab-ad03-4774-b8b4-37bd25d6f28e None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:06.549312 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0af73d5-c062-4d9b-a7c7-820ee2a3317c None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:06.549534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb914cab-ad03-4774-b8b4-37bd25d6f28e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:06.550236 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb914cab-ad03-4774-b8b4-37bd25d6f28e None admin] RBAC: Adding query filter params (role.id=e806ce849cf34b92979b5524f3ea9ff6, scope.project.id=da9a86463d68412884746b115667d2fc, user.id=abda1f23a18c4c808483cd6b53952975) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:06.550545 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb914cab-ad03-4774-b8b4-37bd25d6f28e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:06.551963 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb914cab-ad03-4774-b8b4-37bd25d6f28e None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:06.569639 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 439/877] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:14:06 2022] GET /identity/v3/role_assignments?user.id=abda1f23a18c4c808483cd6b53952975&scope.project.id=da9a86463d68412884746b115667d2fc&role.id=e806ce849cf34b92979b5524f3ea9ff6 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:06.569639 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb914cab-ad03-4774-b8b4-37bd25d6f28e None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:06.580634 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 439/878] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Aug 23 22:14:06 2022] POST /identity/v3/services => generated 251 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:14:06.665916 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:06.697434 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb914cab-ad03-4774-b8b4-37bd25d6f28e None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:06.770381 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26e35e-51d4-4b3b-bf4c-6eaddbe98af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:06.774319 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26e35e-51d4-4b3b-bf4c-6eaddbe98af2 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:06.774319 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26e35e-51d4-4b3b-bf4c-6eaddbe98af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:06.774319 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26e35e-51d4-4b3b-bf4c-6eaddbe98af2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:06.787592 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a26e35e-51d4-4b3b-bf4c-6eaddbe98af2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:14:06.793283 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-0a26e35e-51d4-4b3b-bf4c-6eaddbe98af2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 22:14:06.793283 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:06.793283 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:06.793283 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:06.793283 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:06.793283 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:06.793283 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:06.793283 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:06.793283 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:06.793283 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:06.793283 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:06.793283 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:06.793283 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:14:06.793283 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:14:06.793283 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:14:06.793283 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:14:06.794378 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:14:06.794378 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:14:06.794378 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:14:06.794378 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:14:06.794378 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:06.794378 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:06.794378 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:06.794378 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:06.794378 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:06.794378 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:06.794378 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:06.794378 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:06.794378 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:06.794378 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:06.794378 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:06.794378 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:06.795359 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:06.795359 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:06.795359 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:06.795359 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:06.795359 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:14:06.795359 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:14:06.795359 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:14:06.795359 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:14:06.795359 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:14:06.795359 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:14:06.795359 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 22:14:06.795359 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:06.799337 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 440/879] 10.222.0.77 () {56 vars in 1120 bytes} [Tue Aug 23 22:14:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:06.801103 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af73d5-c062-4d9b-a7c7-820ee2a3317c None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:06.845343 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:06.954247 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af73d5-c062-4d9b-a7c7-820ee2a3317c None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:07.002046 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383ea5b-895f-4b00-91cd-80670cdf1bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:07.002680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383ea5b-895f-4b00-91cd-80670cdf1bd2 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:07.002959 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383ea5b-895f-4b00-91cd-80670cdf1bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:07.003232 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383ea5b-895f-4b00-91cd-80670cdf1bd2 None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:07.003995 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9383ea5b-895f-4b00-91cd-80670cdf1bd2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:07.004302 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9383ea5b-895f-4b00-91cd-80670cdf1bd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:07.005757 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9383ea5b-895f-4b00-91cd-80670cdf1bd2 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:07.017854 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 440/880] 10.222.0.77 () {56 vars in 1115 bytes} [Tue Aug 23 22:14:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:07.023457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26e35e-51d4-4b3b-bf4c-6eaddbe98af2 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:07.147822 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26e35e-51d4-4b3b-bf4c-6eaddbe98af2 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:07.183302 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:07.191496 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d905f-17bd-4e82-8fc3-4af493be1a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:07.192457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d905f-17bd-4e82-8fc3-4af493be1a0a None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:07.192965 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d905f-17bd-4e82-8fc3-4af493be1a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:07.193245 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d905f-17bd-4e82-8fc3-4af493be1a0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:07.212301 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d905f-17bd-4e82-8fc3-4af493be1a0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:07.214843 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d905f-17bd-4e82-8fc3-4af493be1a0a None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:07.234774 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-6e9d905f-17bd-4e82-8fc3-4af493be1a0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:14:07.234774 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:07.234774 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:07.234774 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:07.234774 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:07.234774 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:07.234774 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:07.234774 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:07.234774 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:07.234774 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:07.234774 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:07.234774 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:07.234774 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:14:07.234774 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:14:07.234774 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:14:07.234774 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:14:07.236205 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:07.236205 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:07.236205 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:07.236205 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:07.236205 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:07.236205 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:07.236205 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:07.236205 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:07.236205 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:07.236205 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:07.236205 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:07.236205 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:07.236205 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:07.236205 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:07.236205 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:07.236205 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:07.236205 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:14:07.237106 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:14:07.237106 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:14:07.237106 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:07.237106 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 441/881] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:07.243241 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383ea5b-895f-4b00-91cd-80670cdf1bd2 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:07.367356 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:07.379710 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383ea5b-895f-4b00-91cd-80670cdf1bd2 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:07.422168 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e88d9-7219-4247-9c43-660799f0b45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:07.422785 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e88d9-7219-4247-9c43-660799f0b45b None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:07.423067 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e88d9-7219-4247-9c43-660799f0b45b None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:07.423377 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e88d9-7219-4247-9c43-660799f0b45b None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:07.424023 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e88d9-7219-4247-9c43-660799f0b45b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:07.424323 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e88d9-7219-4247-9c43-660799f0b45b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:07.425722 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e88d9-7219-4247-9c43-660799f0b45b None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:07.441831 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 441/882] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:07.450557 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d905f-17bd-4e82-8fc3-4af493be1a0a None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:07.580724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d905f-17bd-4e82-8fc3-4af493be1a0a None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:07.625536 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912aa4e8-f1e6-4f0e-b8f1-c85501d78295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:07.626554 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912aa4e8-f1e6-4f0e-b8f1-c85501d78295 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:07.627010 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912aa4e8-f1e6-4f0e-b8f1-c85501d78295 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:07.627347 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912aa4e8-f1e6-4f0e-b8f1-c85501d78295 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:07.638445 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912aa4e8-f1e6-4f0e-b8f1-c85501d78295 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:07.640935 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912aa4e8-f1e6-4f0e-b8f1-c85501d78295 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:07.657292 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-912aa4e8-f1e6-4f0e-b8f1-c85501d78295 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 22:14:07.657292 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:07.657292 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:07.657292 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:07.657292 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:07.657292 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:07.657292 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:07.657292 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:07.657292 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:07.657292 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:07.657292 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:07.657292 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:07.657292 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:14:07.657292 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:14:07.657292 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:14:07.657292 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:14:07.659604 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:07.659604 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:07.659604 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:14:07.659604 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:14:07.659604 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:14:07.659604 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:14:07.659604 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:07.659604 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:07.659604 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:07.659604 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:07.659604 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:07.659604 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:07.659604 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:07.659604 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:07.659604 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:07.659604 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:07.659604 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:07.659604 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:07.661812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:07.661812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:07.661812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:14:07.661812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:14:07.661812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:14:07.661812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:14:07.661812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:14:07.661812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:14:07.661812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 22:14:07.661812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:07.661812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 442/883] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Aug 23 22:14:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:07.664846 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e88d9-7219-4247-9c43-660799f0b45b None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:07.796338 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e88d9-7219-4247-9c43-660799f0b45b None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:07.843221 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f65405-d974-4016-9fea-844d061bb2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:07.843831 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f65405-d974-4016-9fea-844d061bb2e4 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:07.844109 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f65405-d974-4016-9fea-844d061bb2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:07.844374 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f65405-d974-4016-9fea-844d061bb2e4 None admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:07.845105 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f65405-d974-4016-9fea-844d061bb2e4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:07.845430 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f65405-d974-4016-9fea-844d061bb2e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:07.846967 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f65405-d974-4016-9fea-844d061bb2e4 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:07.868027 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 442/884] 10.222.0.77 () {56 vars in 1149 bytes} [Tue Aug 23 22:14:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:07.874028 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912aa4e8-f1e6-4f0e-b8f1-c85501d78295 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:07.940677 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:08.004552 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912aa4e8-f1e6-4f0e-b8f1-c85501d78295 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:08.048396 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bab337-fe31-4dc8-89d3-6bcca353d746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:08.049015 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bab337-fe31-4dc8-89d3-6bcca353d746 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:08.049401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bab337-fe31-4dc8-89d3-6bcca353d746 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:08.049861 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bab337-fe31-4dc8-89d3-6bcca353d746 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:08.123950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3cae8-4cff-4cbc-a508-22bf277839a8 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:08.124126 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3cae8-4cff-4cbc-a508-22bf277839a8 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:08.124391 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3cae8-4cff-4cbc-a508-22bf277839a8 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:08.126249 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 443/885] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:14:08.134489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960013af-655e-4ecd-9db4-a6a32f7cc875 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:08.135149 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960013af-655e-4ecd-9db4-a6a32f7cc875 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:08.135630 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960013af-655e-4ecd-9db4-a6a32f7cc875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:08.139250 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bab337-fe31-4dc8-89d3-6bcca353d746 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:08.140766 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bab337-fe31-4dc8-89d3-6bcca353d746 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:08.156165 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-960013af-655e-4ecd-9db4-a6a32f7cc875 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:08.157820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-960013af-655e-4ecd-9db4-a6a32f7cc875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:08.160252 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:08.225790 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:08.261734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 444/886] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:08 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:14:08.284257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 443/887] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:14:07 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:14:08.290174 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960013af-655e-4ecd-9db4-a6a32f7cc875 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:08.418972 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960013af-655e-4ecd-9db4-a6a32f7cc875 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:08.471048 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ea88a-c430-4084-aadf-264bc44d45b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:08.472146 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ea88a-c430-4084-aadf-264bc44d45b4 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:08.472633 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ea88a-c430-4084-aadf-264bc44d45b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:08.473094 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ea88a-c430-4084-aadf-264bc44d45b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:08.490358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:08.498638 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ea88a-c430-4084-aadf-264bc44d45b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:08.501214 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ea88a-c430-4084-aadf-264bc44d45b4 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:08.519318 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-b81ea88a-c430-4084-aadf-264bc44d45b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:14:08.519318 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:08.519318 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:08.519318 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:08.519318 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:08.519318 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:08.519318 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:08.519318 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:08.519318 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:08.519318 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:08.519318 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:08.519318 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:08.519318 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:14:08.519318 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:14:08.519318 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:14:08.519318 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:14:08.520335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:08.520335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:08.520335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:08.520335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:08.520335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:08.520335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:08.520335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:08.520335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:08.520335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:08.520335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:08.520335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:08.520335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:08.520335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:08.520335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:08.520335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:08.520335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:08.520335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:14:08.521239 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:14:08.521239 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:14:08.521239 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:08.521239 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 445/888] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:14:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:08.528873 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bab337-fe31-4dc8-89d3-6bcca353d746 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:08.586576 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ea88a-c430-4084-aadf-264bc44d45b4 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:08.671767 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bab337-fe31-4dc8-89d3-6bcca353d746 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:08.729461 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4517459-d069-44e5-a1b9-ed8e347a12dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:08.730099 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4517459-d069-44e5-a1b9-ed8e347a12dc None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:08.730386 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4517459-d069-44e5-a1b9-ed8e347a12dc None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:08.730628 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4517459-d069-44e5-a1b9-ed8e347a12dc None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:08.731278 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4517459-d069-44e5-a1b9-ed8e347a12dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:08.731575 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4517459-d069-44e5-a1b9-ed8e347a12dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:08.733992 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4517459-d069-44e5-a1b9-ed8e347a12dc None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:08.753415 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 444/889] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:08.757187 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ea88a-c430-4084-aadf-264bc44d45b4 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:08.761337 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4517459-d069-44e5-a1b9-ed8e347a12dc None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:08.766403 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:08.812465 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395aa3ae-6091-4ef2-ab22-9b8ec11a4859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:08.813651 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395aa3ae-6091-4ef2-ab22-9b8ec11a4859 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:08.814221 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395aa3ae-6091-4ef2-ab22-9b8ec11a4859 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:08.814737 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395aa3ae-6091-4ef2-ab22-9b8ec11a4859 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:08.816547 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395aa3ae-6091-4ef2-ab22-9b8ec11a4859 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:08.818603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395aa3ae-6091-4ef2-ab22-9b8ec11a4859 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:08.830211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-395aa3ae-6091-4ef2-ab22-9b8ec11a4859 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:14:08.830211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:08.830211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:14:08.830211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:14:08.830211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:14:08.830211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:14:08.830211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:14:08.830211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:14:08.830211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:14:08.830211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:08.830211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:14:08.830211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:08.830211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:08.830211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:08.830211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:08.830211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:08.831259 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:08.831259 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:08.831259 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:08.831259 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:08.831259 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:08.831259 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:08.831259 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:08.831259 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:14:08.831259 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:14:08.831259 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:14:08.831259 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:14:08.831259 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:08.831259 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:08.831259 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:08.831259 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:08.831259 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:08.831259 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:08.832190 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:08.832190 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:08.832190 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:08.832190 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:08.832190 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:08.832190 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:08.832190 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:08.832190 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:08.832190 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:08.832190 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:08.832190 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:14:08.832190 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:14:08.832190 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:14:08.832190 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:08.836541 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 446/890] 10.222.0.77 () {56 vars in 1132 bytes} [Tue Aug 23 22:14:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:08.838613 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520027a-df45-4de1-a3a6-ab0079213e9f None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:08.838970 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520027a-df45-4de1-a3a6-ab0079213e9f None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:08.839380 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520027a-df45-4de1-a3a6-ab0079213e9f None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:08.841412 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 447/891] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:08.841639 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520027a-df45-4de1-a3a6-ab0079213e9f None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:08.919478 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:08.923155 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4517459-d069-44e5-a1b9-ed8e347a12dc None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:08.969679 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04a469-6bb2-4f86-8f7b-844270eec58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:08.970511 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04a469-6bb2-4f86-8f7b-844270eec58a None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:08.970921 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04a469-6bb2-4f86-8f7b-844270eec58a None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:08.971288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04a469-6bb2-4f86-8f7b-844270eec58a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:08.979875 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04a469-6bb2-4f86-8f7b-844270eec58a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:08.981572 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04a469-6bb2-4f86-8f7b-844270eec58a None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:08.986185 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520027a-df45-4de1-a3a6-ab0079213e9f None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:08.993768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-9d04a469-6bb2-4f86-8f7b-844270eec58a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:14:08.993768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:08.993768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:08.993768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:08.993768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:08.993768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:08.993768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:08.993768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:08.993768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:08.993768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:08.993768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:08.993768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:08.993768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:14:08.993768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:14:08.993768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:14:08.995635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:14:08.995635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:08.995635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:08.995635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:08.995635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:08.995635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:08.995635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:08.995635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:08.995635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:08.995635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:08.995635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:08.995635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:08.995635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:08.995635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:08.995635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:08.995635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:08.995635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:08.996528 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:14:08.996528 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:14:08.996528 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:14:08.996528 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:14:08.996528 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:14:08.996528 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:14:08.996528 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:14:08.996528 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:08.996528 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 445/892] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:14:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:14:08.997276 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b992cda-2855-4cd6-acf1-885d4954f27c None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:08.997564 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b992cda-2855-4cd6-acf1-885d4954f27c None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:08.997763 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b992cda-2855-4cd6-acf1-885d4954f27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:09.016913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-2b992cda-2855-4cd6-acf1-885d4954f27c None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:09.018145 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-2b992cda-2855-4cd6-acf1-885d4954f27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:09.028668 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e4b52-39d4-423d-80f4-1c09a7b799fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:09.029292 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e4b52-39d4-423d-80f4-1c09a7b799fb None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:09.029603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e4b52-39d4-423d-80f4-1c09a7b799fb None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:09.029874 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e4b52-39d4-423d-80f4-1c09a7b799fb None admin] PATH_INFO: `/v3/services` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:09.030521 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e4b52-39d4-423d-80f4-1c09a7b799fb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:09.030821 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e4b52-39d4-423d-80f4-1c09a7b799fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:09.032195 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e4b52-39d4-423d-80f4-1c09a7b799fb None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:09.037209 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 448/893] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Aug 23 22:14:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:09.038545 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6484f1d-d50f-4896-964b-ca9a898c9a36 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:09.038829 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6484f1d-d50f-4896-964b-ca9a898c9a36 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:09.039104 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6484f1d-d50f-4896-964b-ca9a898c9a36 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:09.040323 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 449/894] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:09.041126 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6484f1d-d50f-4896-964b-ca9a898c9a36 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:09.087663 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:09.096849 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 446/895] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:08 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:14:09.097728 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b992cda-2855-4cd6-acf1-885d4954f27c None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:09.183192 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6484f1d-d50f-4896-964b-ca9a898c9a36 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:09.203101 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:09.223904 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cc56d-25d9-483e-9c09-d206a0342a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:09.224773 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cc56d-25d9-483e-9c09-d206a0342a10 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:09.225322 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cc56d-25d9-483e-9c09-d206a0342a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:09.225786 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cc56d-25d9-483e-9c09-d206a0342a10 None admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:09.226653 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cc56d-25d9-483e-9c09-d206a0342a10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:09.226960 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cc56d-25d9-483e-9c09-d206a0342a10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:09.229227 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cc56d-25d9-483e-9c09-d206a0342a10 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:09.232156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b992cda-2855-4cd6-acf1-885d4954f27c None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:09.243082 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 450/896] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:14:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:09.251269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51519420-ddad-4213-b03f-577334a3092c None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:09.251620 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51519420-ddad-4213-b03f-577334a3092c None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:09.251900 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51519420-ddad-4213-b03f-577334a3092c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:09.283298 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-51519420-ddad-4213-b03f-577334a3092c None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:09.284761 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-51519420-ddad-4213-b03f-577334a3092c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:09.288178 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4a19d-aead-4a52-b16d-8f26ff7fa508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:09.289449 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4a19d-aead-4a52-b16d-8f26ff7fa508 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:09.289735 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4a19d-aead-4a52-b16d-8f26ff7fa508 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:09.290060 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4a19d-aead-4a52-b16d-8f26ff7fa508 None admin] PATH_INFO: `/v3/services` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:09.290671 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4a19d-aead-4a52-b16d-8f26ff7fa508 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:09.290975 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4a19d-aead-4a52-b16d-8f26ff7fa508 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:09.294966 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4a19d-aead-4a52-b16d-8f26ff7fa508 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:09.316772 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 447/897] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Aug 23 22:14:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:09.316772 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4a19d-aead-4a52-b16d-8f26ff7fa508 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:09.396929 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 451/898] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:09 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:14:09.398244 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51519420-ddad-4213-b03f-577334a3092c None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:09.420879 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:09.504676 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4a19d-aead-4a52-b16d-8f26ff7fa508 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:09.537388 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51519420-ddad-4213-b03f-577334a3092c None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:09.547782 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:09.572961 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbd105-a27e-4fea-b36e-9d12e8fefefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:09.574896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbd105-a27e-4fea-b36e-9d12e8fefefa None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:09.575402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbd105-a27e-4fea-b36e-9d12e8fefefa None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:09.575904 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbd105-a27e-4fea-b36e-9d12e8fefefa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:09.577280 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbbd105-a27e-4fea-b36e-9d12e8fefefa None admin] RBAC: Adding query filter params (role.id=029b79624d2f446b91041126ab200822, scope.project.id=da9a86463d68412884746b115667d2fc, user.id=02e415eb75984daa97ee79fc0146f318) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:09.577692 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f227a0-7f9d-4571-bc73-93010ba1b0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:09.577902 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbbd105-a27e-4fea-b36e-9d12e8fefefa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:09.578305 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f227a0-7f9d-4571-bc73-93010ba1b0f0 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:09.578581 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f227a0-7f9d-4571-bc73-93010ba1b0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:09.578849 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f227a0-7f9d-4571-bc73-93010ba1b0f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:09.579550 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f227a0-7f9d-4571-bc73-93010ba1b0f0 None admin] RBAC: Adding query filter params (interface=public, service_id=43008ad5170c4ae8bcbca6cdfe558aec, region_id=RegionOne) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:09.579855 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f227a0-7f9d-4571-bc73-93010ba1b0f0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:09.580660 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbbd105-a27e-4fea-b36e-9d12e8fefefa None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:09.581202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f227a0-7f9d-4571-bc73-93010ba1b0f0 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:09.594248 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 452/899] 10.222.0.77 () {56 vars in 1251 bytes} [Tue Aug 23 22:14:09 2022] GET /identity/v3/endpoints?service_id=43008ad5170c4ae8bcbca6cdfe558aec&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:09.594248 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f227a0-7f9d-4571-bc73-93010ba1b0f0 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:09.601279 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 448/900] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:14:09 2022] GET /identity/v3/role_assignments?user.id=02e415eb75984daa97ee79fc0146f318&scope.project.id=da9a86463d68412884746b115667d2fc&role.id=029b79624d2f446b91041126ab200822 => generated 259 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:09.601279 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbd105-a27e-4fea-b36e-9d12e8fefefa None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:09.721860 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f227a0-7f9d-4571-bc73-93010ba1b0f0 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:09.740662 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbd105-a27e-4fea-b36e-9d12e8fefefa None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:09.772561 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f464d47-57f0-476f-be0d-df96a08d4cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:09.772756 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f464d47-57f0-476f-be0d-df96a08d4cfb None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:09.773027 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f464d47-57f0-476f-be0d-df96a08d4cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:09.773235 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f464d47-57f0-476f-be0d-df96a08d4cfb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:09.773859 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f464d47-57f0-476f-be0d-df96a08d4cfb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:09.775552 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f464d47-57f0-476f-be0d-df96a08d4cfb None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:09.777233 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:09.787324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-4f464d47-57f0-476f-be0d-df96a08d4cfb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:14:09.787324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:09.787324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:14:09.787324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:14:09.787324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:14:09.787324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:14:09.787324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:14:09.787324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:14:09.787324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:14:09.787324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:09.787324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:14:09.787324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:09.787324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:09.787324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:09.787324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:09.787324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:09.787324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:09.788431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:09.788431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:09.788431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:09.788431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:09.788431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:09.788431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:09.788431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:14:09.788431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:14:09.788431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:14:09.788431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:14:09.788431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:09.788431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:09.788431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:09.788431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:09.788431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:09.788431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:09.789322 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:09.789322 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:09.789322 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:09.789322 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:09.789322 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:09.789322 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:09.789322 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:09.789322 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:09.789322 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:09.789322 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:09.789322 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:14:09.789322 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:14:09.789322 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:14:09.789322 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:09.793575 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 453/901] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Aug 23 22:14:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:09.794766 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f464d47-57f0-476f-be0d-df96a08d4cfb None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:09.798869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0dce8-5528-4e90-a796-9194be293c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:09.800223 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0dce8-5528-4e90-a796-9194be293c66 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:09.800223 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0dce8-5528-4e90-a796-9194be293c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:09.801195 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0dce8-5528-4e90-a796-9194be293c66 None admin] PATH_INFO: `/v3/services` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:09.801649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0dce8-5528-4e90-a796-9194be293c66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:09.804336 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0dce8-5528-4e90-a796-9194be293c66 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:09.812428 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 449/902] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Aug 23 22:14:09 2022] GET /identity/v3/services => generated 1268 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:14:09.840312 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:09.894998 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0dce8-5528-4e90-a796-9194be293c66 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:09.924456 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f464d47-57f0-476f-be0d-df96a08d4cfb None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:09.966482 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23eccc5-8eea-461a-a4af-3a285db8ae30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:09.967174 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23eccc5-8eea-461a-a4af-3a285db8ae30 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:09.967489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23eccc5-8eea-461a-a4af-3a285db8ae30 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:09.967780 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23eccc5-8eea-461a-a4af-3a285db8ae30 None admin] PATH_INFO: `/v3/services` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:09.968438 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23eccc5-8eea-461a-a4af-3a285db8ae30 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:09.968749 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23eccc5-8eea-461a-a4af-3a285db8ae30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:09.970445 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23eccc5-8eea-461a-a4af-3a285db8ae30 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:09.976405 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 454/903] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Aug 23 22:14:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:09.985174 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23eccc5-8eea-461a-a4af-3a285db8ae30 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:10.071191 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0dce8-5528-4e90-a796-9194be293c66 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:10.113880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e956e-e22d-49cd-8dad-83b9c873a044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:10.114685 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e956e-e22d-49cd-8dad-83b9c873a044 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:10.115088 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e956e-e22d-49cd-8dad-83b9c873a044 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:10.115365 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e956e-e22d-49cd-8dad-83b9c873a044 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:10.116087 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e956e-e22d-49cd-8dad-83b9c873a044 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:10.117535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e956e-e22d-49cd-8dad-83b9c873a044 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:10.124869 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:10.128757 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23eccc5-8eea-461a-a4af-3a285db8ae30 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:10.129643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-5d9e956e-e22d-49cd-8dad-83b9c873a044 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 22:14:10.129643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:10.129643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:14:10.129643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:14:10.129643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:14:10.129643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:14:10.129643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:14:10.129643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:14:10.129643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 22:14:10.129643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:10.129643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:14:10.129643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:10.129643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:10.129643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:10.129643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:10.129643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:10.129643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:10.130821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:10.130821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:10.130821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:10.130821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:10.130821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:10.130821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:10.130821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:14:10.130821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:14:10.130821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:14:10.130821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:14:10.130821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:10.130821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:10.130821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:10.130821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:10.130821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:10.130821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:10.131812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:10.131812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:10.131812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:10.131812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:10.131812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:10.131812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:10.131812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:10.131812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:10.131812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:10.131812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:10.131812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:14:10.131812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:14:10.131812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 22:14:10.131812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:10.134966 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 450/904] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Aug 23 22:14:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:14:10.144656 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e956e-e22d-49cd-8dad-83b9c873a044 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:10.172055 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef353e6-9782-4ea4-90e6-a4bb38d4db5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:10.173236 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef353e6-9782-4ea4-90e6-a4bb38d4db5b None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:10.173594 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef353e6-9782-4ea4-90e6-a4bb38d4db5b None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:10.174174 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef353e6-9782-4ea4-90e6-a4bb38d4db5b None admin] PATH_INFO: `/v3/services` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:10.174825 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef353e6-9782-4ea4-90e6-a4bb38d4db5b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:10.175132 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef353e6-9782-4ea4-90e6-a4bb38d4db5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:10.176779 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef353e6-9782-4ea4-90e6-a4bb38d4db5b None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:10.184902 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 455/905] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Aug 23 22:14:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:10.190657 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef353e6-9782-4ea4-90e6-a4bb38d4db5b None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:10.225992 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:10.285197 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e956e-e22d-49cd-8dad-83b9c873a044 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:10.313411 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef353e6-9782-4ea4-90e6-a4bb38d4db5b None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:10.332726 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089848c-888c-47e2-b747-2d8943ee048b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:10.334082 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089848c-888c-47e2-b747-2d8943ee048b None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:10.334362 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089848c-888c-47e2-b747-2d8943ee048b None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:10.334634 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089848c-888c-47e2-b747-2d8943ee048b None admin] PATH_INFO: `/v3/services` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:10.335272 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089848c-888c-47e2-b747-2d8943ee048b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:10.335570 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089848c-888c-47e2-b747-2d8943ee048b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:10.336940 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089848c-888c-47e2-b747-2d8943ee048b None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:10.342931 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 451/906] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Aug 23 22:14:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:10.353403 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089848c-888c-47e2-b747-2d8943ee048b None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:10.367914 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c0141-312d-4898-aa8b-aec0439f7259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:10.369341 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c0141-312d-4898-aa8b-aec0439f7259 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:10.369891 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c0141-312d-4898-aa8b-aec0439f7259 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:10.370421 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c0141-312d-4898-aa8b-aec0439f7259 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:10.371427 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c0141-312d-4898-aa8b-aec0439f7259 None admin] RBAC: Adding query filter params (interface=public, service_id=e4171c058747483090685b45886b34df, region_id=RegionOne) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:10.372005 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c0141-312d-4898-aa8b-aec0439f7259 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:10.373619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c0141-312d-4898-aa8b-aec0439f7259 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:10.382206 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 456/907] 10.222.0.77 () {56 vars in 1251 bytes} [Tue Aug 23 22:14:10 2022] GET /identity/v3/endpoints?service_id=e4171c058747483090685b45886b34df&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:14:10.388746 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c0141-312d-4898-aa8b-aec0439f7259 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:10.424158 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:10.472896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089848c-888c-47e2-b747-2d8943ee048b None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:10.488844 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:10.512911 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adabadd-891b-46c4-976f-5a5a9879d4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:10.513597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adabadd-891b-46c4-976f-5a5a9879d4d9 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:10.513859 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adabadd-891b-46c4-976f-5a5a9879d4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:10.514133 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adabadd-891b-46c4-976f-5a5a9879d4d9 None admin] PATH_INFO: `/v3/services` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:10.514789 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adabadd-891b-46c4-976f-5a5a9879d4d9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:10.515092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adabadd-891b-46c4-976f-5a5a9879d4d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:10.516522 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adabadd-891b-46c4-976f-5a5a9879d4d9 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:10.516862 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c0141-312d-4898-aa8b-aec0439f7259 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:10.522154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 452/908] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Aug 23 22:14:10 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:10.559453 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4627bc9-88be-4b51-9cbd-6bcf010ead7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:10.560390 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4627bc9-88be-4b51-9cbd-6bcf010ead7d None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:10.560838 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4627bc9-88be-4b51-9cbd-6bcf010ead7d None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:10.561581 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4627bc9-88be-4b51-9cbd-6bcf010ead7d None admin] PATH_INFO: `/v3/services` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:10.562354 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4627bc9-88be-4b51-9cbd-6bcf010ead7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:10.563907 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4627bc9-88be-4b51-9cbd-6bcf010ead7d None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:10.571116 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 457/909] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Aug 23 22:14:10 2022] GET /identity/v3/services => generated 1268 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:14:11.827344 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e96608-6414-4497-9f5f-9bc464c0e8f4 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:11.827920 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e96608-6414-4497-9f5f-9bc464c0e8f4 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:11.827920 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e96608-6414-4497-9f5f-9bc464c0e8f4 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:11.829527 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 453/910] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:14:11.835229 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b302bc-fe19-402e-91f9-ceea87dd19ed None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:11.835735 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b302bc-fe19-402e-91f9-ceea87dd19ed None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:11.835820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b302bc-fe19-402e-91f9-ceea87dd19ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:11.856048 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-c0b302bc-fe19-402e-91f9-ceea87dd19ed None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:11.857258 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-c0b302bc-fe19-402e-91f9-ceea87dd19ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:11.930584 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 458/911] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:11 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:14:12.022036 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b89195-763a-4a50-aee1-110f3ed17e00 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:12.022229 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b89195-763a-4a50-aee1-110f3ed17e00 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:12.022528 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b89195-763a-4a50-aee1-110f3ed17e00 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:12.024162 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 454/912] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:12.030675 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5154a07-4a76-4e33-ace1-b14168d201eb None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:12.031119 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5154a07-4a76-4e33-ace1-b14168d201eb None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:12.031540 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5154a07-4a76-4e33-ace1-b14168d201eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:12.052610 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-a5154a07-4a76-4e33-ace1-b14168d201eb None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:12.054207 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-a5154a07-4a76-4e33-ace1-b14168d201eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:12.074869 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:12.137926 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 459/913] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:12 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:14:12.240197 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b89195-763a-4a50-aee1-110f3ed17e00 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:12.378257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b89195-763a-4a50-aee1-110f3ed17e00 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:12.415685 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5154a07-4a76-4e33-ace1-b14168d201eb None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:12.443744 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3baf13f-52f7-46e7-9067-4c90ce7360a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:12.444465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3baf13f-52f7-46e7-9067-4c90ce7360a1 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:12.445033 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3baf13f-52f7-46e7-9067-4c90ce7360a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:12.445314 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3baf13f-52f7-46e7-9067-4c90ce7360a1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:12.461232 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3baf13f-52f7-46e7-9067-4c90ce7360a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:14:12.468006 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-a3baf13f-52f7-46e7-9067-4c90ce7360a1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 22:14:12.468006 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:12.468006 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:12.468006 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:12.468006 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:12.468006 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:12.468006 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:12.468006 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:12.468006 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:12.468006 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:12.468006 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:12.468006 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:12.468006 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:14:12.468006 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:14:12.468006 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:14:12.468006 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:14:12.469111 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:14:12.469111 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:14:12.469111 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:14:12.469111 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:14:12.469111 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:12.469111 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:12.469111 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:12.469111 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:12.469111 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:12.469111 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:12.469111 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:12.469111 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:12.469111 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:12.469111 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:12.469111 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:12.469111 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:12.470069 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:12.470069 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:12.470069 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:12.470069 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:12.470069 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:14:12.470069 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:14:12.470069 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:14:12.470069 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:14:12.470069 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:14:12.470069 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:14:12.470069 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 22:14:12.470069 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:12.470069 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 455/914] 10.222.0.77 () {56 vars in 1120 bytes} [Tue Aug 23 22:14:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:12.476573 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3baf13f-52f7-46e7-9067-4c90ce7360a1 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:12.533603 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:12.585972 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5154a07-4a76-4e33-ace1-b14168d201eb None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:12.658398 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3baf13f-52f7-46e7-9067-4c90ce7360a1 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:12.659309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcee029-9ad1-4f3d-9be6-54a9558963c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:12.660725 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcee029-9ad1-4f3d-9be6-54a9558963c3 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:12.662461 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcee029-9ad1-4f3d-9be6-54a9558963c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:12.663073 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcee029-9ad1-4f3d-9be6-54a9558963c3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:12.663990 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcee029-9ad1-4f3d-9be6-54a9558963c3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:12.665665 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcee029-9ad1-4f3d-9be6-54a9558963c3 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:12.683637 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-1bcee029-9ad1-4f3d-9be6-54a9558963c3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:14:12.683637 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:12.683637 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:14:12.683637 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:14:12.683637 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:14:12.683637 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:14:12.683637 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:14:12.683637 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:14:12.683637 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:14:12.683637 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:12.683637 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:14:12.683637 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:12.683637 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:12.683637 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:12.683637 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:12.683637 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:12.684754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:12.684754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:12.684754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:12.684754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:12.684754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:12.684754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:12.684754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:12.684754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:14:12.684754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:14:12.684754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:14:12.684754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:14:12.684754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:12.684754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:12.684754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:12.684754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:12.684754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:12.684754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:12.685682 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:12.685682 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:12.685682 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:12.685682 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:12.685682 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:12.685682 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:12.685682 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:12.685682 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:12.685682 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:12.685682 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:12.685682 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:14:12.685682 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:14:12.685682 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:14:12.685682 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:12.688151 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 460/915] 10.222.0.77 () {56 vars in 1132 bytes} [Tue Aug 23 22:14:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:12.693188 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcee029-9ad1-4f3d-9be6-54a9558963c3 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:12.715040 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed5a07-5b30-454f-93a2-db5624b2db2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:12.716025 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed5a07-5b30-454f-93a2-db5624b2db2c None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:12.716495 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed5a07-5b30-454f-93a2-db5624b2db2c None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:12.716959 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:12.717830 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed5a07-5b30-454f-93a2-db5624b2db2c None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:12.719026 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed5a07-5b30-454f-93a2-db5624b2db2c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:12.719380 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed5a07-5b30-454f-93a2-db5624b2db2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:12.720913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed5a07-5b30-454f-93a2-db5624b2db2c None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:12.733114 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 456/916] 10.222.0.77 () {56 vars in 1115 bytes} [Tue Aug 23 22:14:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:14:12.734998 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3afc2-9a05-47ff-b578-d2e3a0881d31 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:12.735611 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3afc2-9a05-47ff-b578-d2e3a0881d31 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:12.736161 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3afc2-9a05-47ff-b578-d2e3a0881d31 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:12.738546 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 457/917] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:12.739466 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3afc2-9a05-47ff-b578-d2e3a0881d31 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:12.840930 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcee029-9ad1-4f3d-9be6-54a9558963c3 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:12.868361 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:12.873614 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3afc2-9a05-47ff-b578-d2e3a0881d31 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:12.882697 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba9fd6-db32-48b0-98c2-afd1ce1f33c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:12.883700 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba9fd6-db32-48b0-98c2-afd1ce1f33c0 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:12.884140 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba9fd6-db32-48b0-98c2-afd1ce1f33c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:12.884716 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba9fd6-db32-48b0-98c2-afd1ce1f33c0 None admin] PATH_INFO: `/v3/services` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:12.886382 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba9fd6-db32-48b0-98c2-afd1ce1f33c0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:12.886694 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba9fd6-db32-48b0-98c2-afd1ce1f33c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:12.888209 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba9fd6-db32-48b0-98c2-afd1ce1f33c0 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:12.898850 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 461/918] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Aug 23 22:14:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:14:12.898850 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb831ca-d84f-4d8f-b918-2d82ff1d6edb None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:12.898850 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb831ca-d84f-4d8f-b918-2d82ff1d6edb None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:12.898850 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb831ca-d84f-4d8f-b918-2d82ff1d6edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:12.918989 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-6fb831ca-d84f-4d8f-b918-2d82ff1d6edb None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:12.919981 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2c62a-2ffb-4093-aef8-c6eed0bc7c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:12.920804 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-6fb831ca-d84f-4d8f-b918-2d82ff1d6edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:12.920929 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2c62a-2ffb-4093-aef8-c6eed0bc7c1b None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:12.921099 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2c62a-2ffb-4093-aef8-c6eed0bc7c1b None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:12.921400 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2c62a-2ffb-4093-aef8-c6eed0bc7c1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:12.935131 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe2c62a-2ffb-4093-aef8-c6eed0bc7c1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:12.936852 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe2c62a-2ffb-4093-aef8-c6eed0bc7c1b None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:12.952178 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-2fe2c62a-2ffb-4093-aef8-c6eed0bc7c1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:14:12.952178 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:12.952178 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:12.952178 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:12.952178 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:12.952178 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:12.952178 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:12.952178 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:12.952178 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:12.952178 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:12.952178 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:12.952178 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:12.952178 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:14:12.952178 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:14:12.952178 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:14:12.952178 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:14:12.953441 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:12.953441 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:12.953441 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:12.953441 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:12.953441 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:12.953441 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:12.953441 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:12.953441 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:12.953441 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:12.953441 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:12.953441 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:12.953441 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:12.953441 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:12.953441 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:12.953441 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:12.953441 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:12.953441 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:14:12.954465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:14:12.954465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:14:12.954465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:12.954465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 458/919] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:14:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:12.954465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2c62a-2ffb-4093-aef8-c6eed0bc7c1b None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:13.004064 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 462/920] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:12 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:14:13.005159 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb831ca-d84f-4d8f-b918-2d82ff1d6edb None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:13.027900 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:13.080387 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2c62a-2ffb-4093-aef8-c6eed0bc7c1b None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:13.137598 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5198f-189d-4d54-986b-f4900be06b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:13.138228 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5198f-189d-4d54-986b-f4900be06b5c None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:13.138517 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5198f-189d-4d54-986b-f4900be06b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:13.138783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5198f-189d-4d54-986b-f4900be06b5c None admin] PATH_INFO: `/v3/services` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:13.139427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5198f-189d-4d54-986b-f4900be06b5c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:13.139731 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5198f-189d-4d54-986b-f4900be06b5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:13.141234 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5198f-189d-4d54-986b-f4900be06b5c None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:13.150395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 459/921] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Aug 23 22:14:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:13.155713 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5198f-189d-4d54-986b-f4900be06b5c None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:13.182967 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:13.187870 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb831ca-d84f-4d8f-b918-2d82ff1d6edb None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:13.240993 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad642f-a833-4d08-bcbb-ab1843bad719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:13.241708 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad642f-a833-4d08-bcbb-ab1843bad719 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:13.241997 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad642f-a833-4d08-bcbb-ab1843bad719 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:13.242276 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad642f-a833-4d08-bcbb-ab1843bad719 None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:13.242932 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad642f-a833-4d08-bcbb-ab1843bad719 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:13.243236 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad642f-a833-4d08-bcbb-ab1843bad719 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:13.245515 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad642f-a833-4d08-bcbb-ab1843bad719 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:13.264269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 463/922] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:13.265251 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad642f-a833-4d08-bcbb-ab1843bad719 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:13.295147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5198f-189d-4d54-986b-f4900be06b5c None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:13.332894 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25df3ea-10fd-490d-b12f-da62210a4317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:13.333533 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25df3ea-10fd-490d-b12f-da62210a4317 None admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:13.333816 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25df3ea-10fd-490d-b12f-da62210a4317 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:13.334082 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25df3ea-10fd-490d-b12f-da62210a4317 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:13.335105 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25df3ea-10fd-490d-b12f-da62210a4317 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:13.336465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25df3ea-10fd-490d-b12f-da62210a4317 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:13.355984 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:13.369530 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 460/923] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:14:13 2022] POST /identity/v3/endpoints => generated 347 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:14:13.369530 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25df3ea-10fd-490d-b12f-da62210a4317 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:13.412547 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad642f-a833-4d08-bcbb-ab1843bad719 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:13.466437 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac3a44-4e7f-423c-9a04-bebe2eafbc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:13.467562 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac3a44-4e7f-423c-9a04-bebe2eafbc89 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:13.468110 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac3a44-4e7f-423c-9a04-bebe2eafbc89 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:13.468701 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac3a44-4e7f-423c-9a04-bebe2eafbc89 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:13.476121 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:13.488711 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac3a44-4e7f-423c-9a04-bebe2eafbc89 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:13.493621 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac3a44-4e7f-423c-9a04-bebe2eafbc89 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:13.515951 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25df3ea-10fd-490d-b12f-da62210a4317 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:13.519461 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-ffac3a44-4e7f-423c-9a04-bebe2eafbc89 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 22:14:13.519461 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:13.519461 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:13.519461 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:13.519461 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:13.519461 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:13.519461 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:13.519461 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:13.519461 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:13.519461 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:13.519461 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:13.519461 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:13.519461 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:14:13.519461 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:14:13.519461 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:14:13.519461 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:14:13.521244 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:13.521244 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:13.521244 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:14:13.521244 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:14:13.521244 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:14:13.521244 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:14:13.521244 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:13.521244 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:13.521244 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:13.521244 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:13.521244 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:13.521244 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:13.521244 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:13.521244 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:13.521244 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:13.521244 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:13.521244 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:13.521244 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:13.523092 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:13.523092 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:13.523092 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:14:13.523092 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:14:13.523092 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:14:13.523092 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:14:13.523092 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:14:13.523092 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:14:13.523092 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 22:14:13.523092 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:13.528986 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 464/924] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Aug 23 22:14:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:13.535198 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac3a44-4e7f-423c-9a04-bebe2eafbc89 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:13.570041 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83985ec6-1be4-42c3-bd11-69122ba583c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:13.571017 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83985ec6-1be4-42c3-bd11-69122ba583c6 None admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:13.571017 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83985ec6-1be4-42c3-bd11-69122ba583c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:13.571295 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83985ec6-1be4-42c3-bd11-69122ba583c6 None admin] PATH_INFO: `/v3/services` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:13.571921 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83985ec6-1be4-42c3-bd11-69122ba583c6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:13.574692 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83985ec6-1be4-42c3-bd11-69122ba583c6 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:13.595174 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 461/925] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Aug 23 22:14:13 2022] POST /identity/v3/services => generated 241 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:14:13.716926 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac3a44-4e7f-423c-9a04-bebe2eafbc89 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:13.788354 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:13.835213 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf27beb-0582-42bc-9869-23ee595d9502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:13.836827 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf27beb-0582-42bc-9869-23ee595d9502 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:13.837922 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf27beb-0582-42bc-9869-23ee595d9502 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:13.838783 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf27beb-0582-42bc-9869-23ee595d9502 None admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:13.843047 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf27beb-0582-42bc-9869-23ee595d9502 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:13.844926 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf27beb-0582-42bc-9869-23ee595d9502 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:13.850083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf27beb-0582-42bc-9869-23ee595d9502 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:13.898622 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 465/926] 10.222.0.77 () {56 vars in 1149 bytes} [Tue Aug 23 22:14:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:14:13.907947 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83985ec6-1be4-42c3-bd11-69122ba583c6 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:13.944346 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28840b1-5550-466a-98f8-0c0b9fcdd0b2 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:13.945272 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28840b1-5550-466a-98f8-0c0b9fcdd0b2 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:13.946058 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28840b1-5550-466a-98f8-0c0b9fcdd0b2 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:13.950187 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 466/927] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:13.959328 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1458d-2021-4b99-a739-328745bc139f None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:13.960214 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1458d-2021-4b99-a739-328745bc139f None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:13.960945 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1458d-2021-4b99-a739-328745bc139f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:13.995800 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-95b1458d-2021-4b99-a739-328745bc139f None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:13.998894 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-95b1458d-2021-4b99-a739-328745bc139f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:14.097506 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 467/928] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:14:14.122869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83985ec6-1be4-42c3-bd11-69122ba583c6 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:14.178912 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:14.189643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2e04b-79a8-4a26-8776-dfac2d33cc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:14.191568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2e04b-79a8-4a26-8776-dfac2d33cc3a None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:14.192873 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2e04b-79a8-4a26-8776-dfac2d33cc3a None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:14.193656 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2e04b-79a8-4a26-8776-dfac2d33cc3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:14.214695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2e04b-79a8-4a26-8776-dfac2d33cc3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:14.218007 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2e04b-79a8-4a26-8776-dfac2d33cc3a None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:14.246635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-9da2e04b-79a8-4a26-8776-dfac2d33cc3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:14:14.246635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:14.246635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:14.246635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:14.246635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:14.246635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:14.246635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:14.246635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:14.246635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:14.246635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:14.246635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:14.246635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:14.246635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:14:14.246635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:14:14.246635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:14:14.246635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:14:14.248401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:14.248401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:14.248401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:14.248401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:14.248401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:14.248401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:14.248401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:14.248401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:14.248401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:14.248401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:14.248401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:14.248401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:14.248401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:14.248401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:14.248401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:14.248401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:14.248401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:14:14.250203 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:14:14.250203 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:14:14.250203 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:14.253781 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 462/929] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:14:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:14.263404 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b1458d-2021-4b99-a739-328745bc139f None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:14.388934 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b1458d-2021-4b99-a739-328745bc139f None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:14.400727 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:14.427673 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ec317-d57e-4873-8054-a7e86bd8d7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:14.428318 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ec317-d57e-4873-8054-a7e86bd8d7d9 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:14.428601 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ec317-d57e-4873-8054-a7e86bd8d7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:14.428876 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ec317-d57e-4873-8054-a7e86bd8d7d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:14.429558 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ec317-d57e-4873-8054-a7e86bd8d7d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:14.429861 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ec317-d57e-4873-8054-a7e86bd8d7d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:14.431265 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ec317-d57e-4873-8054-a7e86bd8d7d9 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:14.445627 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 468/930] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:14.454173 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2e04b-79a8-4a26-8776-dfac2d33cc3a None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:14.456854 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ec317-d57e-4873-8054-a7e86bd8d7d9 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:14.566281 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ec317-d57e-4873-8054-a7e86bd8d7d9 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:14.604196 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc848f-4db2-4a9a-9eec-6342b81eec5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:14.604676 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc848f-4db2-4a9a-9eec-6342b81eec5a None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:14.604833 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc848f-4db2-4a9a-9eec-6342b81eec5a None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:14.605241 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc848f-4db2-4a9a-9eec-6342b81eec5a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:14.605867 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc848f-4db2-4a9a-9eec-6342b81eec5a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:14.607233 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc848f-4db2-4a9a-9eec-6342b81eec5a None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:14.616447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-6dfc848f-4db2-4a9a-9eec-6342b81eec5a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:14:14.616447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:14.616447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:14:14.616447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:14:14.616447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:14:14.616447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:14:14.616447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:14:14.616447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:14:14.616447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:14:14.616447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:14.616447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:14:14.616447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:14.616447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:14.616447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:14.616447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:14.616447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:14.616447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:14.618432 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:14.618432 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:14.618432 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:14.618432 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:14.618432 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:14.618432 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:14.618432 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:14:14.618432 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:14:14.618432 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:14:14.618432 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:14:14.618432 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:14.618432 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:14.618432 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:14.618432 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:14.618432 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:14.618432 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:14.620709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:14.620709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:14.620709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:14.620709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:14.620709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:14.620709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:14.620709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:14.620709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:14.620709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:14.620709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:14.620709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:14:14.620709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:14:14.620709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:14:14.620709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:14.620709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 469/931] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Aug 23 22:14:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:14:14.626915 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc848f-4db2-4a9a-9eec-6342b81eec5a None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:14.646511 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2e04b-79a8-4a26-8776-dfac2d33cc3a None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:14.698874 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ac611-1f4c-4582-9788-f6c11bd06a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:14.699731 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ac611-1f4c-4582-9788-f6c11bd06a62 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:14.700619 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ac611-1f4c-4582-9788-f6c11bd06a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:14.700619 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ac611-1f4c-4582-9788-f6c11bd06a62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:14.709068 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ac611-1f4c-4582-9788-f6c11bd06a62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:14.710805 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ac611-1f4c-4582-9788-f6c11bd06a62 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:14.722405 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:14.725968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-168ac611-1f4c-4582-9788-f6c11bd06a62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:14:14.725968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:14.725968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:14.725968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:14.725968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:14.725968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:14.725968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:14.725968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:14.725968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:14.725968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:14.725968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:14.725968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:14.725968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:14:14.725968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:14:14.725968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:14:14.727597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:14:14.727597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:14.727597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:14.727597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:14.727597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:14.727597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:14.727597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:14.727597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:14.727597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:14.727597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:14.727597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:14.727597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:14.727597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:14.727597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:14.727597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:14.727597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:14.727597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:14.729301 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:14:14.729301 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:14:14.729301 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:14:14.729301 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:14:14.729301 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:14:14.729301 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:14:14.729301 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:14:14.729301 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:14.736512 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 463/932] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:14:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:14.736512 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ac611-1f4c-4582-9788-f6c11bd06a62 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:14.813338 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:14.874847 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc848f-4db2-4a9a-9eec-6342b81eec5a None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:14.930238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ac611-1f4c-4582-9788-f6c11bd06a62 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:14.944380 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3dfec-e805-4d88-a563-792cb0afd9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:14.945216 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3dfec-e805-4d88-a563-792cb0afd9b8 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:14.945593 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3dfec-e805-4d88-a563-792cb0afd9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:14.945982 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3dfec-e805-4d88-a563-792cb0afd9b8 None admin] PATH_INFO: `/v3/services` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:14.946715 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd3dfec-e805-4d88-a563-792cb0afd9b8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:14.947801 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd3dfec-e805-4d88-a563-792cb0afd9b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:14.950155 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd3dfec-e805-4d88-a563-792cb0afd9b8 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:14.957428 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 470/933] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Aug 23 22:14:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:14.964308 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3dfec-e805-4d88-a563-792cb0afd9b8 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:15.013595 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5253d-e942-46ea-9fa0-d8b52a45f4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:15.014608 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5253d-e942-46ea-9fa0-d8b52a45f4ce None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:15.014608 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5253d-e942-46ea-9fa0-d8b52a45f4ce None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:15.014974 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5253d-e942-46ea-9fa0-d8b52a45f4ce None admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:15.015899 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5253d-e942-46ea-9fa0-d8b52a45f4ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:15.016276 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5253d-e942-46ea-9fa0-d8b52a45f4ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:15.017951 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5253d-e942-46ea-9fa0-d8b52a45f4ce None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:15.038768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 464/934] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:14:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:15.040211 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5253d-e942-46ea-9fa0-d8b52a45f4ce None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:15.153903 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5253d-e942-46ea-9fa0-d8b52a45f4ce None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:15.156539 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:15.167250 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:15.175252 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3dfec-e805-4d88-a563-792cb0afd9b8 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:15.204205 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92709d2b-d098-47e9-8c6d-5fdd1648a5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:15.205478 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92709d2b-d098-47e9-8c6d-5fdd1648a5fe None admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:15.206080 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92709d2b-d098-47e9-8c6d-5fdd1648a5fe None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:15.206781 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92709d2b-d098-47e9-8c6d-5fdd1648a5fe None admin] PATH_INFO: `/v3/projects/da9a86463d68412884746b115667d2fc/users/02e415eb75984daa97ee79fc0146f318/roles/029b79624d2f446b91041126ab200822` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:15.211074 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92709d2b-d098-47e9-8c6d-5fdd1648a5fe None admin] RBAC: Authorizing `identity:create_grant(project_id=da9a86463d68412884746b115667d2fc, user_id=02e415eb75984daa97ee79fc0146f318, role_id=029b79624d2f446b91041126ab200822)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:15.212799 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92709d2b-d098-47e9-8c6d-5fdd1648a5fe None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:15.240179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 465/935] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Aug 23 22:14:15 2022] PUT /identity/v3/projects/da9a86463d68412884746b115667d2fc/users/02e415eb75984daa97ee79fc0146f318/roles/029b79624d2f446b91041126ab200822 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:14:15.246300 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee98450-a63a-4cc4-b6e9-0ee8976c2ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:15.247552 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee98450-a63a-4cc4-b6e9-0ee8976c2ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:15.248171 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee98450-a63a-4cc4-b6e9-0ee8976c2ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:15.248851 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee98450-a63a-4cc4-b6e9-0ee8976c2ba2 None admin] PATH_INFO: `/v3/services` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:15.250312 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee98450-a63a-4cc4-b6e9-0ee8976c2ba2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:15.251040 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee98450-a63a-4cc4-b6e9-0ee8976c2ba2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:15.254022 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee98450-a63a-4cc4-b6e9-0ee8976c2ba2 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:15.265299 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 471/936] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Aug 23 22:14:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:14:15.272475 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92709d2b-d098-47e9-8c6d-5fdd1648a5fe None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:15.418561 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92709d2b-d098-47e9-8c6d-5fdd1648a5fe None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:15.470132 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a30fc-6fcc-4f14-b689-e4f57eeb3abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:15.471280 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a30fc-6fcc-4f14-b689-e4f57eeb3abb None admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:15.471775 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a30fc-6fcc-4f14-b689-e4f57eeb3abb None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:15.472282 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a30fc-6fcc-4f14-b689-e4f57eeb3abb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:15.473089 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a30fc-6fcc-4f14-b689-e4f57eeb3abb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:15.474698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a30fc-6fcc-4f14-b689-e4f57eeb3abb None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:15.503306 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 466/937] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:14:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:14:15.607762 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783dbe76-c29d-42db-8719-76365c693784 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:15.608099 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783dbe76-c29d-42db-8719-76365c693784 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:15.608314 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783dbe76-c29d-42db-8719-76365c693784 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:15.610031 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 472/938] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:15.615974 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8f5d9-d4ed-4432-b3f6-b747fbda1138 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:15.616306 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8f5d9-d4ed-4432-b3f6-b747fbda1138 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:15.616529 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8f5d9-d4ed-4432-b3f6-b747fbda1138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:15.638700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-92a8f5d9-d4ed-4432-b3f6-b747fbda1138 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:15.640433 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-92a8f5d9-d4ed-4432-b3f6-b747fbda1138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:15.662051 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:15.753454 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 467/939] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:14:16.038849 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783dbe76-c29d-42db-8719-76365c693784 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:16.174562 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783dbe76-c29d-42db-8719-76365c693784 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:16.217912 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5307844-6cb6-4f87-8dbe-45b81d7fd757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:16.218592 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5307844-6cb6-4f87-8dbe-45b81d7fd757 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:16.218872 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5307844-6cb6-4f87-8dbe-45b81d7fd757 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:16.219143 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5307844-6cb6-4f87-8dbe-45b81d7fd757 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:16.219741 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5307844-6cb6-4f87-8dbe-45b81d7fd757 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:16.221129 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5307844-6cb6-4f87-8dbe-45b81d7fd757 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:16.233830 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-d5307844-6cb6-4f87-8dbe-45b81d7fd757 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:14:16.233830 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:16.233830 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:14:16.233830 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:14:16.233830 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:14:16.233830 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:14:16.233830 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:14:16.233830 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:14:16.233830 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:14:16.233830 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:16.233830 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:14:16.233830 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:16.233830 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:16.233830 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:16.233830 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:16.233830 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:16.233830 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:16.234899 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:16.234899 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:16.234899 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:16.234899 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:16.234899 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:16.234899 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:16.234899 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:14:16.234899 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:14:16.234899 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:14:16.234899 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:14:16.234899 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:16.234899 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:16.234899 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:16.234899 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:16.234899 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:16.234899 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:16.235745 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:16.235745 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:16.235745 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:16.235745 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:16.235745 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:16.235745 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:16.235745 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:16.235745 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:16.235745 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:16.235745 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:16.235745 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:14:16.235745 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:14:16.235745 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:14:16.235745 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:16.236493 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 473/940] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:14:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:16.243582 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8f5d9-d4ed-4432-b3f6-b747fbda1138 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:16.370335 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8f5d9-d4ed-4432-b3f6-b747fbda1138 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:16.410173 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac2447-e7df-4676-ae8c-38c232526a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:16.411238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac2447-e7df-4676-ae8c-38c232526a7a None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:16.411726 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac2447-e7df-4676-ae8c-38c232526a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:16.412328 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac2447-e7df-4676-ae8c-38c232526a7a None admin] PATH_INFO: `/v3/services` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:16.413496 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac2447-e7df-4676-ae8c-38c232526a7a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:16.414098 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac2447-e7df-4676-ae8c-38c232526a7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:16.417725 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac2447-e7df-4676-ae8c-38c232526a7a None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:16.425354 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 468/941] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Aug 23 22:14:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:16.437549 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5307844-6cb6-4f87-8dbe-45b81d7fd757 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:16.469081 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:16.600826 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5307844-6cb6-4f87-8dbe-45b81d7fd757 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:16.657088 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180f524-237d-4e21-ba6a-8ef09a2f5f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:16.658062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180f524-237d-4e21-ba6a-8ef09a2f5f68 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:16.658545 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180f524-237d-4e21-ba6a-8ef09a2f5f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:16.659025 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180f524-237d-4e21-ba6a-8ef09a2f5f68 None admin] PATH_INFO: `/v3/services` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:16.660173 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180f524-237d-4e21-ba6a-8ef09a2f5f68 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:16.660709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180f524-237d-4e21-ba6a-8ef09a2f5f68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:16.663392 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180f524-237d-4e21-ba6a-8ef09a2f5f68 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:16.672908 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 474/942] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Aug 23 22:14:16 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:16.943552 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc76dc-5946-450c-af6e-5cb2a3941d9a None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:16.944081 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc76dc-5946-450c-af6e-5cb2a3941d9a None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:16.944578 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc76dc-5946-450c-af6e-5cb2a3941d9a None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:16.948110 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 469/943] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:16.956466 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917a89f-0f58-44e7-8e6e-614edcb27c83 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:16.956751 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917a89f-0f58-44e7-8e6e-614edcb27c83 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:16.957033 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917a89f-0f58-44e7-8e6e-614edcb27c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:16.978119 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-e917a89f-0f58-44e7-8e6e-614edcb27c83 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:16.979740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-e917a89f-0f58-44e7-8e6e-614edcb27c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:17.065109 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 475/944] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:14:17.582833 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc76dc-5946-450c-af6e-5cb2a3941d9a None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:17.605839 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:17.663710 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658d8b6-d26e-4a79-a128-dad15504c3cf None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:17.664065 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658d8b6-d26e-4a79-a128-dad15504c3cf None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:17.664271 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658d8b6-d26e-4a79-a128-dad15504c3cf None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:17.666528 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 476/945] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:17.673600 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7b7a9-a8b8-4fd8-896f-0597c2875190 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:17.673916 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7b7a9-a8b8-4fd8-896f-0597c2875190 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:17.674164 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7b7a9-a8b8-4fd8-896f-0597c2875190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:17.697505 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-80b7b7a9-a8b8-4fd8-896f-0597c2875190 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:17.699628 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-80b7b7a9-a8b8-4fd8-896f-0597c2875190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:17.729955 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:17.753515 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc76dc-5946-450c-af6e-5cb2a3941d9a None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:17.792903 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665a4f1-6979-4f82-a5b8-ee187134cee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:17.793590 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665a4f1-6979-4f82-a5b8-ee187134cee9 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:17.793876 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665a4f1-6979-4f82-a5b8-ee187134cee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:17.794155 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665a4f1-6979-4f82-a5b8-ee187134cee9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:17.794758 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3665a4f1-6979-4f82-a5b8-ee187134cee9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:17.796724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3665a4f1-6979-4f82-a5b8-ee187134cee9 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:17.806998 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-3665a4f1-6979-4f82-a5b8-ee187134cee9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 22:14:17.806998 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:17.806998 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:14:17.806998 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:14:17.806998 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:14:17.806998 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:14:17.806998 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:14:17.806998 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:14:17.806998 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 22:14:17.806998 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:17.806998 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:14:17.806998 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:17.806998 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:17.806998 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:17.806998 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:17.806998 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:17.806998 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:17.808376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:17.808376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:17.808376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:17.808376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:17.808376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:17.808376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:17.808376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:14:17.808376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:14:17.808376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:14:17.808376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:14:17.808376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:17.808376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:17.808376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:17.808376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:17.808376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:17.808376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:17.809424 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:17.809424 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:17.809424 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:17.809424 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:17.809424 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:17.809424 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:17.809424 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:17.809424 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:17.809424 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:17.809424 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:17.809424 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:14:17.809424 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:14:17.809424 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 22:14:17.809424 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:17.809424 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 470/946] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Aug 23 22:14:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:17.818917 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665a4f1-6979-4f82-a5b8-ee187134cee9 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:17.824996 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 477/947] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:14:17.836861 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c1ea1-b6b9-4422-882f-c73ce97d4088 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:17.837052 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c1ea1-b6b9-4422-882f-c73ce97d4088 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:17.837312 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c1ea1-b6b9-4422-882f-c73ce97d4088 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:17.842879 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 478/948] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:14:17.844394 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be341787-4b6a-4cfa-ab7f-368f0f43b77a None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:17.844612 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be341787-4b6a-4cfa-ab7f-368f0f43b77a None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:17.844832 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be341787-4b6a-4cfa-ab7f-368f0f43b77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:17.863534 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-be341787-4b6a-4cfa-ab7f-368f0f43b77a None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:17.864762 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-be341787-4b6a-4cfa-ab7f-368f0f43b77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:17.930390 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:17.960713 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 479/949] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:14:17.979682 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665a4f1-6979-4f82-a5b8-ee187134cee9 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:18.015348 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab74f9-e7ee-4ef5-9138-a79b4f3f6a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:18.016031 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab74f9-e7ee-4ef5-9138-a79b4f3f6a9e None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:18.016306 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab74f9-e7ee-4ef5-9138-a79b4f3f6a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:18.016574 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab74f9-e7ee-4ef5-9138-a79b4f3f6a9e None admin] PATH_INFO: `/v3/services` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:18.017258 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab74f9-e7ee-4ef5-9138-a79b4f3f6a9e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:18.017660 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab74f9-e7ee-4ef5-9138-a79b4f3f6a9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:18.019064 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab74f9-e7ee-4ef5-9138-a79b4f3f6a9e None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:18.024326 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 471/950] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Aug 23 22:14:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:18.030731 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be341787-4b6a-4cfa-ab7f-368f0f43b77a None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:18.117502 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:18.138990 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be341787-4b6a-4cfa-ab7f-368f0f43b77a None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:18.186791 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb152c84-cad2-4533-a5bb-a862892920cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:18.187637 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb152c84-cad2-4533-a5bb-a862892920cd None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:18.187964 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb152c84-cad2-4533-a5bb-a862892920cd None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:18.188238 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb152c84-cad2-4533-a5bb-a862892920cd None admin] PATH_INFO: `/v3/services` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:18.189175 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb152c84-cad2-4533-a5bb-a862892920cd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:18.189476 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb152c84-cad2-4533-a5bb-a862892920cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:18.190973 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb152c84-cad2-4533-a5bb-a862892920cd None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:18.191972 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab74f9-e7ee-4ef5-9138-a79b4f3f6a9e None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:18.199000 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 480/951] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Aug 23 22:14:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:14:18.209305 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb152c84-cad2-4533-a5bb-a862892920cd None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:18.345603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb152c84-cad2-4533-a5bb-a862892920cd None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:18.354441 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab74f9-e7ee-4ef5-9138-a79b4f3f6a9e None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:18.386860 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad263ec7-ff10-4ea9-9ff8-0c7e0bc6cfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:18.387389 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad263ec7-ff10-4ea9-9ff8-0c7e0bc6cfa8 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:18.387664 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad263ec7-ff10-4ea9-9ff8-0c7e0bc6cfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:18.387969 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad263ec7-ff10-4ea9-9ff8-0c7e0bc6cfa8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:18.388757 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad263ec7-ff10-4ea9-9ff8-0c7e0bc6cfa8 None admin] RBAC: Adding query filter params (interface=public, service_id=6675bfeaa12a4b2bb6118e7db280aa40, region_id=RegionOne) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:18.389108 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad263ec7-ff10-4ea9-9ff8-0c7e0bc6cfa8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:18.390535 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad263ec7-ff10-4ea9-9ff8-0c7e0bc6cfa8 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:18.392137 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fc35d-ca7f-4d27-8e90-6e7350373226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:18.392780 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fc35d-ca7f-4d27-8e90-6e7350373226 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:18.393059 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fc35d-ca7f-4d27-8e90-6e7350373226 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:18.393328 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fc35d-ca7f-4d27-8e90-6e7350373226 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:18.403323 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 481/952] 10.222.0.77 () {56 vars in 1251 bytes} [Tue Aug 23 22:14:18 2022] GET /identity/v3/endpoints?service_id=6675bfeaa12a4b2bb6118e7db280aa40&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:18.403323 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad263ec7-ff10-4ea9-9ff8-0c7e0bc6cfa8 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:18.407599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:18.413801 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244fc35d-ca7f-4d27-8e90-6e7350373226 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:14:18.413982 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:18.419038 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-244fc35d-ca7f-4d27-8e90-6e7350373226 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 22:14:18.419038 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:18.419038 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:18.419038 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:18.419038 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:18.419038 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:18.419038 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:18.419038 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:18.419038 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:18.419038 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:18.419038 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:18.419038 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:18.419038 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:14:18.419038 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:14:18.419038 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:14:18.419038 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:14:18.420090 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:14:18.420090 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:14:18.420090 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:14:18.420090 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:14:18.420090 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:18.420090 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:18.420090 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:18.420090 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:18.420090 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:18.420090 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:18.420090 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:18.420090 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:18.420090 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:18.420090 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:18.420090 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:18.420090 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:18.421026 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:18.421026 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:18.421026 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:18.421026 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:18.421026 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:14:18.421026 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:14:18.421026 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:14:18.421026 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:14:18.421026 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:14:18.421026 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:14:18.421026 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 22:14:18.421026 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:18.421026 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 472/953] 10.222.0.77 () {56 vars in 1120 bytes} [Tue Aug 23 22:14:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:14:18.421999 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fc35d-ca7f-4d27-8e90-6e7350373226 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:18.535753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad263ec7-ff10-4ea9-9ff8-0c7e0bc6cfa8 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:18.554982 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fc35d-ca7f-4d27-8e90-6e7350373226 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:18.576238 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abee870-9611-43b4-9acf-839507a92f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:18.576853 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abee870-9611-43b4-9acf-839507a92f11 None admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:18.577126 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abee870-9611-43b4-9acf-839507a92f11 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:18.577415 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abee870-9611-43b4-9acf-839507a92f11 None admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:18.578177 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abee870-9611-43b4-9acf-839507a92f11 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:18.579732 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abee870-9611-43b4-9acf-839507a92f11 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:18.582662 dv-cinder-850321-4-smb devstack@keystone.service[81752]: WARNING keystone.server.flask.common [None req-8abee870-9611-43b4-9acf-839507a92f11 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 23 22:14:18.594888 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93635432-2b81-4930-a6ae-fbb54bce9098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:18.595510 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93635432-2b81-4930-a6ae-fbb54bce9098 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:18.595791 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93635432-2b81-4930-a6ae-fbb54bce9098 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:18.596067 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93635432-2b81-4930-a6ae-fbb54bce9098 None admin] PATH_INFO: `/v3/services` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:18.596683 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93635432-2b81-4930-a6ae-fbb54bce9098 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:18.598102 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93635432-2b81-4930-a6ae-fbb54bce9098 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:18.605030 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.sql.core [None req-8abee870-9611-43b4-9acf-839507a92f11 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 22:14:18.605030 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 23 22:14:18.605030 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [parameters: {'id': 'a59bd5cc930c4af3848d802801f8a2bc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 23 22:14:18.605030 dv-cinder-850321-4-smb devstack@keystone.service[81752]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81752) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 22:14:18.613508 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 473/954] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Aug 23 22:14:18 2022] GET /identity/v3/services => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:14:18.613508 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93635432-2b81-4930-a6ae-fbb54bce9098 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:18.636603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-8abee870-9611-43b4-9acf-839507a92f11 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a59bd5cc930c4af3848d802801f8a2bc.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a59bd5cc930c4af3848d802801f8a2bc. Aug 23 22:14:18.636603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:18.636603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 22:14:18.636603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 22:14:18.636603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 22:14:18.636603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 22:14:18.636603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 22:14:18.636603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 22:14:18.636603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 22:14:18.636603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application conn.query(q) Aug 23 22:14:18.636603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 22:14:18.636603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 22:14:18.636603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 22:14:18.637619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application result.read() Aug 23 22:14:18.637619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 22:14:18.637619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 22:14:18.637619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 22:14:18.637619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 22:14:18.637619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 22:14:18.637619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 22:14:18.637619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 22:14:18.637619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 22:14:18.637619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 22:14:18.637619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:18.637619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 22:14:18.637619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:18.637619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:18.637619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 22:14:18.637619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 22:14:18.637619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 23 22:14:18.637619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 23 22:14:18.638727 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 22:14:18.638727 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application next(self.gen) Aug 23 22:14:18.638727 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 22:14:18.638727 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application yield resource Aug 23 22:14:18.638727 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 22:14:18.638727 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application next(self.gen) Aug 23 22:14:18.638727 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 22:14:18.638727 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 22:14:18.638727 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 22:14:18.638727 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 22:14:18.638727 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 22:14:18.638727 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise self.value Aug 23 22:14:18.638727 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 22:14:18.638727 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 22:14:18.638727 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 22:14:18.638727 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application session.commit() Aug 23 22:14:18.638727 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 22:14:18.639886 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 22:14:18.639886 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 22:14:18.639886 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 22:14:18.639886 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 22:14:18.639886 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application self.session.flush() Aug 23 22:14:18.639886 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 22:14:18.639886 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 22:14:18.639886 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 22:14:18.639886 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 22:14:18.639886 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 22:14:18.639886 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application compat.raise_( Aug 23 22:14:18.639886 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 22:14:18.639886 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception Aug 23 22:14:18.639886 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 22:14:18.639886 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 22:14:18.639886 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 22:14:18.639886 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 22:14:18.640785 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 22:14:18.640785 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 22:14:18.640785 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 22:14:18.640785 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 22:14:18.640785 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 23 22:14:18.640785 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 23 22:14:18.640785 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 22:14:18.640785 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 22:14:18.640785 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 22:14:18.640785 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 22:14:18.640785 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 22:14:18.640785 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 22:14:18.640785 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 22:14:18.640785 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 22:14:18.640785 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 22:14:18.641621 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 22:14:18.641621 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 22:14:18.641621 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception Aug 23 22:14:18.641621 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 22:14:18.641621 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 22:14:18.641621 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 22:14:18.641621 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 22:14:18.641621 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 22:14:18.641621 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 22:14:18.641621 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 22:14:18.641621 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application conn.query(q) Aug 23 22:14:18.641621 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 22:14:18.641621 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 22:14:18.641621 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 22:14:18.641621 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application result.read() Aug 23 22:14:18.641621 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 22:14:18.641621 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 22:14:18.642504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 22:14:18.642504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 22:14:18.642504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 22:14:18.642504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 22:14:18.642504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 22:14:18.642504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 22:14:18.642504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 22:14:18.642504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 23 22:14:18.642504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [parameters: {'id': 'a59bd5cc930c4af3848d802801f8a2bc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 23 22:14:18.642504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 22:14:18.642504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:18.642504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:14:18.642504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:18.642504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:18.642504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 23 22:14:18.645088 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 23 22:14:18.645088 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 22:14:18.645088 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 22:14:18.645088 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 23 22:14:18.645088 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:18.645088 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:14:18.645088 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:18.645088 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:18.645088 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:18.645088 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:18.645088 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:18.645088 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:18.645088 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:18.645088 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:18.645088 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:18.645088 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:18.645088 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:18.647251 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:18.647251 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 23 22:14:18.647251 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 23 22:14:18.647251 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:18.647251 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:18.647251 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 23 22:14:18.647251 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 23 22:14:18.647251 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a59bd5cc930c4af3848d802801f8a2bc. Aug 23 22:14:18.647251 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:18.647251 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 482/955] 10.222.0.77 () {60 vars in 1140 bytes} [Tue Aug 23 22:14:18 2022] POST /identity/v3/projects => generated 262 bytes in 244 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:18.647251 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abee870-9611-43b4-9acf-839507a92f11 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:18.694593 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:18.731312 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:18.755370 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93635432-2b81-4930-a6ae-fbb54bce9098 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:18.790204 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abee870-9611-43b4-9acf-839507a92f11 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:18.804098 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35532ba7-4e1d-4fe7-bd99-c52138b99e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:18.804751 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35532ba7-4e1d-4fe7-bd99-c52138b99e68 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:18.805127 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35532ba7-4e1d-4fe7-bd99-c52138b99e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:18.805499 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35532ba7-4e1d-4fe7-bd99-c52138b99e68 None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:18.806963 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35532ba7-4e1d-4fe7-bd99-c52138b99e68 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:18.807389 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35532ba7-4e1d-4fe7-bd99-c52138b99e68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:18.809969 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35532ba7-4e1d-4fe7-bd99-c52138b99e68 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:18.822590 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 474/956] 10.222.0.77 () {56 vars in 1115 bytes} [Tue Aug 23 22:14:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:18.833207 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35532ba7-4e1d-4fe7-bd99-c52138b99e68 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:18.853712 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885de708-5f82-4998-b92a-ffc60d9f30e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:18.854430 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885de708-5f82-4998-b92a-ffc60d9f30e5 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:18.854717 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885de708-5f82-4998-b92a-ffc60d9f30e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:18.854987 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885de708-5f82-4998-b92a-ffc60d9f30e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:18.865591 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885de708-5f82-4998-b92a-ffc60d9f30e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:18.867344 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885de708-5f82-4998-b92a-ffc60d9f30e5 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:18.882211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-885de708-5f82-4998-b92a-ffc60d9f30e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:14:18.882211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:18.882211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:18.882211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:18.882211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:18.882211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:18.882211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:18.882211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:18.882211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:18.882211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:18.882211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:18.882211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:18.882211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:14:18.882211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:14:18.882211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:14:18.884012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:14:18.884012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:18.884012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:18.884012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:18.884012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:18.884012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:18.884012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:18.884012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:18.884012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:18.884012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:18.884012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:18.884012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:18.884012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:18.884012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:18.884012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:18.884012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:18.884012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:18.887477 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:14:18.887477 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:14:18.887477 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:14:18.887477 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:14:18.887477 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:14:18.887477 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:14:18.887477 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:14:18.887477 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:18.887477 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 483/957] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:14:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:18.887477 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f790dc-7421-45df-a652-c109f58af6dd None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:18.887477 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f790dc-7421-45df-a652-c109f58af6dd None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:18.888758 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f790dc-7421-45df-a652-c109f58af6dd None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:18.892502 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 484/958] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:18.894694 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f790dc-7421-45df-a652-c109f58af6dd None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:18.991304 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35532ba7-4e1d-4fe7-bd99-c52138b99e68 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:19.021244 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:19.035363 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8a8da-91a7-47d0-94d7-80f5f60dc591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:19.036012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8a8da-91a7-47d0-94d7-80f5f60dc591 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:19.036302 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8a8da-91a7-47d0-94d7-80f5f60dc591 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:19.036581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8a8da-91a7-47d0-94d7-80f5f60dc591 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:19.041632 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f790dc-7421-45df-a652-c109f58af6dd None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:19.048869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8a8da-91a7-47d0-94d7-80f5f60dc591 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:19.050510 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8a8da-91a7-47d0-94d7-80f5f60dc591 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:19.074294 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:19.074516 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-eab8a8da-91a7-47d0-94d7-80f5f60dc591 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:14:19.074516 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:19.074516 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:19.074516 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:19.074516 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:19.074516 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:19.074516 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:19.074516 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:19.074516 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:19.074516 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:19.074516 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:19.074516 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:19.074516 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:14:19.074516 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:14:19.074516 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:14:19.074516 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:14:19.075436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:19.075436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:19.075436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:19.075436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:19.075436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:19.075436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:19.075436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:19.075436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:19.075436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:19.075436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:19.075436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:19.075436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:19.075436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:19.075436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:19.075436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:19.075436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:19.075436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:14:19.076389 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:14:19.076389 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:14:19.076389 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:19.076389 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 475/959] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:14:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:19.077267 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff51735-015d-47fb-be18-25e1bbbfa65e None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:19.077572 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff51735-015d-47fb-be18-25e1bbbfa65e None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:19.077777 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff51735-015d-47fb-be18-25e1bbbfa65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:19.092652 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df00ca-2917-40ad-acd7-86e20cd164e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:19.093285 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df00ca-2917-40ad-acd7-86e20cd164e3 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:19.093615 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df00ca-2917-40ad-acd7-86e20cd164e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:19.093891 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df00ca-2917-40ad-acd7-86e20cd164e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:19.095097 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df00ca-2917-40ad-acd7-86e20cd164e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:19.095408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df00ca-2917-40ad-acd7-86e20cd164e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:19.096878 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df00ca-2917-40ad-acd7-86e20cd164e3 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:19.099947 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-dff51735-015d-47fb-be18-25e1bbbfa65e None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:19.101165 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-dff51735-015d-47fb-be18-25e1bbbfa65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:19.116839 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 485/960] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Aug 23 22:14:18 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:19.117746 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df00ca-2917-40ad-acd7-86e20cd164e3 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:19.217960 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 476/961] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:14:19.267460 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df00ca-2917-40ad-acd7-86e20cd164e3 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:19.310271 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7730fa1-4a86-4d9d-9f77-ffa44a561a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:19.313239 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7730fa1-4a86-4d9d-9f77-ffa44a561a03 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:19.313239 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7730fa1-4a86-4d9d-9f77-ffa44a561a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:19.313239 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7730fa1-4a86-4d9d-9f77-ffa44a561a03 None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:19.313239 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7730fa1-4a86-4d9d-9f77-ffa44a561a03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:19.313239 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7730fa1-4a86-4d9d-9f77-ffa44a561a03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:19.316264 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7730fa1-4a86-4d9d-9f77-ffa44a561a03 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:19.327367 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 486/962] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:19.333572 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff51735-015d-47fb-be18-25e1bbbfa65e None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:19.464212 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff51735-015d-47fb-be18-25e1bbbfa65e None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:19.473236 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:19.502232 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7730fa1-4a86-4d9d-9f77-ffa44a561a03 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:19.511700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d4475-e2fd-47dd-b5eb-68b891b4e3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:19.512581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d4475-e2fd-47dd-b5eb-68b891b4e3f6 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:19.512724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d4475-e2fd-47dd-b5eb-68b891b4e3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:19.512940 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d4475-e2fd-47dd-b5eb-68b891b4e3f6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:19.524269 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d4475-e2fd-47dd-b5eb-68b891b4e3f6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:19.526770 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d4475-e2fd-47dd-b5eb-68b891b4e3f6 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:19.543682 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-491d4475-e2fd-47dd-b5eb-68b891b4e3f6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 22:14:19.543682 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:19.543682 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:19.543682 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:19.543682 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:19.543682 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:19.543682 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:19.543682 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:19.543682 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:19.543682 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:19.543682 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:19.543682 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:19.543682 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:14:19.543682 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:14:19.543682 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:14:19.543682 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:14:19.544741 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:19.544741 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:19.544741 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:14:19.544741 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:14:19.544741 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:14:19.544741 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:14:19.544741 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:19.544741 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:19.544741 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:19.544741 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:19.544741 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:19.544741 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:19.544741 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:19.544741 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:19.544741 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:19.544741 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:19.544741 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:19.544741 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:19.546402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:19.546402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:19.546402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:14:19.546402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:14:19.546402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:14:19.546402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:14:19.546402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:14:19.546402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:14:19.546402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 22:14:19.546402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:19.546402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 477/963] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Aug 23 22:14:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:19.551183 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d4475-e2fd-47dd-b5eb-68b891b4e3f6 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:19.575517 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:19.708026 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d4475-e2fd-47dd-b5eb-68b891b4e3f6 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:19.711490 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7730fa1-4a86-4d9d-9f77-ffa44a561a03 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:19.769833 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8b1c9-8457-4388-9a30-5c223810777d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:19.770093 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac19c6-2e02-4daf-b11f-853aec87213b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:19.770572 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac19c6-2e02-4daf-b11f-853aec87213b None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:19.770864 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac19c6-2e02-4daf-b11f-853aec87213b None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:19.774145 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8b1c9-8457-4388-9a30-5c223810777d None admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:19.774299 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac19c6-2e02-4daf-b11f-853aec87213b None admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:19.774433 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8b1c9-8457-4388-9a30-5c223810777d None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:19.774433 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8b1c9-8457-4388-9a30-5c223810777d None admin] PATH_INFO: `/v3/services` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:19.774606 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac19c6-2e02-4daf-b11f-853aec87213b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:19.774606 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac19c6-2e02-4daf-b11f-853aec87213b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:19.774837 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8b1c9-8457-4388-9a30-5c223810777d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:19.774837 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8b1c9-8457-4388-9a30-5c223810777d None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:19.775071 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac19c6-2e02-4daf-b11f-853aec87213b None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:19.798288 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 487/964] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Aug 23 22:14:19 2022] POST /identity/v3/services => generated 242 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:14:19.799568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 478/965] 10.222.0.77 () {56 vars in 1149 bytes} [Tue Aug 23 22:14:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:14:19.807129 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8b1c9-8457-4388-9a30-5c223810777d None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:19.937844 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:19.942681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8b1c9-8457-4388-9a30-5c223810777d None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:19.983603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd73d1-8cc8-472c-be38-50dab46f5ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:19.984269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd73d1-8cc8-472c-be38-50dab46f5ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:19.984528 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd73d1-8cc8-472c-be38-50dab46f5ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:19.984777 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd73d1-8cc8-472c-be38-50dab46f5ef9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:20.070131 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd73d1-8cc8-472c-be38-50dab46f5ef9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:20.071555 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd73d1-8cc8-472c-be38-50dab46f5ef9 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:20.188991 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:20.195273 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 488/966] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:14:19 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:14:20.201310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac19c6-2e02-4daf-b11f-853aec87213b None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:20.235063 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:20.338820 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac19c6-2e02-4daf-b11f-853aec87213b None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:20.383532 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101af01-bd3b-4d7b-8c7c-3b600ad6a6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:20.384534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101af01-bd3b-4d7b-8c7c-3b600ad6a6ca None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:20.385486 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101af01-bd3b-4d7b-8c7c-3b600ad6a6ca None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:20.385912 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101af01-bd3b-4d7b-8c7c-3b600ad6a6ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:20.397968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101af01-bd3b-4d7b-8c7c-3b600ad6a6ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:20.399732 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101af01-bd3b-4d7b-8c7c-3b600ad6a6ca None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:20.418949 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-1101af01-bd3b-4d7b-8c7c-3b600ad6a6ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:14:20.418949 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:20.418949 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:20.418949 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:20.418949 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:20.418949 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:20.418949 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:20.418949 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:20.418949 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:20.418949 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:20.418949 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:20.418949 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:20.418949 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:14:20.418949 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:14:20.418949 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:14:20.418949 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:14:20.420204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:20.420204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:20.420204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:20.420204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:20.420204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:20.420204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:20.420204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:20.420204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:20.420204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:20.420204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:20.420204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:20.420204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:20.420204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:20.420204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:20.420204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:20.420204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:20.420204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:14:20.421354 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:14:20.421354 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:14:20.421354 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:20.423246 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 479/967] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:20.430066 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd73d1-8cc8-472c-be38-50dab46f5ef9 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:20.572415 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd73d1-8cc8-472c-be38-50dab46f5ef9 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:20.617419 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d7878-b463-4a09-81bf-0f60f07af4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:20.617956 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d7878-b463-4a09-81bf-0f60f07af4d3 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:20.618234 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d7878-b463-4a09-81bf-0f60f07af4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:20.618506 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d7878-b463-4a09-81bf-0f60f07af4d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:20.619974 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d7878-b463-4a09-81bf-0f60f07af4d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:20.620283 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d7878-b463-4a09-81bf-0f60f07af4d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:20.621694 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d7878-b463-4a09-81bf-0f60f07af4d3 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:20.634964 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 489/968] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:20.641986 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101af01-bd3b-4d7b-8c7c-3b600ad6a6ca None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:20.739953 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:20.771375 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101af01-bd3b-4d7b-8c7c-3b600ad6a6ca None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:20.816029 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5aefa-d97c-417a-b786-89add713d855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:20.816678 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5aefa-d97c-417a-b786-89add713d855 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:20.816963 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5aefa-d97c-417a-b786-89add713d855 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:20.817238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5aefa-d97c-417a-b786-89add713d855 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:20.827153 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5aefa-d97c-417a-b786-89add713d855 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:20.829233 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5aefa-d97c-417a-b786-89add713d855 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:20.843690 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-21a5aefa-d97c-417a-b786-89add713d855 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:14:20.843690 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:20.843690 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:20.843690 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:20.843690 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:20.843690 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:20.843690 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:20.843690 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:20.843690 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:20.843690 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:20.843690 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:20.843690 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:20.843690 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:14:20.843690 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:14:20.843690 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:14:20.844738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:14:20.844738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:20.844738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:20.844738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:20.844738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:20.844738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:20.844738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:20.844738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:20.844738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:20.844738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:20.844738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:20.844738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:20.844738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:20.844738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:20.844738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:20.844738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:20.844738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:20.845673 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:14:20.845673 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:14:20.845673 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:14:20.845673 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:14:20.845673 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:14:20.845673 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:14:20.845673 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:14:20.845673 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:20.845673 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 480/969] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:14:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:20.854902 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d7878-b463-4a09-81bf-0f60f07af4d3 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:20.873844 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fa133-513e-41bd-93ea-198a9bd7312b None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:20.874265 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fa133-513e-41bd-93ea-198a9bd7312b None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:20.874732 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fa133-513e-41bd-93ea-198a9bd7312b None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:20.880588 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 481/970] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:20.882733 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08130523-604f-42dc-9d20-bfcb0c266563 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:20.883020 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08130523-604f-42dc-9d20-bfcb0c266563 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:20.883329 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08130523-604f-42dc-9d20-bfcb0c266563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:20.910277 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-08130523-604f-42dc-9d20-bfcb0c266563 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:20.911568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-08130523-604f-42dc-9d20-bfcb0c266563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:20.933169 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:20.992425 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d7878-b463-4a09-81bf-0f60f07af4d3 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:21.021583 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 482/971] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:20 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:14:21.032989 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d8508-c5d3-46ac-9728-3e837e815094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:21.033662 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d8508-c5d3-46ac-9728-3e837e815094 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:21.033930 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d8508-c5d3-46ac-9728-3e837e815094 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:21.034194 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d8508-c5d3-46ac-9728-3e837e815094 None admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:21.034949 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d8508-c5d3-46ac-9728-3e837e815094 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:21.035272 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d8508-c5d3-46ac-9728-3e837e815094 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:21.036708 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d8508-c5d3-46ac-9728-3e837e815094 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:21.051131 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 490/972] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:14:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:21.058163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08130523-604f-42dc-9d20-bfcb0c266563 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:21.137222 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:21.176260 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08130523-604f-42dc-9d20-bfcb0c266563 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:21.216465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e01d68-7534-40f0-9a98-27ad295a36fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:21.217095 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e01d68-7534-40f0-9a98-27ad295a36fe None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:21.217393 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e01d68-7534-40f0-9a98-27ad295a36fe None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:21.217679 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e01d68-7534-40f0-9a98-27ad295a36fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:21.218422 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e01d68-7534-40f0-9a98-27ad295a36fe None admin] RBAC: Adding query filter params (role.id=029b79624d2f446b91041126ab200822, scope.project.id=da9a86463d68412884746b115667d2fc, user.id=02e415eb75984daa97ee79fc0146f318) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:21.218732 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e01d68-7534-40f0-9a98-27ad295a36fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:21.220297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e01d68-7534-40f0-9a98-27ad295a36fe None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:21.229073 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 483/973] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:14:21 2022] GET /identity/v3/role_assignments?user.id=02e415eb75984daa97ee79fc0146f318&scope.project.id=da9a86463d68412884746b115667d2fc&role.id=029b79624d2f446b91041126ab200822 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:21.328476 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d8508-c5d3-46ac-9728-3e837e815094 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:21.501959 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d8508-c5d3-46ac-9728-3e837e815094 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:21.529551 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169bd55-8e71-4c32-8614-260e2da99f83 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:21.529896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169bd55-8e71-4c32-8614-260e2da99f83 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:21.530200 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169bd55-8e71-4c32-8614-260e2da99f83 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:21.531884 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 484/974] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:21.538271 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f73ebe-21a4-494e-9964-d432d0951281 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:21.538562 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f73ebe-21a4-494e-9964-d432d0951281 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:21.538832 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f73ebe-21a4-494e-9964-d432d0951281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:21.547152 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:21.577761 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221e7a3-6906-417a-bc77-fa0aef6f2d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:21.578580 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221e7a3-6906-417a-bc77-fa0aef6f2d03 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:21.578967 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221e7a3-6906-417a-bc77-fa0aef6f2d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:21.579343 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221e7a3-6906-417a-bc77-fa0aef6f2d03 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:21.580264 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221e7a3-6906-417a-bc77-fa0aef6f2d03 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:21.582026 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221e7a3-6906-417a-bc77-fa0aef6f2d03 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:21.595141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-8221e7a3-6906-417a-bc77-fa0aef6f2d03 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 22:14:21.595141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:21.595141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:14:21.595141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:14:21.595141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:14:21.595141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:14:21.595141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:14:21.595141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:14:21.595141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 22:14:21.595141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:21.595141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:14:21.595141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:21.595141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:21.595141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:21.595141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:21.595141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:21.595141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:21.597358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:21.597358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:21.597358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:21.597358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:21.597358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:21.597358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:21.597358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:14:21.597358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:14:21.597358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:14:21.597358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:14:21.597358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:21.597358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:21.597358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:21.597358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:21.597358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:21.597358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:21.599456 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:21.599456 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:21.599456 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:21.599456 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:21.599456 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:21.599456 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:21.599456 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:21.599456 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:21.599456 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:21.599456 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:21.599456 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:14:21.599456 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:14:21.599456 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 22:14:21.599456 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:21.599456 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 491/975] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Aug 23 22:14:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:21.605711 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-d8f73ebe-21a4-494e-9964-d432d0951281 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:21.606489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221e7a3-6906-417a-bc77-fa0aef6f2d03 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:21.608254 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-d8f73ebe-21a4-494e-9964-d432d0951281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:21.709568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 485/976] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:21 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:14:21.834913 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221e7a3-6906-417a-bc77-fa0aef6f2d03 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:21.903416 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856314b-b97e-4b9f-9e18-d2e01130105a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:21.904886 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856314b-b97e-4b9f-9e18-d2e01130105a None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:21.905605 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856314b-b97e-4b9f-9e18-d2e01130105a None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:21.906297 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856314b-b97e-4b9f-9e18-d2e01130105a None admin] PATH_INFO: `/v3/services` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:21.907652 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856314b-b97e-4b9f-9e18-d2e01130105a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:21.908396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856314b-b97e-4b9f-9e18-d2e01130105a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:21.911259 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856314b-b97e-4b9f-9e18-d2e01130105a None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:21.923887 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 492/977] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Aug 23 22:14:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:21.930707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f73ebe-21a4-494e-9964-d432d0951281 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:22.004300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:22.031890 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c86c7-c22d-4c90-a5da-f109ab0d6639 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:22.032304 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c86c7-c22d-4c90-a5da-f109ab0d6639 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:22.032462 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c86c7-c22d-4c90-a5da-f109ab0d6639 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:22.034241 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 493/978] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:14:22.040136 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81140b64-a159-4409-b3a9-2d980e67e87e None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:22.040402 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81140b64-a159-4409-b3a9-2d980e67e87e None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:22.041393 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81140b64-a159-4409-b3a9-2d980e67e87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:22.052898 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f73ebe-21a4-494e-9964-d432d0951281 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:22.067537 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-81140b64-a159-4409-b3a9-2d980e67e87e None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:22.069565 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-81140b64-a159-4409-b3a9-2d980e67e87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:22.101618 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f7e55-c598-46fa-95fc-f4429f35819d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:22.102156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f7e55-c598-46fa-95fc-f4429f35819d None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:22.102446 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f7e55-c598-46fa-95fc-f4429f35819d None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:22.102718 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f7e55-c598-46fa-95fc-f4429f35819d None admin] PATH_INFO: `/v3/services` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:22.104541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f7e55-c598-46fa-95fc-f4429f35819d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:22.104856 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f7e55-c598-46fa-95fc-f4429f35819d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:22.106904 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f7e55-c598-46fa-95fc-f4429f35819d None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:22.121404 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 486/979] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Aug 23 22:14:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:22.121404 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f7e55-c598-46fa-95fc-f4429f35819d None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:22.140128 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:22.170727 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 494/980] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:22 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:14:22.171424 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81140b64-a159-4409-b3a9-2d980e67e87e None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:22.315141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f7e55-c598-46fa-95fc-f4429f35819d None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:22.321089 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81140b64-a159-4409-b3a9-2d980e67e87e None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:22.361636 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:22.382653 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f8500-6ae7-409d-8647-881837ca91d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:22.383522 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a782e9-5d04-4ca1-938d-eda1734aee36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:22.384879 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a782e9-5d04-4ca1-938d-eda1734aee36 None admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:22.385404 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a782e9-5d04-4ca1-938d-eda1734aee36 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:22.385915 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a782e9-5d04-4ca1-938d-eda1734aee36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:22.386221 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f8500-6ae7-409d-8647-881837ca91d3 None admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:22.387023 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f8500-6ae7-409d-8647-881837ca91d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:22.387179 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a782e9-5d04-4ca1-938d-eda1734aee36 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:22.387919 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f8500-6ae7-409d-8647-881837ca91d3 None admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:22.389284 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f8500-6ae7-409d-8647-881837ca91d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:22.389595 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a782e9-5d04-4ca1-938d-eda1734aee36 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:22.392332 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f8500-6ae7-409d-8647-881837ca91d3 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:22.397352 dv-cinder-850321-4-smb devstack@keystone.service[81751]: WARNING keystone.server.flask.common [None req-266f8500-6ae7-409d-8647-881837ca91d3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 23 22:14:22.418472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.sql.core [None req-266f8500-6ae7-409d-8647-881837ca91d3 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 22:14:22.418472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 23 22:14:22.418472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [parameters: {'user_id': 'e8b5911eab3d40c09d13002028913e9a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 23 22:14:22.418472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81751) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 22:14:22.429424 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 495/981] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:14:22 2022] POST /identity/v3/endpoints => generated 349 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:14:22.438218 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-266f8500-6ae7-409d-8647-881837ca91d3 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 23 22:14:22.438218 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:22.438218 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 22:14:22.438218 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 22:14:22.438218 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 22:14:22.438218 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 22:14:22.438218 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 22:14:22.438218 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 22:14:22.438218 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 22:14:22.438218 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application conn.query(q) Aug 23 22:14:22.438218 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 22:14:22.438218 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 22:14:22.438218 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 22:14:22.438218 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application result.read() Aug 23 22:14:22.438218 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 22:14:22.439882 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 22:14:22.439882 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 22:14:22.439882 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 22:14:22.439882 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 22:14:22.439882 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 22:14:22.439882 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 22:14:22.439882 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 22:14:22.439882 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 22:14:22.439882 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:22.439882 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 22:14:22.439882 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:22.439882 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:22.439882 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 22:14:22.439882 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 22:14:22.439882 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 23 22:14:22.439882 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 23 22:14:22.439882 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 22:14:22.439882 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application next(self.gen) Aug 23 22:14:22.441926 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 22:14:22.441926 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application yield resource Aug 23 22:14:22.441926 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 22:14:22.441926 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application next(self.gen) Aug 23 22:14:22.441926 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 22:14:22.441926 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 22:14:22.441926 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 22:14:22.441926 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 22:14:22.441926 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 22:14:22.441926 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise self.value Aug 23 22:14:22.441926 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 22:14:22.441926 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 22:14:22.441926 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 22:14:22.441926 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application session.commit() Aug 23 22:14:22.441926 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 22:14:22.441926 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 22:14:22.441926 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 22:14:22.443695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 22:14:22.443695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 22:14:22.443695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self.session.flush() Aug 23 22:14:22.443695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 22:14:22.443695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 22:14:22.443695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 22:14:22.443695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 22:14:22.443695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 22:14:22.443695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application compat.raise_( Aug 23 22:14:22.443695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 22:14:22.443695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception Aug 23 22:14:22.443695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 22:14:22.443695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 22:14:22.443695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 22:14:22.443695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 22:14:22.443695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 22:14:22.443695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 22:14:22.447791 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 22:14:22.447791 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 22:14:22.447791 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 23 22:14:22.447791 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 23 22:14:22.447791 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 22:14:22.447791 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 22:14:22.447791 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 22:14:22.447791 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 22:14:22.447791 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 22:14:22.447791 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 22:14:22.447791 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 22:14:22.447791 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 22:14:22.447791 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 22:14:22.447791 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 22:14:22.447791 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 22:14:22.447791 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception Aug 23 22:14:22.451054 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 22:14:22.451054 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 22:14:22.451054 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 22:14:22.451054 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 22:14:22.451054 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 22:14:22.451054 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 22:14:22.451054 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 22:14:22.451054 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application conn.query(q) Aug 23 22:14:22.451054 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 22:14:22.451054 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 22:14:22.451054 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 22:14:22.451054 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application result.read() Aug 23 22:14:22.451054 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 22:14:22.451054 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 22:14:22.451054 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 22:14:22.451054 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 22:14:22.453188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 22:14:22.453188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 22:14:22.453188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 22:14:22.453188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 22:14:22.453188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 22:14:22.453188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 23 22:14:22.453188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e8b5911eab3d40c09d13002028913e9a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 23 22:14:22.453188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 22:14:22.453188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:22.453188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:14:22.453188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:22.453188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:22.453188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:22.453188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:22.453188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:22.455225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:22.455225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:22.455225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:22.455225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:22.455225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:22.455225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:22.455225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:22.455225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 23 22:14:22.455225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 23 22:14:22.455225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:22.455225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:22.455225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:14:22.455225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:14:22.455225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:14:22.455225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:14:22.455225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 23 22:14:22.455225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 23 22:14:22.457300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 23 22:14:22.457300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 23 22:14:22.457300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 22:14:22.457300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 22:14:22.457300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 23 22:14:22.457300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:22.457300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 487/982] 10.222.0.77 () {60 vars in 1131 bytes} [Tue Aug 23 22:14:22 2022] POST /identity/v3/users => generated 160 bytes in 328 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:22.461991 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a782e9-5d04-4ca1-938d-eda1734aee36 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:22.463968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f8500-6ae7-409d-8647-881837ca91d3 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:22.518257 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:22.646261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a782e9-5d04-4ca1-938d-eda1734aee36 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:22.681068 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f8500-6ae7-409d-8647-881837ca91d3 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:22.693959 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86160d-d80d-46ec-a4f0-43b0804c8580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:22.695121 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86160d-d80d-46ec-a4f0-43b0804c8580 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:22.695509 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86160d-d80d-46ec-a4f0-43b0804c8580 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:22.695951 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86160d-d80d-46ec-a4f0-43b0804c8580 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:22.697267 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86160d-d80d-46ec-a4f0-43b0804c8580 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:22.699074 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86160d-d80d-46ec-a4f0-43b0804c8580 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:22.710274 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-2b86160d-d80d-46ec-a4f0-43b0804c8580 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:14:22.710274 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:22.710274 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:14:22.710274 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:14:22.710274 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:14:22.710274 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:14:22.710274 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:14:22.710274 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:14:22.710274 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:14:22.710274 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:22.710274 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:14:22.710274 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:22.710274 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:22.710274 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:22.710274 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:22.710274 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:22.710274 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:22.713098 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:22.713098 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:22.713098 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:22.713098 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:22.713098 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:22.713098 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:22.713098 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:14:22.713098 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:14:22.713098 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:14:22.713098 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:14:22.713098 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:22.713098 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:22.713098 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:22.713098 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:22.713098 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:22.713098 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:22.714829 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:22.714829 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:22.714829 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:22.714829 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:22.714829 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:22.714829 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:22.714829 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:22.714829 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:22.714829 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:22.714829 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:22.714829 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:14:22.714829 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:14:22.714829 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:14:22.714829 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:22.714829 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 496/983] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:14:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:22.720052 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86160d-d80d-46ec-a4f0-43b0804c8580 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:22.764580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbc60c-e74a-44a4-a107-d8ab06ff3ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:22.765491 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbc60c-e74a-44a4-a107-d8ab06ff3ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:22.765781 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbc60c-e74a-44a4-a107-d8ab06ff3ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:22.766057 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbc60c-e74a-44a4-a107-d8ab06ff3ae1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:22.779574 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbc60c-e74a-44a4-a107-d8ab06ff3ae1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:22.781457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbc60c-e74a-44a4-a107-d8ab06ff3ae1 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:22.796092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-cbdbc60c-e74a-44a4-a107-d8ab06ff3ae1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 22:14:22.796092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:22.796092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:22.796092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:22.796092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:22.796092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:22.796092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:22.796092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:22.796092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:22.796092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:22.796092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:22.796092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:22.796092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:14:22.796092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:14:22.796092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:14:22.796092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:14:22.798120 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:22.798120 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:22.798120 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:14:22.798120 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:14:22.798120 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:14:22.798120 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:14:22.798120 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:22.798120 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:22.798120 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:22.798120 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:22.798120 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:22.798120 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:22.798120 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:22.798120 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:22.798120 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:22.798120 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:22.798120 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:22.798120 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:22.799969 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:22.799969 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:22.799969 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:14:22.799969 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:14:22.799969 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:14:22.799969 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:14:22.799969 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:14:22.799969 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:14:22.799969 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 22:14:22.799969 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:22.799969 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 488/984] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:14:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:22.807771 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbc60c-e74a-44a4-a107-d8ab06ff3ae1 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:22.861996 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:22.925904 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:22.928779 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbc60c-e74a-44a4-a107-d8ab06ff3ae1 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:22.942438 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86160d-d80d-46ec-a4f0-43b0804c8580 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:22.972169 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23ca2f-6c2a-42b9-a9b8-42b34a477574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:22.972946 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23ca2f-6c2a-42b9-a9b8-42b34a477574 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:22.973100 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23ca2f-6c2a-42b9-a9b8-42b34a477574 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:22.973324 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23ca2f-6c2a-42b9-a9b8-42b34a477574 None admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:22.974129 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be23ca2f-6c2a-42b9-a9b8-42b34a477574 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:22.974438 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be23ca2f-6c2a-42b9-a9b8-42b34a477574 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:22.975886 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be23ca2f-6c2a-42b9-a9b8-42b34a477574 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:23.013747 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9fd529-7558-42c0-b9a9-7dbba3e1c159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:23.015083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fd529-7558-42c0-b9a9-7dbba3e1c159 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:23.015765 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fd529-7558-42c0-b9a9-7dbba3e1c159 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:23.016435 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fd529-7558-42c0-b9a9-7dbba3e1c159 None admin] PATH_INFO: `/v3/services` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:23.017859 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9fd529-7558-42c0-b9a9-7dbba3e1c159 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:23.018672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9fd529-7558-42c0-b9a9-7dbba3e1c159 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:23.021561 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9fd529-7558-42c0-b9a9-7dbba3e1c159 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:23.026006 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 489/985] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Aug 23 22:14:22 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:14:23.034321 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 497/986] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Aug 23 22:14:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:23.041479 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23ca2f-6c2a-42b9-a9b8-42b34a477574 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:23.171501 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23ca2f-6c2a-42b9-a9b8-42b34a477574 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:23.174510 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:23.218484 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b688b-e4fd-4d54-a85d-05b649256747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:23.219032 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b688b-e4fd-4d54-a85d-05b649256747 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:23.219323 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b688b-e4fd-4d54-a85d-05b649256747 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:23.219607 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b688b-e4fd-4d54-a85d-05b649256747 None admin] PATH_INFO: `/v3/services` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:23.220308 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b688b-e4fd-4d54-a85d-05b649256747 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:23.220620 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b688b-e4fd-4d54-a85d-05b649256747 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:23.222122 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b688b-e4fd-4d54-a85d-05b649256747 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:23.229600 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 490/987] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Aug 23 22:14:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:14:23.236941 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9fd529-7558-42c0-b9a9-7dbba3e1c159 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:23.394796 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9fd529-7558-42c0-b9a9-7dbba3e1c159 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:23.459320 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d1739-71ad-463c-8735-7d4d763cbb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:23.460343 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d1739-71ad-463c-8735-7d4d763cbb1a None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:23.460834 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d1739-71ad-463c-8735-7d4d763cbb1a None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:23.461317 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d1739-71ad-463c-8735-7d4d763cbb1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:23.463226 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d1739-71ad-463c-8735-7d4d763cbb1a None admin] RBAC: Adding query filter params (interface=public, service_id=8ca93a7325d248dcb3e90cfffdb5f8e8, region_id=RegionOne) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:23.463802 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d1739-71ad-463c-8735-7d4d763cbb1a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:23.465470 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d1739-71ad-463c-8735-7d4d763cbb1a None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:23.472263 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 498/988] 10.222.0.77 () {56 vars in 1251 bytes} [Tue Aug 23 22:14:23 2022] GET /identity/v3/endpoints?service_id=8ca93a7325d248dcb3e90cfffdb5f8e8&interface=public®ion_id=RegionOne => generated 194 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:14:23.478690 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b688b-e4fd-4d54-a85d-05b649256747 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:23.676277 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b688b-e4fd-4d54-a85d-05b649256747 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:23.742646 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f0da1-7ff6-48f8-82ef-e5101f0336d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:23.743292 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f0da1-7ff6-48f8-82ef-e5101f0336d7 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:23.743595 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f0da1-7ff6-48f8-82ef-e5101f0336d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:23.744518 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f0da1-7ff6-48f8-82ef-e5101f0336d7 None admin] PATH_INFO: `/v3/services` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:23.745276 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f0da1-7ff6-48f8-82ef-e5101f0336d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:23.746858 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f0da1-7ff6-48f8-82ef-e5101f0336d7 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:23.754722 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 491/989] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Aug 23 22:14:23 2022] GET /identity/v3/services => generated 1727 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:14:24.256715 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07111fd-95e3-4eb9-bc28-a0a2558959d8 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:24.257198 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07111fd-95e3-4eb9-bc28-a0a2558959d8 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:24.257723 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07111fd-95e3-4eb9-bc28-a0a2558959d8 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:24.260907 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 499/990] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:24.269974 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116bcdb-e2d3-46fc-a817-9edb525a04e2 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:24.270591 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116bcdb-e2d3-46fc-a817-9edb525a04e2 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:24.270915 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116bcdb-e2d3-46fc-a817-9edb525a04e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:24.304181 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-d116bcdb-e2d3-46fc-a817-9edb525a04e2 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:24.307599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-d116bcdb-e2d3-46fc-a817-9edb525a04e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:24.359562 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:24.445724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 492/991] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:24 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:14:24.969118 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd38317-65b3-4acf-b0d9-e92ef5aa9b1e None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:24.970002 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd38317-65b3-4acf-b0d9-e92ef5aa9b1e None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:24.970141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd38317-65b3-4acf-b0d9-e92ef5aa9b1e None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:24.972790 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 500/992] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:24.973774 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116bcdb-e2d3-46fc-a817-9edb525a04e2 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:24.982566 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cf844-122b-470b-b699-51d65c3bd71f None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:24.983049 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cf844-122b-470b-b699-51d65c3bd71f None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:24.983436 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cf844-122b-470b-b699-51d65c3bd71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:25.015661 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-e92cf844-122b-470b-b699-51d65c3bd71f None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:25.017212 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-e92cf844-122b-470b-b699-51d65c3bd71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:25.047898 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:25.142535 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 501/993] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:24 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:14:25.162436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116bcdb-e2d3-46fc-a817-9edb525a04e2 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:25.227280 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e0a4a-4481-4f4b-99ed-0e1e74f1fd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:25.228878 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e0a4a-4481-4f4b-99ed-0e1e74f1fd42 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:25.229394 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e0a4a-4481-4f4b-99ed-0e1e74f1fd42 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:25.229869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e0a4a-4481-4f4b-99ed-0e1e74f1fd42 None admin] PATH_INFO: `/v3/services/image` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:25.230921 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e0a4a-4481-4f4b-99ed-0e1e74f1fd42 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:25.233509 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e0a4a-4481-4f4b-99ed-0e1e74f1fd42 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:25.251827 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-fd8e0a4a-4481-4f4b-99ed-0e1e74f1fd42 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:14:25.251827 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:25.251827 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:14:25.251827 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:14:25.251827 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:14:25.251827 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:14:25.251827 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:14:25.251827 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:14:25.251827 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:14:25.251827 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:25.251827 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:14:25.251827 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:25.251827 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:25.251827 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:25.251827 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:25.251827 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:25.251827 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:25.258040 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:25.258040 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:25.258040 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:25.258040 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:25.258040 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:25.258040 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:25.258040 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:14:25.258040 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:14:25.258040 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:14:25.258040 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:14:25.258040 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:25.258040 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:25.258040 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:25.258040 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:25.258040 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:25.258040 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:25.259698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:25.259698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:25.259698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:25.259698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:25.259698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:25.259698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:25.259698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:25.259698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:25.259698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:25.259698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:25.259698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:14:25.259698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:14:25.259698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:14:25.259698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:25.259698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 493/994] 10.222.0.77 () {56 vars in 1105 bytes} [Tue Aug 23 22:14:24 2022] GET /identity/v3/services/image => generated 86 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:14:25.266329 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92cf844-122b-470b-b699-51d65c3bd71f None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:25.449843 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92cf844-122b-470b-b699-51d65c3bd71f None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:25.486610 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e0a4a-4481-4f4b-99ed-0e1e74f1fd42 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:25.510988 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218cdaa-bf9e-4fe2-a875-5feaca8a2afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:25.511622 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218cdaa-bf9e-4fe2-a875-5feaca8a2afa None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:25.511941 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218cdaa-bf9e-4fe2-a875-5feaca8a2afa None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:25.512228 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218cdaa-bf9e-4fe2-a875-5feaca8a2afa None admin] PATH_INFO: `/v3/services` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:25.513273 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b218cdaa-bf9e-4fe2-a875-5feaca8a2afa None admin] RBAC: Adding query filter params (name=image) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:25.513778 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b218cdaa-bf9e-4fe2-a875-5feaca8a2afa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:25.515508 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b218cdaa-bf9e-4fe2-a875-5feaca8a2afa None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:25.522881 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 502/995] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:14:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:25.530514 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218cdaa-bf9e-4fe2-a875-5feaca8a2afa None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:25.532696 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:25.562508 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:25.650565 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e0a4a-4481-4f4b-99ed-0e1e74f1fd42 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:25.715566 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218cdaa-bf9e-4fe2-a875-5feaca8a2afa None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:25.724313 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e3023-0a19-4cbc-af21-298f79eca09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:25.725545 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e3023-0a19-4cbc-af21-298f79eca09f None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:25.726115 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e3023-0a19-4cbc-af21-298f79eca09f None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:25.726609 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e3023-0a19-4cbc-af21-298f79eca09f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:25.727879 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e3023-0a19-4cbc-af21-298f79eca09f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:25.731209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e3023-0a19-4cbc-af21-298f79eca09f None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:25.750742 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-951e3023-0a19-4cbc-af21-298f79eca09f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 22:14:25.750742 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:25.750742 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:14:25.750742 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:14:25.750742 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:14:25.750742 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:14:25.750742 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:14:25.750742 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:14:25.750742 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 22:14:25.750742 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:25.750742 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:14:25.750742 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:25.750742 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:25.750742 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:25.750742 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:25.750742 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:25.750742 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:25.751919 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:25.751919 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:25.751919 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:25.751919 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:25.751919 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:25.751919 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:25.751919 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:14:25.751919 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:14:25.751919 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:14:25.751919 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:14:25.751919 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:25.751919 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:25.751919 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:25.751919 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:25.751919 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:25.751919 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:25.752824 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:25.752824 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:25.752824 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:25.752824 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:25.752824 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:25.752824 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:25.752824 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:25.752824 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:25.752824 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:25.752824 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:25.752824 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:14:25.752824 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:14:25.752824 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 22:14:25.752824 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:25.754678 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 494/996] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Aug 23 22:14:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:14:25.763569 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e3023-0a19-4cbc-af21-298f79eca09f None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:25.773530 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f69ad-37d9-4bf0-9ef3-652662ae1716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:25.773530 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f69ad-37d9-4bf0-9ef3-652662ae1716 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:25.773530 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f69ad-37d9-4bf0-9ef3-652662ae1716 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:25.773530 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f69ad-37d9-4bf0-9ef3-652662ae1716 None admin] PATH_INFO: `/v3/services` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:25.776873 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f69ad-37d9-4bf0-9ef3-652662ae1716 None admin] RBAC: Adding query filter params (type=image) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:25.776873 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f69ad-37d9-4bf0-9ef3-652662ae1716 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:25.778379 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f69ad-37d9-4bf0-9ef3-652662ae1716 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:25.784977 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 503/997] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:14:25 2022] GET /identity/v3/services?type=image => generated 122 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:14:25.911066 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:25.935385 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e3023-0a19-4cbc-af21-298f79eca09f None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:25.997258 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a95aee-3b35-4056-a50a-0ecb737699b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:25.997921 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a95aee-3b35-4056-a50a-0ecb737699b0 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:25.998206 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a95aee-3b35-4056-a50a-0ecb737699b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:25.998480 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a95aee-3b35-4056-a50a-0ecb737699b0 None admin] PATH_INFO: `/v3/services` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:25.999131 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a95aee-3b35-4056-a50a-0ecb737699b0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:25.999434 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a95aee-3b35-4056-a50a-0ecb737699b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:26.001352 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a95aee-3b35-4056-a50a-0ecb737699b0 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:26.008331 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 495/998] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Aug 23 22:14:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:14:26.018765 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f69ad-37d9-4bf0-9ef3-652662ae1716 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:26.067103 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cfa60-6e5b-4081-86eb-790f9762d766 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:26.067405 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cfa60-6e5b-4081-86eb-790f9762d766 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:26.067594 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cfa60-6e5b-4081-86eb-790f9762d766 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:26.068982 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 496/999] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:14:26.075321 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20eae58-2a0c-4964-b504-2c263a3aa00a None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:26.075612 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20eae58-2a0c-4964-b504-2c263a3aa00a None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:26.075911 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20eae58-2a0c-4964-b504-2c263a3aa00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:26.103663 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-d20eae58-2a0c-4964-b504-2c263a3aa00a None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:26.106467 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-d20eae58-2a0c-4964-b504-2c263a3aa00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:26.177234 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:26.214464 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f69ad-37d9-4bf0-9ef3-652662ae1716 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:26.257048 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 497/1000] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:26 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:14:26.277316 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302285a-29e1-4821-8b53-2f69de85ab8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:26.278114 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302285a-29e1-4821-8b53-2f69de85ab8e None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:26.278390 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302285a-29e1-4821-8b53-2f69de85ab8e None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:26.278807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302285a-29e1-4821-8b53-2f69de85ab8e None admin] PATH_INFO: `/v3/services` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:26.279546 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302285a-29e1-4821-8b53-2f69de85ab8e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:26.279955 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302285a-29e1-4821-8b53-2f69de85ab8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:26.282620 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302285a-29e1-4821-8b53-2f69de85ab8e None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:26.297473 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 504/1001] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Aug 23 22:14:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:26.299854 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20eae58-2a0c-4964-b504-2c263a3aa00a None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:26.441901 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:26.475425 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20eae58-2a0c-4964-b504-2c263a3aa00a None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:26.538675 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5bc231-661b-44de-8955-3bc675deb382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:26.539625 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bc231-661b-44de-8955-3bc675deb382 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:26.539764 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bc231-661b-44de-8955-3bc675deb382 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:26.540145 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bc231-661b-44de-8955-3bc675deb382 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:26.541007 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5bc231-661b-44de-8955-3bc675deb382 None admin] RBAC: Adding query filter params (interface=admin, service_id=6675bfeaa12a4b2bb6118e7db280aa40, region_id=RegionOne) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:26.541511 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5bc231-661b-44de-8955-3bc675deb382 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:26.543070 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5bc231-661b-44de-8955-3bc675deb382 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:26.549968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 498/1002] 10.222.0.77 () {56 vars in 1249 bytes} [Tue Aug 23 22:14:26 2022] GET /identity/v3/endpoints?service_id=6675bfeaa12a4b2bb6118e7db280aa40&interface=admin®ion_id=RegionOne => generated 193 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:26.558267 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302285a-29e1-4821-8b53-2f69de85ab8e None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:26.613019 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5bc231-661b-44de-8955-3bc675deb382 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:26.718666 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302285a-29e1-4821-8b53-2f69de85ab8e None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:26.791287 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5bc231-661b-44de-8955-3bc675deb382 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:26.814156 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9d207-1c2a-49a5-bc60-85e4dba7afde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:26.814788 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9d207-1c2a-49a5-bc60-85e4dba7afde None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:26.815100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9d207-1c2a-49a5-bc60-85e4dba7afde None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:26.815453 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9d207-1c2a-49a5-bc60-85e4dba7afde None admin] PATH_INFO: `/v3/services` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:26.816159 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9d207-1c2a-49a5-bc60-85e4dba7afde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:26.818115 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9d207-1c2a-49a5-bc60-85e4dba7afde None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:26.827040 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 505/1003] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Aug 23 22:14:26 2022] GET /identity/v3/services => generated 1727 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:14:26.858041 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d76c20-80f2-447c-b2c2-45a3492afce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:26.859588 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d76c20-80f2-447c-b2c2-45a3492afce4 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:26.860329 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d76c20-80f2-447c-b2c2-45a3492afce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:26.860834 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d76c20-80f2-447c-b2c2-45a3492afce4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:26.861866 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d76c20-80f2-447c-b2c2-45a3492afce4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:26.863798 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d76c20-80f2-447c-b2c2-45a3492afce4 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:26.878797 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-e6d76c20-80f2-447c-b2c2-45a3492afce4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:14:26.878797 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:26.878797 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:14:26.878797 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:14:26.878797 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:14:26.878797 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:14:26.878797 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:14:26.878797 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:14:26.878797 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:14:26.878797 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:26.878797 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:14:26.878797 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:26.878797 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:26.878797 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:26.878797 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:26.878797 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:26.878797 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:26.880074 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:26.880074 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:26.880074 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:26.880074 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:26.880074 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:26.880074 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:26.880074 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:14:26.880074 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:14:26.880074 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:14:26.880074 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:14:26.880074 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:26.880074 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:26.880074 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:26.880074 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:26.880074 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:26.880074 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:26.881834 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:26.881834 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:26.881834 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:26.881834 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:26.881834 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:26.881834 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:26.881834 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:26.881834 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:26.881834 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:26.881834 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:26.881834 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:14:26.881834 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:14:26.881834 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:14:26.881834 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:26.881834 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 499/1004] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:14:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:26.889557 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9d207-1c2a-49a5-bc60-85e4dba7afde None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:26.907539 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:27.086985 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9d207-1c2a-49a5-bc60-85e4dba7afde None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:27.146470 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8457f-e907-4cd4-ae96-f08bb2094367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:27.147582 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8457f-e907-4cd4-ae96-f08bb2094367 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:27.148088 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8457f-e907-4cd4-ae96-f08bb2094367 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:27.148566 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8457f-e907-4cd4-ae96-f08bb2094367 None admin] PATH_INFO: `/v3/services` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:27.149550 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8457f-e907-4cd4-ae96-f08bb2094367 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:27.150643 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8457f-e907-4cd4-ae96-f08bb2094367 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:27.152595 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8457f-e907-4cd4-ae96-f08bb2094367 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:27.164977 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 506/1005] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Aug 23 22:14:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:27.167430 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d76c20-80f2-447c-b2c2-45a3492afce4 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:27.199981 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:27.357169 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d76c20-80f2-447c-b2c2-45a3492afce4 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:27.410640 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775071dc-ffe3-44f2-8705-577e4a3ece47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:27.411258 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775071dc-ffe3-44f2-8705-577e4a3ece47 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:27.411530 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775071dc-ffe3-44f2-8705-577e4a3ece47 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:27.411828 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775071dc-ffe3-44f2-8705-577e4a3ece47 None admin] PATH_INFO: `/v3/services` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:27.412727 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775071dc-ffe3-44f2-8705-577e4a3ece47 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:27.413029 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775071dc-ffe3-44f2-8705-577e4a3ece47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:27.416649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775071dc-ffe3-44f2-8705-577e4a3ece47 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:27.424412 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 500/1006] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Aug 23 22:14:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:27.432519 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8457f-e907-4cd4-ae96-f08bb2094367 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:27.538832 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:27.582134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8457f-e907-4cd4-ae96-f08bb2094367 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:27.648155 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08a7a9-e49b-41d1-9fca-8e90ee047c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:27.648794 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08a7a9-e49b-41d1-9fca-8e90ee047c1c None admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:27.649275 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08a7a9-e49b-41d1-9fca-8e90ee047c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:27.649835 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08a7a9-e49b-41d1-9fca-8e90ee047c1c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:27.651049 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a08a7a9-e49b-41d1-9fca-8e90ee047c1c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:27.653625 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a08a7a9-e49b-41d1-9fca-8e90ee047c1c None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:27.689396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 507/1007] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:14:27 2022] POST /identity/v3/endpoints => generated 334 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:14:28.274155 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7482a-0d4e-438f-a724-96d59dd1c185 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:28.275550 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7482a-0d4e-438f-a724-96d59dd1c185 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:28.275550 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7482a-0d4e-438f-a724-96d59dd1c185 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:28.277386 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 501/1008] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:28.283692 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ddd54-6331-4dd1-86f0-6e9dcf9949d4 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:28.284230 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ddd54-6331-4dd1-86f0-6e9dcf9949d4 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:28.284230 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ddd54-6331-4dd1-86f0-6e9dcf9949d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:28.306614 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-885ddd54-6331-4dd1-86f0-6e9dcf9949d4 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:28.308338 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-885ddd54-6331-4dd1-86f0-6e9dcf9949d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:28.449518 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 508/1009] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:28 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:14:28.836134 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7482a-0d4e-438f-a724-96d59dd1c185 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:28.996268 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:29.056813 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7482a-0d4e-438f-a724-96d59dd1c185 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:29.116694 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d19794-a10e-4da4-a377-a401ee16175b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:29.117746 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d19794-a10e-4da4-a377-a401ee16175b None admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:29.118046 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d19794-a10e-4da4-a377-a401ee16175b None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:29.118453 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d19794-a10e-4da4-a377-a401ee16175b None admin] PATH_INFO: `/v3/services` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:29.119288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d19794-a10e-4da4-a377-a401ee16175b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:29.121446 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d19794-a10e-4da4-a377-a401ee16175b None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:29.146504 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 502/1010] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Aug 23 22:14:28 2022] POST /identity/v3/services => generated 242 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:14:29.521618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76312d4e-b4ce-4fe2-aab2-101cd279eb11 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:29.522275 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76312d4e-b4ce-4fe2-aab2-101cd279eb11 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:29.522590 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76312d4e-b4ce-4fe2-aab2-101cd279eb11 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:29.525857 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 509/1011] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:29.535639 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39314733-90dd-4222-8fe0-512e4285396f None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:29.537508 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39314733-90dd-4222-8fe0-512e4285396f None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:29.537508 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39314733-90dd-4222-8fe0-512e4285396f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:29.568623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-39314733-90dd-4222-8fe0-512e4285396f None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:29.570724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-39314733-90dd-4222-8fe0-512e4285396f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:29.721556 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 503/1012] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:29 2022] POST /identity/v3/auth/tokens => generated 1822 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:14:30.228488 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76312d4e-b4ce-4fe2-aab2-101cd279eb11 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:30.245816 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ab68c-db11-4541-bfc3-c0c0506ce097 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:30.245816 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ab68c-db11-4541-bfc3-c0c0506ce097 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:30.246442 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ab68c-db11-4541-bfc3-c0c0506ce097 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:30.248030 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 504/1013] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:14:30.257961 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6d499-91be-4a1a-99fc-dad1f7de04ba None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:30.258509 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6d499-91be-4a1a-99fc-dad1f7de04ba None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:30.258998 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6d499-91be-4a1a-99fc-dad1f7de04ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:30.288085 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-18e6d499-91be-4a1a-99fc-dad1f7de04ba None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:30.289855 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-18e6d499-91be-4a1a-99fc-dad1f7de04ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:30.342811 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:30.401789 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:30.423128 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 505/1014] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:30 2022] POST /identity/v3/auth/tokens => generated 1822 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:14:30.434521 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76312d4e-b4ce-4fe2-aab2-101cd279eb11 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:30.507160 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b2b01-9141-4360-8a10-7f1ce62cdb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:30.508130 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b2b01-9141-4360-8a10-7f1ce62cdb7b None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:30.508620 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b2b01-9141-4360-8a10-7f1ce62cdb7b None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:30.509661 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b2b01-9141-4360-8a10-7f1ce62cdb7b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:30.510716 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b2b01-9141-4360-8a10-7f1ce62cdb7b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:30.513268 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b2b01-9141-4360-8a10-7f1ce62cdb7b None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:30.532672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-0b9b2b01-9141-4360-8a10-7f1ce62cdb7b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 22:14:30.532672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:30.532672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:14:30.532672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:14:30.532672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:14:30.532672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:14:30.532672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:14:30.532672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:14:30.532672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 22:14:30.532672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:30.532672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:14:30.532672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:30.532672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:30.532672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:30.532672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:30.532672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:30.532672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:30.534603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:30.534603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:30.534603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:30.534603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:30.534603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:30.534603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:30.534603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:14:30.534603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:14:30.534603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:14:30.534603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:14:30.534603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:30.534603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:30.534603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:30.534603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:30.534603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:30.534603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:30.535540 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:30.535540 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:30.535540 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:30.535540 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:30.535540 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:30.535540 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:30.535540 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:30.535540 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:30.535540 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:30.535540 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:30.535540 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:14:30.535540 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:14:30.535540 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 22:14:30.535540 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:30.535540 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 510/1015] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Aug 23 22:14:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:30.543949 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6d499-91be-4a1a-99fc-dad1f7de04ba None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:30.733615 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6d499-91be-4a1a-99fc-dad1f7de04ba None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:30.818878 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2dd5c-6b3b-4365-941b-09a453bd76fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:30.820099 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2dd5c-6b3b-4365-941b-09a453bd76fd None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:30.820598 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2dd5c-6b3b-4365-941b-09a453bd76fd None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:30.821142 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2dd5c-6b3b-4365-941b-09a453bd76fd None admin] PATH_INFO: `/v3/services` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:30.822723 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2dd5c-6b3b-4365-941b-09a453bd76fd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:30.823493 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2dd5c-6b3b-4365-941b-09a453bd76fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:30.827143 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2dd5c-6b3b-4365-941b-09a453bd76fd None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:30.828632 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b2b01-9141-4360-8a10-7f1ce62cdb7b None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:30.840688 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 506/1016] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Aug 23 22:14:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:30.849913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2dd5c-6b3b-4365-941b-09a453bd76fd None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:30.950503 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:31.042986 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2dd5c-6b3b-4365-941b-09a453bd76fd None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:31.051970 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b2b01-9141-4360-8a10-7f1ce62cdb7b None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:31.097507 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:31.119414 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c2b45-5a34-4326-9e70-852381ad1683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:31.120456 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c2b45-5a34-4326-9e70-852381ad1683 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:31.120970 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c2b45-5a34-4326-9e70-852381ad1683 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:31.121512 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c2b45-5a34-4326-9e70-852381ad1683 None admin] PATH_INFO: `/v3/services` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:31.122601 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c2b45-5a34-4326-9e70-852381ad1683 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:31.123150 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c2b45-5a34-4326-9e70-852381ad1683 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:31.124835 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c2b45-5a34-4326-9e70-852381ad1683 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:31.132275 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed0410-eb63-4906-bb98-097bb2f1fbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:31.132600 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 507/1017] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Aug 23 22:14:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:14:31.132944 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed0410-eb63-4906-bb98-097bb2f1fbfd None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:31.133229 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed0410-eb63-4906-bb98-097bb2f1fbfd None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:31.133544 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed0410-eb63-4906-bb98-097bb2f1fbfd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:31.139912 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c2b45-5a34-4326-9e70-852381ad1683 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:31.157785 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed0410-eb63-4906-bb98-097bb2f1fbfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:14:31.168661 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-b8ed0410-eb63-4906-bb98-097bb2f1fbfd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 22:14:31.168661 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:31.168661 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:31.168661 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:31.168661 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:31.168661 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:31.168661 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:31.168661 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:31.168661 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:31.168661 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:31.168661 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:31.168661 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:31.168661 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:14:31.168661 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:14:31.168661 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:14:31.168661 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:14:31.170618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:14:31.170618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:14:31.170618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:14:31.170618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:14:31.170618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:31.170618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:31.170618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:31.170618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:31.170618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:31.170618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:31.170618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:31.170618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:31.170618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:31.170618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:31.170618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:31.170618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:31.172284 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:31.172284 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:31.172284 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:31.172284 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:31.172284 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:14:31.172284 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:14:31.172284 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:14:31.172284 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:14:31.172284 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:14:31.172284 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:14:31.172284 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 22:14:31.172284 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:31.178827 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 511/1018] 10.222.0.77 () {56 vars in 1120 bytes} [Tue Aug 23 22:14:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:31.180570 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed0410-eb63-4906-bb98-097bb2f1fbfd None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:31.357148 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c2b45-5a34-4326-9e70-852381ad1683 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:31.390872 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed0410-eb63-4906-bb98-097bb2f1fbfd None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:31.398838 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:31.424061 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740e171-74c8-4729-b1d6-1ee3e4d12d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:31.424871 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740e171-74c8-4729-b1d6-1ee3e4d12d6a None admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:31.425349 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740e171-74c8-4729-b1d6-1ee3e4d12d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:31.425994 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740e171-74c8-4729-b1d6-1ee3e4d12d6a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:31.427179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740e171-74c8-4729-b1d6-1ee3e4d12d6a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:31.429965 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740e171-74c8-4729-b1d6-1ee3e4d12d6a None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:31.448853 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d534f6-ff95-41c8-9cf1-6e53f17a2a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:31.449909 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d534f6-ff95-41c8-9cf1-6e53f17a2a22 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:31.450352 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d534f6-ff95-41c8-9cf1-6e53f17a2a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:31.450731 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d534f6-ff95-41c8-9cf1-6e53f17a2a22 None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:31.451700 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d534f6-ff95-41c8-9cf1-6e53f17a2a22 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:31.452178 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d534f6-ff95-41c8-9cf1-6e53f17a2a22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:31.454187 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d534f6-ff95-41c8-9cf1-6e53f17a2a22 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:31.455602 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 508/1019] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:14:31 2022] POST /identity/v3/endpoints => generated 325 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:14:31.473979 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 512/1020] 10.222.0.77 () {56 vars in 1115 bytes} [Tue Aug 23 22:14:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:31.484385 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740e171-74c8-4729-b1d6-1ee3e4d12d6a None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:31.692197 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740e171-74c8-4729-b1d6-1ee3e4d12d6a None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:31.760311 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828be14-e440-4a40-b3cd-1db7fa41053a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:31.761093 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828be14-e440-4a40-b3cd-1db7fa41053a None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:31.761524 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828be14-e440-4a40-b3cd-1db7fa41053a None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:31.761697 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828be14-e440-4a40-b3cd-1db7fa41053a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:31.779189 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf588a0-61b6-42fc-bdc8-ee442604df70 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:31.780014 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf588a0-61b6-42fc-bdc8-ee442604df70 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:31.780288 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf588a0-61b6-42fc-bdc8-ee442604df70 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:31.783795 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 513/1021] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:14:31.785889 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828be14-e440-4a40-b3cd-1db7fa41053a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:31.788406 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828be14-e440-4a40-b3cd-1db7fa41053a None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:31.793044 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0d641-ec80-4941-95fe-a3183b59948d None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:31.793808 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0d641-ec80-4941-95fe-a3183b59948d None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:31.794037 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0d641-ec80-4941-95fe-a3183b59948d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:31.809294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-9828be14-e440-4a40-b3cd-1db7fa41053a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:14:31.809294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:31.809294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:31.809294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:31.809294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:31.809294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:31.809294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:31.809294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:31.809294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:31.809294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:31.809294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:31.809294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:31.809294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:14:31.809294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:14:31.809294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:14:31.809294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:14:31.814472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:31.814472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:31.814472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:31.814472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:31.814472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:31.814472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:31.814472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:31.814472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:31.814472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:31.814472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:31.814472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:31.814472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:31.814472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:31.814472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:31.814472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:31.814472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:31.814472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:14:31.815747 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:14:31.815747 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:14:31.815747 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:31.815747 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 509/1022] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:14:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:31.818538 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828be14-e440-4a40-b3cd-1db7fa41053a None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:31.826670 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-b8b0d641-ec80-4941-95fe-a3183b59948d None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:31.828884 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-b8b0d641-ec80-4941-95fe-a3183b59948d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:31.874861 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:31.896310 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:31.949335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 514/1023] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:31 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:14:31.994347 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828be14-e440-4a40-b3cd-1db7fa41053a None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:32.075585 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ff9f4-a90a-41ec-bb95-56a8a2f16b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:32.076216 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ff9f4-a90a-41ec-bb95-56a8a2f16b4f None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:32.076494 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ff9f4-a90a-41ec-bb95-56a8a2f16b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:32.076764 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ff9f4-a90a-41ec-bb95-56a8a2f16b4f None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:32.077459 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ff9f4-a90a-41ec-bb95-56a8a2f16b4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:32.077768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ff9f4-a90a-41ec-bb95-56a8a2f16b4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:32.079162 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ff9f4-a90a-41ec-bb95-56a8a2f16b4f None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:32.100570 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 510/1024] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:14:32.107329 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0d641-ec80-4941-95fe-a3183b59948d None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:32.274882 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0d641-ec80-4941-95fe-a3183b59948d None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:32.302057 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ff9f4-a90a-41ec-bb95-56a8a2f16b4f None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:32.348006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5849afb-e7e2-43f3-8aad-d28094c4e663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:32.349055 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5849afb-e7e2-43f3-8aad-d28094c4e663 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:32.349589 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5849afb-e7e2-43f3-8aad-d28094c4e663 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:32.350032 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5849afb-e7e2-43f3-8aad-d28094c4e663 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:32.369559 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5849afb-e7e2-43f3-8aad-d28094c4e663 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:32.372755 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5849afb-e7e2-43f3-8aad-d28094c4e663 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:32.404324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-d5849afb-e7e2-43f3-8aad-d28094c4e663 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:14:32.404324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:32.404324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:32.404324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:32.404324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:32.404324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:32.404324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:32.404324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:32.404324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:32.404324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:32.404324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:32.404324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:32.404324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:14:32.404324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:14:32.404324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:14:32.404324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:14:32.405556 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:32.405556 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:32.405556 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:14:32.405556 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:14:32.405556 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:14:32.405556 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:14:32.405556 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:32.405556 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:32.405556 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:32.405556 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:32.405556 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:32.405556 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:32.405556 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:32.405556 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:32.405556 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:32.405556 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:32.405556 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:32.405556 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:32.407069 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:32.407069 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:32.407069 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:14:32.407069 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:14:32.407069 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:14:32.407069 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:14:32.407069 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:14:32.407069 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:14:32.407069 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:14:32.407069 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:32.407069 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 515/1025] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Aug 23 22:14:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:32.418196 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5849afb-e7e2-43f3-8aad-d28094c4e663 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:32.469865 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:32.496674 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:32.524256 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ff9f4-a90a-41ec-bb95-56a8a2f16b4f None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:32.593744 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca9778-85be-4b00-8d01-c136203a35c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:32.594896 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5849afb-e7e2-43f3-8aad-d28094c4e663 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:32.595665 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca9778-85be-4b00-8d01-c136203a35c6 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:32.596611 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca9778-85be-4b00-8d01-c136203a35c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:32.597677 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca9778-85be-4b00-8d01-c136203a35c6 None admin] PATH_INFO: `/v3/services/image` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:32.599227 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca9778-85be-4b00-8d01-c136203a35c6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:32.605154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca9778-85be-4b00-8d01-c136203a35c6 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:32.623913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-2bca9778-85be-4b00-8d01-c136203a35c6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:14:32.623913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:32.623913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:14:32.623913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:14:32.623913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:14:32.623913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:14:32.623913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:14:32.623913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:14:32.623913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:14:32.623913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:32.623913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:14:32.623913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:32.623913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:32.623913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:32.623913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:32.623913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:32.623913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:32.625158 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:32.625158 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:32.625158 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:32.625158 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:32.625158 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:32.625158 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:32.625158 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:14:32.625158 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:14:32.625158 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:14:32.625158 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:14:32.625158 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:32.625158 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:32.625158 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:32.625158 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:32.625158 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:32.625158 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:32.626037 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:32.626037 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:32.626037 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:32.626037 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:32.626037 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:32.626037 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:32.626037 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:32.626037 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:32.626037 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:32.626037 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:32.626037 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:14:32.626037 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:14:32.626037 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:14:32.626037 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:32.630615 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 511/1026] 10.222.0.77 () {56 vars in 1105 bytes} [Tue Aug 23 22:14:32 2022] GET /identity/v3/services/image => generated 86 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:32.632886 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca9778-85be-4b00-8d01-c136203a35c6 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:32.653241 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cc849-1674-45b3-bd25-bff5025ed587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:32.654206 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cc849-1674-45b3-bd25-bff5025ed587 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:32.654542 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cc849-1674-45b3-bd25-bff5025ed587 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:32.654811 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cc849-1674-45b3-bd25-bff5025ed587 None admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:32.655735 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108cc849-1674-45b3-bd25-bff5025ed587 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:32.656045 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108cc849-1674-45b3-bd25-bff5025ed587 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:32.658006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108cc849-1674-45b3-bd25-bff5025ed587 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:32.678855 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 516/1027] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Aug 23 22:14:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:32.687614 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cc849-1674-45b3-bd25-bff5025ed587 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:32.805388 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca9778-85be-4b00-8d01-c136203a35c6 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:32.832797 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:32.851080 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cc849-1674-45b3-bd25-bff5025ed587 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:32.854380 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ba155-8e8a-41ef-bac4-f7e5a9171449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:32.855140 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ba155-8e8a-41ef-bac4-f7e5a9171449 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:32.855500 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ba155-8e8a-41ef-bac4-f7e5a9171449 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:32.855891 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ba155-8e8a-41ef-bac4-f7e5a9171449 None admin] PATH_INFO: `/v3/services` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:32.856618 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ba155-8e8a-41ef-bac4-f7e5a9171449 None admin] RBAC: Adding query filter params (name=image) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:32.856993 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ba155-8e8a-41ef-bac4-f7e5a9171449 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:32.858512 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ba155-8e8a-41ef-bac4-f7e5a9171449 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:32.865380 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 512/1028] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:14:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:32.872776 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ba155-8e8a-41ef-bac4-f7e5a9171449 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:32.907417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:32.911157 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6171cf-faa0-4009-8961-e99bb4acd3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:32.911778 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6171cf-faa0-4009-8961-e99bb4acd3fd None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:32.912056 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6171cf-faa0-4009-8961-e99bb4acd3fd None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:32.912322 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6171cf-faa0-4009-8961-e99bb4acd3fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:33.018661 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6171cf-faa0-4009-8961-e99bb4acd3fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:33.020180 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6171cf-faa0-4009-8961-e99bb4acd3fd None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:33.069328 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ba155-8e8a-41ef-bac4-f7e5a9171449 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:33.138133 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97e38a-df62-418e-95f8-1b5f161675f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:33.138918 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97e38a-df62-418e-95f8-1b5f161675f4 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:33.139209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97e38a-df62-418e-95f8-1b5f161675f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:33.139645 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97e38a-df62-418e-95f8-1b5f161675f4 None admin] PATH_INFO: `/v3/services` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:33.140545 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97e38a-df62-418e-95f8-1b5f161675f4 None admin] RBAC: Adding query filter params (type=image) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:33.140854 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97e38a-df62-418e-95f8-1b5f161675f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:33.142814 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97e38a-df62-418e-95f8-1b5f161675f4 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:33.152656 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 513/1029] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:14:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:14:33.159873 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97e38a-df62-418e-95f8-1b5f161675f4 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:33.191891 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:33.228800 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 517/1030] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:14:32 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:14:33.230451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6171cf-faa0-4009-8961-e99bb4acd3fd None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:33.326299 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:33.367696 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97e38a-df62-418e-95f8-1b5f161675f4 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:33.400096 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6171cf-faa0-4009-8961-e99bb4acd3fd None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:33.429095 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f4136-968f-4bf7-b9d1-8f62fbb26214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:33.429763 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f4136-968f-4bf7-b9d1-8f62fbb26214 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:33.430052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f4136-968f-4bf7-b9d1-8f62fbb26214 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:33.430326 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f4136-968f-4bf7-b9d1-8f62fbb26214 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:33.431184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f4136-968f-4bf7-b9d1-8f62fbb26214 None admin] RBAC: Adding query filter params (interface=public, service_id=85d8d9fb9ac84ae88621d20224c68f76, region_id=RegionOne) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:33.431751 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f4136-968f-4bf7-b9d1-8f62fbb26214 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:33.433486 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f4136-968f-4bf7-b9d1-8f62fbb26214 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:33.442243 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 514/1031] 10.222.0.77 () {56 vars in 1251 bytes} [Tue Aug 23 22:14:33 2022] GET /identity/v3/endpoints?service_id=85d8d9fb9ac84ae88621d20224c68f76&interface=public®ion_id=RegionOne => generated 194 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:14:33.451135 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f4136-968f-4bf7-b9d1-8f62fbb26214 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:33.473330 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7835fd3-c181-4180-99ec-45ac3a59c06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:33.474175 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7835fd3-c181-4180-99ec-45ac3a59c06c None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:33.474582 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7835fd3-c181-4180-99ec-45ac3a59c06c None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:33.474999 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7835fd3-c181-4180-99ec-45ac3a59c06c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:33.494588 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7835fd3-c181-4180-99ec-45ac3a59c06c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:33.496675 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7835fd3-c181-4180-99ec-45ac3a59c06c None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:33.516010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-b7835fd3-c181-4180-99ec-45ac3a59c06c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:14:33.516010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:33.516010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:33.516010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:33.516010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:33.516010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:33.516010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:33.516010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:33.516010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:33.516010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:33.516010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:33.516010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:33.516010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:14:33.516010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:14:33.516010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:14:33.516010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:14:33.528817 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:33.528817 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:33.528817 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:33.528817 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:33.528817 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:33.528817 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:33.528817 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:33.528817 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:33.528817 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:33.528817 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:33.528817 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:33.528817 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:33.528817 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:33.528817 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:33.528817 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:33.528817 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:33.528817 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:14:33.530709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:14:33.530709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:14:33.530709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:33.530709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 518/1032] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:14:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:14:33.532765 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7835fd3-c181-4180-99ec-45ac3a59c06c None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:33.598460 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:33.642068 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f4136-968f-4bf7-b9d1-8f62fbb26214 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:33.691531 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86ddac-b1d5-4753-a361-67f422f09e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:33.692332 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86ddac-b1d5-4753-a361-67f422f09e9b None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:33.692868 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86ddac-b1d5-4753-a361-67f422f09e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:33.693397 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86ddac-b1d5-4753-a361-67f422f09e9b None admin] PATH_INFO: `/v3/services` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:33.694366 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86ddac-b1d5-4753-a361-67f422f09e9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:33.698030 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86ddac-b1d5-4753-a361-67f422f09e9b None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:33.708629 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 515/1033] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Aug 23 22:14:33 2022] GET /identity/v3/services => generated 1957 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:14:33.753962 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7835fd3-c181-4180-99ec-45ac3a59c06c None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:33.826202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefa79b-bf67-4e21-9240-0b327c6f352f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:33.827030 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefa79b-bf67-4e21-9240-0b327c6f352f None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:33.827431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefa79b-bf67-4e21-9240-0b327c6f352f None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:33.827715 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefa79b-bf67-4e21-9240-0b327c6f352f None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:33.828834 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefa79b-bf67-4e21-9240-0b327c6f352f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:33.829297 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefa79b-bf67-4e21-9240-0b327c6f352f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:33.831016 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefa79b-bf67-4e21-9240-0b327c6f352f None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:33.850006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 519/1034] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:33.857285 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86ddac-b1d5-4753-a361-67f422f09e9b None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:33.882992 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:33.952193 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69852a1-7eb0-4cd1-b9fa-30598fd79d32 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:33.952610 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69852a1-7eb0-4cd1-b9fa-30598fd79d32 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:33.952966 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69852a1-7eb0-4cd1-b9fa-30598fd79d32 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:33.955923 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 520/1035] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:33.964276 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43475bbb-7457-48b2-afe6-0baa18fa8f11 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:33.964597 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43475bbb-7457-48b2-afe6-0baa18fa8f11 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:33.965049 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43475bbb-7457-48b2-afe6-0baa18fa8f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:33.992887 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-43475bbb-7457-48b2-afe6-0baa18fa8f11 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:33.996506 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-43475bbb-7457-48b2-afe6-0baa18fa8f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:34.094720 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86ddac-b1d5-4753-a361-67f422f09e9b None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:34.168394 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f163f6-d36d-4cb4-ac2c-7f6d09331ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:34.169837 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f163f6-d36d-4cb4-ac2c-7f6d09331ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:34.170305 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f163f6-d36d-4cb4-ac2c-7f6d09331ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:34.170847 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f163f6-d36d-4cb4-ac2c-7f6d09331ca8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:34.175840 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 521/1036] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:14:34.183043 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f163f6-d36d-4cb4-ac2c-7f6d09331ca8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:34.186476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f163f6-d36d-4cb4-ac2c-7f6d09331ca8 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:34.210913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-28f163f6-d36d-4cb4-ac2c-7f6d09331ca8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:14:34.210913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:34.210913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:34.210913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:34.210913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:34.210913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:34.210913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:34.210913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:34.210913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:34.210913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:34.210913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:34.210913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:34.210913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:14:34.210913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:14:34.210913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:14:34.213912 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:14:34.213912 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:34.213912 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:34.213912 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:34.213912 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:34.213912 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:34.213912 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:34.213912 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:34.213912 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:34.213912 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:34.213912 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:34.213912 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:34.213912 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:34.213912 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:34.213912 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:34.213912 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:34.213912 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:34.219754 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:14:34.219754 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:14:34.219754 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:14:34.219754 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:14:34.219754 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:14:34.219754 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:14:34.219754 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:14:34.219754 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:34.222633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 516/1037] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:14:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:34.225681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43475bbb-7457-48b2-afe6-0baa18fa8f11 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:34.287172 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:34.414938 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43475bbb-7457-48b2-afe6-0baa18fa8f11 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:34.473151 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56b8f0-c279-4523-b651-080e0c86673d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:34.473854 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56b8f0-c279-4523-b651-080e0c86673d None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:34.474018 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56b8f0-c279-4523-b651-080e0c86673d None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:34.474392 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56b8f0-c279-4523-b651-080e0c86673d None admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:34.475579 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56b8f0-c279-4523-b651-080e0c86673d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:34.476090 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56b8f0-c279-4523-b651-080e0c86673d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:34.478539 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56b8f0-c279-4523-b651-080e0c86673d None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:34.500731 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 522/1038] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:14:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:34.506024 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f163f6-d36d-4cb4-ac2c-7f6d09331ca8 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:34.519591 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56b8f0-c279-4523-b651-080e0c86673d None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:34.622672 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:34.673236 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:34.687894 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f163f6-d36d-4cb4-ac2c-7f6d09331ca8 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:34.693588 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56b8f0-c279-4523-b651-080e0c86673d None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:34.752519 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f894a36-ae9b-448d-8e01-da869ce8ec35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:34.753769 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f894a36-ae9b-448d-8e01-da869ce8ec35 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:34.754257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f894a36-ae9b-448d-8e01-da869ce8ec35 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:34.754737 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f894a36-ae9b-448d-8e01-da869ce8ec35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:34.756040 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f894a36-ae9b-448d-8e01-da869ce8ec35 None admin] RBAC: Adding query filter params (role.id=029b79624d2f446b91041126ab200822, scope.project.id=da9a86463d68412884746b115667d2fc, user.id=1a0af5bf009b48a8915c7320b16d08dd) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:34.756367 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f894a36-ae9b-448d-8e01-da869ce8ec35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:34.758252 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f894a36-ae9b-448d-8e01-da869ce8ec35 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:34.758431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed2e4e-8f76-4c10-8496-39c02f14a7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:34.759864 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed2e4e-8f76-4c10-8496-39c02f14a7fc None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:34.760416 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed2e4e-8f76-4c10-8496-39c02f14a7fc None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:34.760664 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed2e4e-8f76-4c10-8496-39c02f14a7fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:34.762183 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed2e4e-8f76-4c10-8496-39c02f14a7fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:34.764470 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed2e4e-8f76-4c10-8496-39c02f14a7fc None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:34.766563 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 523/1039] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:14:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:14:34.776322 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 517/1040] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:14:34 2022] GET /identity/v3/role_assignments?user.id=1a0af5bf009b48a8915c7320b16d08dd&scope.project.id=da9a86463d68412884746b115667d2fc&role.id=029b79624d2f446b91041126ab200822 => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:34.776607 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed2e4e-8f76-4c10-8496-39c02f14a7fc None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:34.951938 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed2e4e-8f76-4c10-8496-39c02f14a7fc None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:34.994287 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b6f80-1c75-4d08-bf16-442ed4300995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:34.994812 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b6f80-1c75-4d08-bf16-442ed4300995 None admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:34.995079 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b6f80-1c75-4d08-bf16-442ed4300995 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:34.995342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b6f80-1c75-4d08-bf16-442ed4300995 None admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:34.996006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b6f80-1c75-4d08-bf16-442ed4300995 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:34.997836 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b6f80-1c75-4d08-bf16-442ed4300995 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:35.045411 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 524/1041] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Aug 23 22:14:34 2022] POST /identity/v3/projects => generated 311 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:14:36.742409 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e0df8-d3c7-4815-a88f-e5376866842d None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:36.743276 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e0df8-d3c7-4815-a88f-e5376866842d None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:36.743276 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e0df8-d3c7-4815-a88f-e5376866842d None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:36.745353 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 518/1042] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:36.753156 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb751bb7-c720-4d31-bf8a-ee602df6601e None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:36.753977 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb751bb7-c720-4d31-bf8a-ee602df6601e None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:36.754337 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb751bb7-c720-4d31-bf8a-ee602df6601e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:36.790711 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-cb751bb7-c720-4d31-bf8a-ee602df6601e None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:36.792542 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-cb751bb7-c720-4d31-bf8a-ee602df6601e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:36.799086 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:36.921017 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 525/1043] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:36 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:14:37.268685 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137f850-ff3a-42ea-ba06-e93ca7a3360f None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:37.268962 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137f850-ff3a-42ea-ba06-e93ca7a3360f None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:37.269443 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137f850-ff3a-42ea-ba06-e93ca7a3360f None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:37.271131 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 519/1044] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:14:37.278689 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a5a6b-1a8b-48e4-bc76-4ca5add87888 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:37.279220 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a5a6b-1a8b-48e4-bc76-4ca5add87888 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:37.279606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a5a6b-1a8b-48e4-bc76-4ca5add87888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:37.308200 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-d46a5a6b-1a8b-48e4-bc76-4ca5add87888 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:37.309885 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-d46a5a6b-1a8b-48e4-bc76-4ca5add87888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:37.313792 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137f850-ff3a-42ea-ba06-e93ca7a3360f None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:37.432202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 526/1045] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:37 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:14:37.523718 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137f850-ff3a-42ea-ba06-e93ca7a3360f None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:37.569187 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:37.580903 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae783ccf-41fe-4001-b027-cd361762805f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:37.582185 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae783ccf-41fe-4001-b027-cd361762805f None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:37.582599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae783ccf-41fe-4001-b027-cd361762805f None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:37.583118 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae783ccf-41fe-4001-b027-cd361762805f None admin] PATH_INFO: `/v3/services/image` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:37.584239 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae783ccf-41fe-4001-b027-cd361762805f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:37.588354 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae783ccf-41fe-4001-b027-cd361762805f None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:37.601499 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-ae783ccf-41fe-4001-b027-cd361762805f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:14:37.601499 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:37.601499 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:14:37.601499 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:14:37.601499 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:14:37.601499 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:14:37.601499 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:14:37.601499 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:14:37.601499 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:14:37.601499 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:37.601499 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:14:37.601499 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:37.601499 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:37.601499 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:37.601499 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:37.601499 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:37.601499 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:37.604416 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:37.604416 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:37.604416 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:37.604416 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:37.604416 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:37.604416 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:37.604416 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:14:37.604416 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:14:37.604416 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:14:37.604416 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:14:37.604416 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:37.604416 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:37.604416 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:37.604416 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:37.604416 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:37.604416 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:37.606156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:37.606156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:37.606156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:37.606156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:37.606156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:37.606156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:37.606156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:37.606156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:37.606156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:37.606156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:37.606156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:14:37.606156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:14:37.606156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:14:37.606156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:37.606156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 520/1046] 10.222.0.77 () {56 vars in 1105 bytes} [Tue Aug 23 22:14:37 2022] GET /identity/v3/services/image => generated 86 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:14:37.612043 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a5a6b-1a8b-48e4-bc76-4ca5add87888 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:37.756119 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:37.813410 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a5a6b-1a8b-48e4-bc76-4ca5add87888 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:37.853025 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae783ccf-41fe-4001-b027-cd361762805f None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:37.886025 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b0a3c-bea9-4e1d-a0dc-e0f99f95320d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:37.886838 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b0a3c-bea9-4e1d-a0dc-e0f99f95320d None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:37.887286 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b0a3c-bea9-4e1d-a0dc-e0f99f95320d None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:37.887636 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b0a3c-bea9-4e1d-a0dc-e0f99f95320d None admin] PATH_INFO: `/v3/services` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:37.888453 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b0a3c-bea9-4e1d-a0dc-e0f99f95320d None admin] RBAC: Adding query filter params (name=image) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:37.888763 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b0a3c-bea9-4e1d-a0dc-e0f99f95320d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:37.890641 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b0a3c-bea9-4e1d-a0dc-e0f99f95320d None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:37.900332 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 527/1047] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:14:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:37.902318 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76147fb-75c6-4459-b5a8-ef3e3b8e064c None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:37.902787 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76147fb-75c6-4459-b5a8-ef3e3b8e064c None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:37.903240 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76147fb-75c6-4459-b5a8-ef3e3b8e064c None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:37.905355 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 528/1048] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:37.911067 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76147fb-75c6-4459-b5a8-ef3e3b8e064c None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:38.042036 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae783ccf-41fe-4001-b027-cd361762805f None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:38.090053 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76147fb-75c6-4459-b5a8-ef3e3b8e064c None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:38.091748 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27aaa0-bd35-4a2e-a76a-a5392168d95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:38.092715 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27aaa0-bd35-4a2e-a76a-a5392168d95e None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:38.093233 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27aaa0-bd35-4a2e-a76a-a5392168d95e None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:38.093727 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27aaa0-bd35-4a2e-a76a-a5392168d95e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:38.112065 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd27aaa0-bd35-4a2e-a76a-a5392168d95e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:14:38.122133 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-cd27aaa0-bd35-4a2e-a76a-a5392168d95e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 22:14:38.122133 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:38.122133 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:38.122133 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:38.122133 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:38.122133 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:38.122133 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:38.122133 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:38.122133 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:38.122133 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:38.122133 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:38.122133 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:38.122133 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:14:38.122133 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:14:38.122133 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:14:38.122133 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:14:38.123450 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:14:38.123450 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:14:38.123450 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:14:38.123450 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:14:38.123450 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:38.123450 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:38.123450 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:38.123450 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:38.123450 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:38.123450 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:38.123450 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:38.123450 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:38.123450 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:38.123450 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:38.123450 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:38.123450 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:38.124581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:38.124581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:38.124581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:38.124581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:38.124581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:14:38.124581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:14:38.124581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:14:38.124581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:14:38.124581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:14:38.124581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:14:38.124581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 22:14:38.124581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:38.124581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 521/1049] 10.222.0.77 () {56 vars in 1120 bytes} [Tue Aug 23 22:14:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:14:38.126232 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c953430-2c8d-45ef-bdf3-e24df94b6c0d None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:38.126741 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c953430-2c8d-45ef-bdf3-e24df94b6c0d None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:38.127240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c953430-2c8d-45ef-bdf3-e24df94b6c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:38.157226 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-9c953430-2c8d-45ef-bdf3-e24df94b6c0d None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:38.159328 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-9c953430-2c8d-45ef-bdf3-e24df94b6c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:38.168036 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27051d13-16a3-44dd-b51a-10aaec3a94f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:38.169046 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27051d13-16a3-44dd-b51a-10aaec3a94f4 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:38.169680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27051d13-16a3-44dd-b51a-10aaec3a94f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:38.170083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27051d13-16a3-44dd-b51a-10aaec3a94f4 None admin] PATH_INFO: `/v3/services` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:38.171012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27051d13-16a3-44dd-b51a-10aaec3a94f4 None admin] RBAC: Adding query filter params (type=image) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:38.171300 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27051d13-16a3-44dd-b51a-10aaec3a94f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:38.172770 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27051d13-16a3-44dd-b51a-10aaec3a94f4 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:38.174484 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:38.181709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 529/1050] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:14:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:38.183378 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27051d13-16a3-44dd-b51a-10aaec3a94f4 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:38.245742 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:38.271308 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 522/1051] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:38 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:14:38.272437 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c953430-2c8d-45ef-bdf3-e24df94b6c0d None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:38.359341 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27051d13-16a3-44dd-b51a-10aaec3a94f4 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:38.417904 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3139e4b-5df9-4aa3-b27e-c7e1916c660f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:38.418856 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3139e4b-5df9-4aa3-b27e-c7e1916c660f None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:38.419278 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3139e4b-5df9-4aa3-b27e-c7e1916c660f None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:38.419696 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3139e4b-5df9-4aa3-b27e-c7e1916c660f None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:38.420791 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3139e4b-5df9-4aa3-b27e-c7e1916c660f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:38.421258 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3139e4b-5df9-4aa3-b27e-c7e1916c660f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:38.423093 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3139e4b-5df9-4aa3-b27e-c7e1916c660f None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:38.441439 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 530/1052] 10.222.0.77 () {56 vars in 1115 bytes} [Tue Aug 23 22:14:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:38.448319 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3139e4b-5df9-4aa3-b27e-c7e1916c660f None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:38.451357 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c953430-2c8d-45ef-bdf3-e24df94b6c0d None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:38.516240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ca666-683f-4772-8494-95a9e61e8145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:38.517355 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ca666-683f-4772-8494-95a9e61e8145 None admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:38.517905 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ca666-683f-4772-8494-95a9e61e8145 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:38.518417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ca666-683f-4772-8494-95a9e61e8145 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:38.519735 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ca666-683f-4772-8494-95a9e61e8145 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:38.522537 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ca666-683f-4772-8494-95a9e61e8145 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:38.546223 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:38.569677 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 523/1053] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:14:38 2022] POST /identity/v3/endpoints => generated 327 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:14:38.634793 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3139e4b-5df9-4aa3-b27e-c7e1916c660f None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:38.709646 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ca666-683f-4772-8494-95a9e61e8145 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:38.711661 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33082dfc-d3df-403d-9e9b-1fc1a9735b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:38.712364 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33082dfc-d3df-403d-9e9b-1fc1a9735b54 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:38.712638 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33082dfc-d3df-403d-9e9b-1fc1a9735b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:38.712968 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33082dfc-d3df-403d-9e9b-1fc1a9735b54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:38.742241 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33082dfc-d3df-403d-9e9b-1fc1a9735b54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:38.745238 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33082dfc-d3df-403d-9e9b-1fc1a9735b54 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:38.770862 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-33082dfc-d3df-403d-9e9b-1fc1a9735b54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:14:38.770862 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:38.770862 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:38.770862 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:38.770862 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:38.770862 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:38.770862 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:38.770862 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:38.770862 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:38.770862 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:38.770862 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:38.770862 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:38.770862 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:14:38.770862 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:14:38.770862 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:14:38.770862 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:14:38.773536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:38.773536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:38.773536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:38.773536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:38.773536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:38.773536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:38.773536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:38.773536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:38.773536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:38.773536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:38.773536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:38.773536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:38.773536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:38.773536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:38.773536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:38.773536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:38.773536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:14:38.775682 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:14:38.775682 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:14:38.775682 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:38.775682 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 531/1054] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:14:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:38.783447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33082dfc-d3df-403d-9e9b-1fc1a9735b54 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:38.808253 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:38.934406 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ca666-683f-4772-8494-95a9e61e8145 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:38.963879 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33082dfc-d3df-403d-9e9b-1fc1a9735b54 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:38.976871 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:38.989949 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c75d7e-94b9-45e7-96dc-ef6c6ea27573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:38.990863 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c75d7e-94b9-45e7-96dc-ef6c6ea27573 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:38.991145 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c75d7e-94b9-45e7-96dc-ef6c6ea27573 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:38.991420 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c75d7e-94b9-45e7-96dc-ef6c6ea27573 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:38.993901 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c75d7e-94b9-45e7-96dc-ef6c6ea27573 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:38.996752 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c75d7e-94b9-45e7-96dc-ef6c6ea27573 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:39.000490 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 524/1055] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:14:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:14:39.009897 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c75d7e-94b9-45e7-96dc-ef6c6ea27573 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:39.023741 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b53e05-168e-40b5-a0aa-2ccfc64352a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:39.026708 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b53e05-168e-40b5-a0aa-2ccfc64352a2 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:39.029193 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b53e05-168e-40b5-a0aa-2ccfc64352a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:39.029831 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b53e05-168e-40b5-a0aa-2ccfc64352a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:39.030881 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b53e05-168e-40b5-a0aa-2ccfc64352a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:39.031381 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b53e05-168e-40b5-a0aa-2ccfc64352a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:39.033567 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b53e05-168e-40b5-a0aa-2ccfc64352a2 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:39.063259 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 532/1056] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:14:39.065474 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b53e05-168e-40b5-a0aa-2ccfc64352a2 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:39.216988 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c75d7e-94b9-45e7-96dc-ef6c6ea27573 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:39.235079 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:39.264508 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b53e05-168e-40b5-a0aa-2ccfc64352a2 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:39.279190 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158dacf-659b-4971-bd93-51b0adf2f36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:39.279926 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158dacf-659b-4971-bd93-51b0adf2f36e None admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:39.280210 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158dacf-659b-4971-bd93-51b0adf2f36e None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:39.280490 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158dacf-659b-4971-bd93-51b0adf2f36e None admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:39.281220 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9158dacf-659b-4971-bd93-51b0adf2f36e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:39.283172 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9158dacf-659b-4971-bd93-51b0adf2f36e None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:39.318245 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedd1ad-459a-4e81-a731-6138c994861c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:39.319507 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedd1ad-459a-4e81-a731-6138c994861c None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:39.320084 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedd1ad-459a-4e81-a731-6138c994861c None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:39.320535 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedd1ad-459a-4e81-a731-6138c994861c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:39.322930 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 525/1057] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Aug 23 22:14:39 2022] POST /identity/v3/users => generated 285 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:14:39.343085 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aedd1ad-459a-4e81-a731-6138c994861c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:39.345879 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aedd1ad-459a-4e81-a731-6138c994861c None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:39.366014 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-4aedd1ad-459a-4e81-a731-6138c994861c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:14:39.366014 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:39.366014 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:39.366014 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:39.366014 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:39.366014 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:39.366014 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:39.366014 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:39.366014 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:39.366014 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:39.366014 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:39.366014 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:39.366014 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:14:39.366014 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:14:39.366014 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:14:39.366014 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:14:39.367740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:39.367740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:39.367740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:14:39.367740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:14:39.367740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:14:39.367740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:14:39.367740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:39.367740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:39.367740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:39.367740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:39.367740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:39.367740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:39.367740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:39.367740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:39.367740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:39.367740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:39.367740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:39.367740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:39.369253 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:39.369253 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:39.369253 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:14:39.369253 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:14:39.369253 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:14:39.369253 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:14:39.369253 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:14:39.369253 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:14:39.369253 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:14:39.369253 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:39.374497 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 533/1058] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Aug 23 22:14:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:39.376887 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158dacf-659b-4971-bd93-51b0adf2f36e None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:39.563126 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158dacf-659b-4971-bd93-51b0adf2f36e None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:39.611344 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8ddab-26a3-47dc-bcbc-3cfa1a6796d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:39.612037 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8ddab-26a3-47dc-bcbc-3cfa1a6796d7 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:39.612320 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8ddab-26a3-47dc-bcbc-3cfa1a6796d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:39.612590 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8ddab-26a3-47dc-bcbc-3cfa1a6796d7 None admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:39.613570 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8ddab-26a3-47dc-bcbc-3cfa1a6796d7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:39.613877 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8ddab-26a3-47dc-bcbc-3cfa1a6796d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:39.615349 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8ddab-26a3-47dc-bcbc-3cfa1a6796d7 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:39.649217 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 526/1059] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Aug 23 22:14:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:39.662104 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedd1ad-459a-4e81-a731-6138c994861c None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:39.719826 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:39.864111 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedd1ad-459a-4e81-a731-6138c994861c None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:39.926273 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568e4b1-2a37-4a80-8a6b-dda2da1af61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:39.927319 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568e4b1-2a37-4a80-8a6b-dda2da1af61b None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:39.927785 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568e4b1-2a37-4a80-8a6b-dda2da1af61b None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:39.928238 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568e4b1-2a37-4a80-8a6b-dda2da1af61b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:39.949528 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568e4b1-2a37-4a80-8a6b-dda2da1af61b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:39.952225 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568e4b1-2a37-4a80-8a6b-dda2da1af61b None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:39.981389 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-6568e4b1-2a37-4a80-8a6b-dda2da1af61b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:14:39.981389 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:39.981389 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:39.981389 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:39.981389 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:39.981389 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:39.981389 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:39.981389 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:39.981389 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:39.981389 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:39.981389 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:39.981389 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:39.981389 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:14:39.981389 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:14:39.981389 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:14:39.981389 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:14:39.982421 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:39.982421 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:39.982421 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:39.982421 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:39.982421 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:39.982421 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:39.982421 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:39.982421 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:39.982421 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:39.982421 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:39.982421 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:39.982421 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:39.982421 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:39.982421 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:39.982421 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:39.982421 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:39.982421 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:14:39.983379 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:14:39.983379 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:14:39.983379 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:39.985447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 534/1060] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:14:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:39.993820 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8ddab-26a3-47dc-bcbc-3cfa1a6796d7 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:40.038741 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:40.189175 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8ddab-26a3-47dc-bcbc-3cfa1a6796d7 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:40.235498 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11cf18-d012-4cbb-875e-a343014972fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:40.236306 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11cf18-d012-4cbb-875e-a343014972fa None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:40.236718 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11cf18-d012-4cbb-875e-a343014972fa None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:40.237138 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11cf18-d012-4cbb-875e-a343014972fa None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:40.237981 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf11cf18-d012-4cbb-875e-a343014972fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:40.238411 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf11cf18-d012-4cbb-875e-a343014972fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:40.239993 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf11cf18-d012-4cbb-875e-a343014972fa None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:40.258093 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 527/1061] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:40.259553 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568e4b1-2a37-4a80-8a6b-dda2da1af61b None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:40.356413 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:40.391302 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568e4b1-2a37-4a80-8a6b-dda2da1af61b None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:40.459564 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd756d63-2d22-4c18-b6c3-527adadec72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:40.460530 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd756d63-2d22-4c18-b6c3-527adadec72b None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:40.460983 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd756d63-2d22-4c18-b6c3-527adadec72b None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:40.461454 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd756d63-2d22-4c18-b6c3-527adadec72b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:40.475327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd756d63-2d22-4c18-b6c3-527adadec72b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:40.478195 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd756d63-2d22-4c18-b6c3-527adadec72b None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:40.500396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-bd756d63-2d22-4c18-b6c3-527adadec72b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:14:40.500396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:40.500396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:40.500396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:40.500396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:40.500396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:40.500396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:40.500396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:40.500396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:40.500396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:40.500396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:40.500396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:40.500396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:14:40.500396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:14:40.500396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:14:40.502739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:14:40.502739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:40.502739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:40.502739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:40.502739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:40.502739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:40.502739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:40.502739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:40.502739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:40.502739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:40.502739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:40.502739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:40.502739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:40.502739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:40.502739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:40.502739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:40.502739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:40.504592 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:14:40.504592 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:14:40.504592 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:14:40.504592 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:14:40.504592 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:14:40.504592 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:14:40.504592 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:14:40.504592 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:40.504592 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 535/1062] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:14:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:14:40.509947 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11cf18-d012-4cbb-875e-a343014972fa None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:40.667517 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:40.717806 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11cf18-d012-4cbb-875e-a343014972fa None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:40.816150 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d39168-861e-4434-9c8a-bb3f768e8e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:40.817350 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d39168-861e-4434-9c8a-bb3f768e8e0d None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:40.817883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d39168-861e-4434-9c8a-bb3f768e8e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:40.818365 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d39168-861e-4434-9c8a-bb3f768e8e0d None admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:40.819698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d39168-861e-4434-9c8a-bb3f768e8e0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:40.820242 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d39168-861e-4434-9c8a-bb3f768e8e0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:40.825656 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d39168-861e-4434-9c8a-bb3f768e8e0d None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:40.861936 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 528/1063] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:14:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:14:40.863710 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd756d63-2d22-4c18-b6c3-527adadec72b None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:40.999298 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd756d63-2d22-4c18-b6c3-527adadec72b None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:41.048289 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09d6a9-cd24-4cba-a98f-177de5f22383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:41.049043 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09d6a9-cd24-4cba-a98f-177de5f22383 None admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:41.049331 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09d6a9-cd24-4cba-a98f-177de5f22383 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:41.049654 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09d6a9-cd24-4cba-a98f-177de5f22383 None admin] PATH_INFO: `/v3/projects/da9a86463d68412884746b115667d2fc/users/1a0af5bf009b48a8915c7320b16d08dd/roles/029b79624d2f446b91041126ab200822` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:41.052090 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09d6a9-cd24-4cba-a98f-177de5f22383 None admin] RBAC: Authorizing `identity:create_grant(project_id=da9a86463d68412884746b115667d2fc, user_id=1a0af5bf009b48a8915c7320b16d08dd, role_id=029b79624d2f446b91041126ab200822)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:41.053601 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09d6a9-cd24-4cba-a98f-177de5f22383 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:41.068638 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:41.089425 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 536/1064] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Aug 23 22:14:40 2022] PUT /identity/v3/projects/da9a86463d68412884746b115667d2fc/users/1a0af5bf009b48a8915c7320b16d08dd/roles/029b79624d2f446b91041126ab200822 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:14:41.807674 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a4dd8-7ffe-43a0-9905-ca9515c6e894 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:41.808480 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a4dd8-7ffe-43a0-9905-ca9515c6e894 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:41.808657 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a4dd8-7ffe-43a0-9905-ca9515c6e894 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:41.811793 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 529/1065] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:41.820775 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c20d9f-f8e4-40d5-9e8b-269f0c5cd5b2 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:41.821318 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c20d9f-f8e4-40d5-9e8b-269f0c5cd5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:41.821923 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c20d9f-f8e4-40d5-9e8b-269f0c5cd5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:41.853832 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-25c20d9f-f8e4-40d5-9e8b-269f0c5cd5b2 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:41.855933 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-25c20d9f-f8e4-40d5-9e8b-269f0c5cd5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:41.989822 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 537/1066] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:14:42.310785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740db8f5-9729-4a10-a614-c76622f8d142 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:42.311286 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740db8f5-9729-4a10-a614-c76622f8d142 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:42.311774 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740db8f5-9729-4a10-a614-c76622f8d142 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:42.314497 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 530/1067] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:42.320689 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46022733-a942-4222-91e9-04118c759ca2 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:42.322039 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46022733-a942-4222-91e9-04118c759ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:42.322039 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46022733-a942-4222-91e9-04118c759ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:42.343747 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-46022733-a942-4222-91e9-04118c759ca2 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:42.344989 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-46022733-a942-4222-91e9-04118c759ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:42.465438 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 538/1068] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:14:42.512047 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740db8f5-9729-4a10-a614-c76622f8d142 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:42.713540 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740db8f5-9729-4a10-a614-c76622f8d142 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:42.769240 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46022733-a942-4222-91e9-04118c759ca2 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:42.793563 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ec8e7-0422-45d7-896d-7197bffb7ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:42.794563 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ec8e7-0422-45d7-896d-7197bffb7ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:42.795543 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ec8e7-0422-45d7-896d-7197bffb7ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:42.795543 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ec8e7-0422-45d7-896d-7197bffb7ee6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:42.828156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:42.859039 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:42.927225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ec8e7-0422-45d7-896d-7197bffb7ee6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:42.929708 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ec8e7-0422-45d7-896d-7197bffb7ee6 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:42.943505 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46022733-a942-4222-91e9-04118c759ca2 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:43.015965 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245e7f0-5af1-49e8-b177-e67f292605a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:43.016973 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245e7f0-5af1-49e8-b177-e67f292605a2 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:43.017461 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245e7f0-5af1-49e8-b177-e67f292605a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:43.017944 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245e7f0-5af1-49e8-b177-e67f292605a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:43.039054 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a245e7f0-5af1-49e8-b177-e67f292605a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:14:43.049742 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-a245e7f0-5af1-49e8-b177-e67f292605a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:14:43.049742 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:43.049742 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:43.049742 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:43.049742 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:43.049742 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:43.049742 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:43.049742 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:43.049742 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:43.049742 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:43.049742 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:43.049742 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:43.049742 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:14:43.049742 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:14:43.049742 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:14:43.049742 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:14:43.050968 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:14:43.050968 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:14:43.050968 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:14:43.050968 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:14:43.050968 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:43.050968 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:43.050968 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:43.050968 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:43.050968 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:43.050968 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:43.050968 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:43.050968 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:43.050968 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:43.050968 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:43.050968 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:43.050968 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:43.051933 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:43.051933 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:43.051933 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:43.051933 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:43.051933 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:14:43.051933 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:14:43.051933 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:14:43.051933 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:14:43.051933 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:14:43.051933 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:14:43.051933 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:14:43.051933 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:43.051933 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 539/1069] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:14:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:14:43.063276 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245e7f0-5af1-49e8-b177-e67f292605a2 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:43.118919 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 531/1070] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:14:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:14:43.128560 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ec8e7-0422-45d7-896d-7197bffb7ee6 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:43.206538 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:43.233780 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245e7f0-5af1-49e8-b177-e67f292605a2 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:43.260506 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:43.280183 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86650fab-f975-4b34-abf5-7c7f6d2fc17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:43.280954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86650fab-f975-4b34-abf5-7c7f6d2fc17e None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:43.281432 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86650fab-f975-4b34-abf5-7c7f6d2fc17e None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:43.281849 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86650fab-f975-4b34-abf5-7c7f6d2fc17e None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:43.282672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86650fab-f975-4b34-abf5-7c7f6d2fc17e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:43.283103 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86650fab-f975-4b34-abf5-7c7f6d2fc17e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:43.284859 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86650fab-f975-4b34-abf5-7c7f6d2fc17e None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:43.301424 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 540/1071] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:14:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:14:43.303610 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86650fab-f975-4b34-abf5-7c7f6d2fc17e None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:43.316326 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ec8e7-0422-45d7-896d-7197bffb7ee6 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:43.375849 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e6a694-5bcd-4f48-9045-737c1ed6d8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:43.377007 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6a694-5bcd-4f48-9045-737c1ed6d8ad None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:43.377553 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6a694-5bcd-4f48-9045-737c1ed6d8ad None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:43.378039 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6a694-5bcd-4f48-9045-737c1ed6d8ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:43.403349 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e6a694-5bcd-4f48-9045-737c1ed6d8ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:43.407656 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e6a694-5bcd-4f48-9045-737c1ed6d8ad None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:43.439407 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-42e6a694-5bcd-4f48-9045-737c1ed6d8ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:14:43.439407 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:43.439407 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:43.439407 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:43.439407 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:43.439407 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:43.439407 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:43.439407 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:43.439407 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:43.439407 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:43.439407 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:43.439407 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:43.439407 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:14:43.439407 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:14:43.439407 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:14:43.439407 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:14:43.442239 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:43.442239 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:43.442239 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:43.442239 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:43.442239 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:43.442239 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:43.442239 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:43.442239 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:43.442239 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:43.442239 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:43.442239 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:43.442239 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:43.442239 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:43.442239 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:43.442239 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:43.442239 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:43.442239 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:14:43.444681 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:14:43.444681 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:14:43.444681 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:43.444681 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 532/1072] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:14:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:14:43.444681 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a70ee0-9665-437b-ba35-7fed6af7f0da None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:43.444681 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a70ee0-9665-437b-ba35-7fed6af7f0da None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:43.444681 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a70ee0-9665-437b-ba35-7fed6af7f0da None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:43.445621 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 533/1073] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:43.450433 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a70ee0-9665-437b-ba35-7fed6af7f0da None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:43.457610 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86650fab-f975-4b34-abf5-7c7f6d2fc17e None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:43.505188 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb2da6-c7ad-4120-9ce6-cc86c73b18e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:43.505981 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb2da6-c7ad-4120-9ce6-cc86c73b18e7 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:43.506346 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb2da6-c7ad-4120-9ce6-cc86c73b18e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:43.506677 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb2da6-c7ad-4120-9ce6-cc86c73b18e7 None admin] PATH_INFO: `/v3/users/d619ae2e75a44a5b95d13a142d9c5bbd` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:43.525278 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb2da6-c7ad-4120-9ce6-cc86c73b18e7 None admin] RBAC: Authorizing `identity:get_user(user_id=d619ae2e75a44a5b95d13a142d9c5bbd)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:43.527196 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb2da6-c7ad-4120-9ce6-cc86c73b18e7 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:43.529594 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 541/1074] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:14:43 2022] GET /identity/v3/users/d619ae2e75a44a5b95d13a142d9c5bbd => generated 285 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:43.531470 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecba2b-a494-4e9a-a5aa-f031c2c193b0 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:43.532015 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecba2b-a494-4e9a-a5aa-f031c2c193b0 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:43.532408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecba2b-a494-4e9a-a5aa-f031c2c193b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:43.554746 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-64ecba2b-a494-4e9a-a5aa-f031c2c193b0 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:43.556871 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-64ecba2b-a494-4e9a-a5aa-f031c2c193b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:43.588441 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:43.599493 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a70ee0-9665-437b-ba35-7fed6af7f0da None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:43.604691 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:43.648462 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c6799-a4e8-419a-9972-e5a4cf8f8576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:43.649819 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c6799-a4e8-419a-9972-e5a4cf8f8576 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:43.650162 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c6799-a4e8-419a-9972-e5a4cf8f8576 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:43.650614 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c6799-a4e8-419a-9972-e5a4cf8f8576 None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:43.650809 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 542/1075] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:14:43.651765 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c6799-a4e8-419a-9972-e5a4cf8f8576 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:43.651951 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ecba2b-a494-4e9a-a5aa-f031c2c193b0 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:43.652366 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c6799-a4e8-419a-9972-e5a4cf8f8576 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:43.654948 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c6799-a4e8-419a-9972-e5a4cf8f8576 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:43.689402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 534/1076] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:14:43.879598 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ecba2b-a494-4e9a-a5aa-f031c2c193b0 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:43.929011 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3110382-1579-4306-b51e-84b6bc458429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:43.929851 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3110382-1579-4306-b51e-84b6bc458429 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:43.930303 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3110382-1579-4306-b51e-84b6bc458429 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:43.931227 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3110382-1579-4306-b51e-84b6bc458429 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:43.962643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c6799-a4e8-419a-9972-e5a4cf8f8576 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:43.999266 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:44.050999 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3110382-1579-4306-b51e-84b6bc458429 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:44.053008 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3110382-1579-4306-b51e-84b6bc458429 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:44.140019 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c6799-a4e8-419a-9972-e5a4cf8f8576 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:44.186151 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdd475-49da-4a58-b324-4d6cb8f795b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:44.186839 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdd475-49da-4a58-b324-4d6cb8f795b4 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:44.187197 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdd475-49da-4a58-b324-4d6cb8f795b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:44.187562 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdd475-49da-4a58-b324-4d6cb8f795b4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:44.193225 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 543/1077] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:14:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:14:44.199896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bdd475-49da-4a58-b324-4d6cb8f795b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:14:44.200170 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3110382-1579-4306-b51e-84b6bc458429 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:44.205159 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-83bdd475-49da-4a58-b324-4d6cb8f795b4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 22:14:44.205159 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:44.205159 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:44.205159 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:44.205159 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:44.205159 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:44.205159 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:44.205159 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:44.205159 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:44.205159 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:44.205159 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:44.205159 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:44.205159 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:14:44.205159 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:14:44.205159 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:14:44.205159 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:14:44.207196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:14:44.207196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:14:44.207196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:14:44.207196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:14:44.207196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:44.207196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:44.207196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:44.207196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:44.207196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:44.207196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:44.207196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:44.207196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:44.207196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:44.207196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:44.207196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:44.207196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:44.209096 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:44.209096 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:44.209096 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:44.209096 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:44.209096 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:14:44.209096 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:14:44.209096 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:14:44.209096 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:14:44.209096 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:14:44.209096 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:14:44.209096 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 22:14:44.209096 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:44.209096 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 535/1078] 10.222.0.77 () {56 vars in 1120 bytes} [Tue Aug 23 22:14:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:14:44.215490 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdd475-49da-4a58-b324-4d6cb8f795b4 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:44.237705 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:44.285620 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:44.326294 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3110382-1579-4306-b51e-84b6bc458429 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:44.342501 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdd475-49da-4a58-b324-4d6cb8f795b4 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:44.368426 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68ee07-1f75-4f49-a724-e778f25091b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:44.369207 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68ee07-1f75-4f49-a724-e778f25091b4 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:44.369646 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68ee07-1f75-4f49-a724-e778f25091b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:44.370040 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68ee07-1f75-4f49-a724-e778f25091b4 None admin] PATH_INFO: `/v3/projects/bb3d203487a349d2a09291beb69f3c8c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:44.371440 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68ee07-1f75-4f49-a724-e778f25091b4 None admin] RBAC: Authorizing `identity:get_project(project_id=bb3d203487a349d2a09291beb69f3c8c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:44.373221 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68ee07-1f75-4f49-a724-e778f25091b4 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:44.375415 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 544/1079] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:14:44 2022] GET /identity/v3/projects/bb3d203487a349d2a09291beb69f3c8c => generated 311 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:14:44.383075 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68ee07-1f75-4f49-a724-e778f25091b4 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:44.386535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c1553-82be-4736-87c3-56217377b174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:44.387484 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c1553-82be-4736-87c3-56217377b174 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:44.387912 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c1553-82be-4736-87c3-56217377b174 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:44.388341 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c1553-82be-4736-87c3-56217377b174 None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:44.389405 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0c1553-82be-4736-87c3-56217377b174 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:44.389771 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0c1553-82be-4736-87c3-56217377b174 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:44.391967 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0c1553-82be-4736-87c3-56217377b174 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:44.405179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 536/1080] 10.222.0.77 () {56 vars in 1115 bytes} [Tue Aug 23 22:14:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:14:44.411754 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c1553-82be-4736-87c3-56217377b174 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:44.516700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:44.521610 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68ee07-1f75-4f49-a724-e778f25091b4 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:44.544329 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c1553-82be-4736-87c3-56217377b174 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:44.587034 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d5f8b-1e03-47a4-94e3-25897368b8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:44.588170 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d5f8b-1e03-47a4-94e3-25897368b8c8 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:44.588697 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d5f8b-1e03-47a4-94e3-25897368b8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:44.589149 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d5f8b-1e03-47a4-94e3-25897368b8c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:44.590626 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d5f8b-1e03-47a4-94e3-25897368b8c8 None admin] RBAC: Adding query filter params (role.id=e806ce849cf34b92979b5524f3ea9ff6, scope.project.id=bb3d203487a349d2a09291beb69f3c8c, user.id=d619ae2e75a44a5b95d13a142d9c5bbd) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:44.591184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71f87b-3fd2-4dde-8718-e2f9a8cec9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:44.591572 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d5f8b-1e03-47a4-94e3-25897368b8c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:44.591996 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71f87b-3fd2-4dde-8718-e2f9a8cec9e6 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:44.592283 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71f87b-3fd2-4dde-8718-e2f9a8cec9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:44.592569 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71f87b-3fd2-4dde-8718-e2f9a8cec9e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:44.594023 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d5f8b-1e03-47a4-94e3-25897368b8c8 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:44.606380 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 545/1081] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:14:44 2022] GET /identity/v3/role_assignments?user.id=d619ae2e75a44a5b95d13a142d9c5bbd&scope.project.id=bb3d203487a349d2a09291beb69f3c8c&role.id=e806ce849cf34b92979b5524f3ea9ff6 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:14:44.608050 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71f87b-3fd2-4dde-8718-e2f9a8cec9e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:44.610104 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71f87b-3fd2-4dde-8718-e2f9a8cec9e6 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:44.630711 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-de71f87b-3fd2-4dde-8718-e2f9a8cec9e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:14:44.630711 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:44.630711 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:44.630711 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:44.630711 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:44.630711 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:44.630711 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:44.630711 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:44.630711 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:44.630711 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:44.630711 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:44.630711 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:44.630711 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:14:44.630711 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:14:44.630711 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:14:44.630711 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:14:44.632714 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:44.632714 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:44.632714 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:44.632714 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:44.632714 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:44.632714 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:44.632714 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:44.632714 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:44.632714 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:44.632714 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:44.632714 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:44.632714 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:44.632714 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:44.632714 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:44.632714 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:44.632714 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:44.632714 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:14:44.634436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:14:44.634436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:14:44.634436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:44.634436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 537/1082] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:14:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:14:44.640630 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d5f8b-1e03-47a4-94e3-25897368b8c8 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:44.645587 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:44.816244 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d5f8b-1e03-47a4-94e3-25897368b8c8 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:44.858343 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2c999-7e1f-49c3-94f6-94a982844595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:44.859081 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2c999-7e1f-49c3-94f6-94a982844595 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:44.859420 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2c999-7e1f-49c3-94f6-94a982844595 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:44.859754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2c999-7e1f-49c3-94f6-94a982844595 None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:44.860500 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2c999-7e1f-49c3-94f6-94a982844595 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:44.860865 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2c999-7e1f-49c3-94f6-94a982844595 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:44.862410 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2c999-7e1f-49c3-94f6-94a982844595 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:44.885453 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 546/1083] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:44.886735 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71f87b-3fd2-4dde-8718-e2f9a8cec9e6 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:45.019174 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71f87b-3fd2-4dde-8718-e2f9a8cec9e6 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:45.072820 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:45.082296 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f0b0d-3bd6-40b0-b722-04217d094969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:45.083377 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f0b0d-3bd6-40b0-b722-04217d094969 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:45.083880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f0b0d-3bd6-40b0-b722-04217d094969 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:45.084364 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f0b0d-3bd6-40b0-b722-04217d094969 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:45.099404 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f0b0d-3bd6-40b0-b722-04217d094969 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:45.102802 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f0b0d-3bd6-40b0-b722-04217d094969 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:45.124852 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-8c2f0b0d-3bd6-40b0-b722-04217d094969 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:14:45.124852 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:45.124852 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:45.124852 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:45.124852 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:45.124852 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:45.124852 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:45.124852 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:45.124852 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:45.124852 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:45.124852 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:45.124852 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:45.124852 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:14:45.124852 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:14:45.124852 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:14:45.124852 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:14:45.126942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:45.126942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:45.126942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:14:45.126942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:14:45.126942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:14:45.126942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:14:45.126942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:45.126942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:45.126942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:45.126942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:45.126942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:45.126942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:45.126942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:45.126942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:45.126942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:45.126942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:45.126942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:45.126942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:45.133669 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:45.133669 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:45.133669 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:14:45.133669 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:14:45.133669 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:14:45.133669 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:14:45.133669 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:14:45.133669 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:14:45.133669 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:14:45.133669 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:45.133669 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 538/1084] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Aug 23 22:14:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:14:45.135712 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2c999-7e1f-49c3-94f6-94a982844595 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:45.254391 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:45.333747 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2c999-7e1f-49c3-94f6-94a982844595 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:45.406778 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7061c-f95b-4f13-97d4-2bee145f35ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:45.407832 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7061c-f95b-4f13-97d4-2bee145f35ca None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:45.408315 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7061c-f95b-4f13-97d4-2bee145f35ca None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:45.408790 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7061c-f95b-4f13-97d4-2bee145f35ca None admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:45.410267 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7061c-f95b-4f13-97d4-2bee145f35ca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:45.410801 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7061c-f95b-4f13-97d4-2bee145f35ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:45.413562 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7061c-f95b-4f13-97d4-2bee145f35ca None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:45.451254 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 547/1085] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Aug 23 22:14:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:45.460854 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f0b0d-3bd6-40b0-b722-04217d094969 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:45.693060 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f0b0d-3bd6-40b0-b722-04217d094969 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:45.762802 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d8950-35f9-4f1e-9aee-047825af40a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:45.763730 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d8950-35f9-4f1e-9aee-047825af40a1 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:45.764159 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d8950-35f9-4f1e-9aee-047825af40a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:45.764579 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d8950-35f9-4f1e-9aee-047825af40a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:45.849950 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:45.869848 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d8950-35f9-4f1e-9aee-047825af40a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:45.872597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d8950-35f9-4f1e-9aee-047825af40a1 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:46.076202 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 539/1086] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:14:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:14:46.079123 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7061c-f95b-4f13-97d4-2bee145f35ca None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:46.235799 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7061c-f95b-4f13-97d4-2bee145f35ca None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:46.260241 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:46.278384 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33438a20-501d-4c59-95ec-2e1c5645a854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:46.279171 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33438a20-501d-4c59-95ec-2e1c5645a854 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:46.279539 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33438a20-501d-4c59-95ec-2e1c5645a854 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:46.279925 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33438a20-501d-4c59-95ec-2e1c5645a854 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:46.296365 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33438a20-501d-4c59-95ec-2e1c5645a854 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:46.297887 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33438a20-501d-4c59-95ec-2e1c5645a854 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:46.316585 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-33438a20-501d-4c59-95ec-2e1c5645a854 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:14:46.316585 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:46.316585 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:46.316585 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:46.316585 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:46.316585 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:46.316585 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:46.316585 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:46.316585 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:46.316585 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:46.316585 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:46.316585 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:46.316585 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:14:46.316585 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:14:46.316585 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:14:46.316585 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:14:46.318954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:46.318954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:46.318954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:46.318954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:46.318954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:46.318954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:46.318954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:46.318954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:46.318954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:46.318954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:46.318954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:46.318954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:46.318954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:46.318954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:46.318954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:46.318954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:46.318954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:14:46.321520 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:14:46.321520 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:14:46.321520 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:46.321520 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 548/1087] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:14:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:46.324552 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d8950-35f9-4f1e-9aee-047825af40a1 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:46.437713 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:46.456083 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d8950-35f9-4f1e-9aee-047825af40a1 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:46.515982 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e288f0-bca3-4c14-b644-23e27789ff8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:46.517014 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e288f0-bca3-4c14-b644-23e27789ff8f None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:46.517552 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e288f0-bca3-4c14-b644-23e27789ff8f None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:46.518029 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e288f0-bca3-4c14-b644-23e27789ff8f None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:46.519220 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e288f0-bca3-4c14-b644-23e27789ff8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:46.519737 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e288f0-bca3-4c14-b644-23e27789ff8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:46.522343 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e288f0-bca3-4c14-b644-23e27789ff8f None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:46.546847 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 540/1088] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:14:46.556678 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33438a20-501d-4c59-95ec-2e1c5645a854 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:46.764001 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33438a20-501d-4c59-95ec-2e1c5645a854 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:46.825246 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39166eaa-3ea5-40f1-aec3-034a9562ae12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:46.826064 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39166eaa-3ea5-40f1-aec3-034a9562ae12 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:46.826460 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39166eaa-3ea5-40f1-aec3-034a9562ae12 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:46.826880 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39166eaa-3ea5-40f1-aec3-034a9562ae12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:46.836157 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39166eaa-3ea5-40f1-aec3-034a9562ae12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:46.838296 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39166eaa-3ea5-40f1-aec3-034a9562ae12 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:46.854793 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-39166eaa-3ea5-40f1-aec3-034a9562ae12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:14:46.854793 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:46.854793 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:46.854793 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:46.854793 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:46.854793 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:46.854793 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:46.854793 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:46.854793 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:46.854793 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:46.854793 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:46.854793 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:46.854793 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:14:46.854793 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:14:46.854793 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:14:46.856549 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:14:46.856549 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:46.856549 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:46.856549 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:46.856549 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:46.856549 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:46.856549 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:46.856549 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:46.856549 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:46.856549 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:46.856549 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:46.856549 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:46.856549 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:46.856549 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:46.856549 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:46.856549 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:46.856549 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:46.858363 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:14:46.858363 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:14:46.858363 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:14:46.858363 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:14:46.858363 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:14:46.858363 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:14:46.858363 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:14:46.858363 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:46.858363 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 549/1089] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:14:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:14:46.862544 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e288f0-bca3-4c14-b644-23e27789ff8f None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:47.056002 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e288f0-bca3-4c14-b644-23e27789ff8f None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:47.120678 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8fb76-ed4f-4172-b90e-107d21675a95 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:47.121484 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8fb76-ed4f-4172-b90e-107d21675a95 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:47.121691 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8fb76-ed4f-4172-b90e-107d21675a95 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:47.123391 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d217b2e-0edf-4451-9774-7c10ec29d1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:47.124240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d217b2e-0edf-4451-9774-7c10ec29d1df None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:47.124374 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 550/1090] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:47.124631 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d217b2e-0edf-4451-9774-7c10ec29d1df None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:47.124966 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d217b2e-0edf-4451-9774-7c10ec29d1df None admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:47.126262 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d217b2e-0edf-4451-9774-7c10ec29d1df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:47.126822 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d217b2e-0edf-4451-9774-7c10ec29d1df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:47.129102 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d217b2e-0edf-4451-9774-7c10ec29d1df None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:47.134697 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe00f8-a19b-4286-8f7f-5b694c9bb5c7 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:47.135191 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe00f8-a19b-4286-8f7f-5b694c9bb5c7 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:47.135685 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe00f8-a19b-4286-8f7f-5b694c9bb5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:47.146136 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 541/1091] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:14:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:14:47.152998 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d217b2e-0edf-4451-9774-7c10ec29d1df None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:47.167278 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-cfbe00f8-a19b-4286-8f7f-5b694c9bb5c7 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:47.168367 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:47.169195 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-cfbe00f8-a19b-4286-8f7f-5b694c9bb5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:47.216100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:47.268973 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 551/1092] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:14:47.281961 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d217b2e-0edf-4451-9774-7c10ec29d1df None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:47.317934 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdda52-5087-4a13-96cf-a50cbcede830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:47.318456 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdda52-5087-4a13-96cf-a50cbcede830 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:47.318735 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdda52-5087-4a13-96cf-a50cbcede830 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:47.319010 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdda52-5087-4a13-96cf-a50cbcede830 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:47.319800 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdda52-5087-4a13-96cf-a50cbcede830 None admin] RBAC: Adding query filter params (role.id=029b79624d2f446b91041126ab200822, scope.project.id=da9a86463d68412884746b115667d2fc, user.id=1a0af5bf009b48a8915c7320b16d08dd) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:47.320087 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdda52-5087-4a13-96cf-a50cbcede830 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:47.322232 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdda52-5087-4a13-96cf-a50cbcede830 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:47.329097 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 542/1093] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:14:47 2022] GET /identity/v3/role_assignments?user.id=1a0af5bf009b48a8915c7320b16d08dd&scope.project.id=da9a86463d68412884746b115667d2fc&role.id=029b79624d2f446b91041126ab200822 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:14:47.553458 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe00f8-a19b-4286-8f7f-5b694c9bb5c7 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:47.686001 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe00f8-a19b-4286-8f7f-5b694c9bb5c7 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:47.735608 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc2c97-8148-4587-b803-719a051fda68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:47.736654 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc2c97-8148-4587-b803-719a051fda68 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:47.737130 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc2c97-8148-4587-b803-719a051fda68 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:47.737637 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc2c97-8148-4587-b803-719a051fda68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:47.752296 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc2c97-8148-4587-b803-719a051fda68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:14:47.757693 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-2ccc2c97-8148-4587-b803-719a051fda68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:14:47.757693 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:47.757693 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:47.757693 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:47.757693 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:47.757693 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:47.757693 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:47.757693 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:47.757693 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:47.757693 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:47.757693 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:47.757693 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:47.757693 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:14:47.757693 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:14:47.757693 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:14:47.757693 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:14:47.758846 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:14:47.758846 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:14:47.758846 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:14:47.758846 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:14:47.758846 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:47.758846 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:47.758846 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:47.758846 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:47.758846 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:47.758846 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:47.758846 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:47.758846 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:47.758846 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:47.758846 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:47.758846 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:47.758846 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:47.759942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:47.759942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:47.759942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:47.759942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:47.759942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:14:47.759942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:14:47.759942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:14:47.759942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:14:47.759942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:14:47.759942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:14:47.759942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:14:47.759942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:14:47.759942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 552/1094] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:14:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:14:47.766149 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdda52-5087-4a13-96cf-a50cbcede830 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:47.869479 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:47.901904 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdda52-5087-4a13-96cf-a50cbcede830 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:47.941940 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818b833-a000-41cf-8675-92ee88038258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:47.942566 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818b833-a000-41cf-8675-92ee88038258 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:47.942855 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818b833-a000-41cf-8675-92ee88038258 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:47.943133 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818b833-a000-41cf-8675-92ee88038258 None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:47.943992 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d818b833-a000-41cf-8675-92ee88038258 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:47.944303 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d818b833-a000-41cf-8675-92ee88038258 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:47.946417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d818b833-a000-41cf-8675-92ee88038258 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:47.956371 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 543/1095] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:14:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:14:47.963463 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc2c97-8148-4587-b803-719a051fda68 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:47.994124 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:48.107715 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc2c97-8148-4587-b803-719a051fda68 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:48.147256 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0e98b-ab4a-4981-a72f-bce8fc98ba7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:48.147996 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0e98b-ab4a-4981-a72f-bce8fc98ba7f None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:48.148180 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0e98b-ab4a-4981-a72f-bce8fc98ba7f None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:48.148448 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0e98b-ab4a-4981-a72f-bce8fc98ba7f None admin] PATH_INFO: `/v3/users/d619ae2e75a44a5b95d13a142d9c5bbd` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:48.150496 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0e98b-ab4a-4981-a72f-bce8fc98ba7f None admin] RBAC: Authorizing `identity:get_user(user_id=d619ae2e75a44a5b95d13a142d9c5bbd)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:48.151969 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0e98b-ab4a-4981-a72f-bce8fc98ba7f None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:48.153978 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 553/1096] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:14:47 2022] GET /identity/v3/users/d619ae2e75a44a5b95d13a142d9c5bbd => generated 285 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:14:48.160879 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818b833-a000-41cf-8675-92ee88038258 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:48.325827 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818b833-a000-41cf-8675-92ee88038258 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:48.371844 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152a8bc-73ce-40ce-b14d-2add4c2d8324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:48.372474 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152a8bc-73ce-40ce-b14d-2add4c2d8324 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:48.372754 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152a8bc-73ce-40ce-b14d-2add4c2d8324 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:48.373024 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152a8bc-73ce-40ce-b14d-2add4c2d8324 None admin] PATH_INFO: `/v3/projects/bb3d203487a349d2a09291beb69f3c8c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:48.374236 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152a8bc-73ce-40ce-b14d-2add4c2d8324 None admin] RBAC: Authorizing `identity:get_project(project_id=bb3d203487a349d2a09291beb69f3c8c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:48.375662 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152a8bc-73ce-40ce-b14d-2add4c2d8324 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:48.377430 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 544/1097] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:14:48 2022] GET /identity/v3/projects/bb3d203487a349d2a09291beb69f3c8c => generated 311 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:48.384175 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0e98b-ab4a-4981-a72f-bce8fc98ba7f None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:48.482992 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:48.495940 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0e98b-ab4a-4981-a72f-bce8fc98ba7f None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:48.532766 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0be41d-d5a1-4163-8ca9-b04bd016b6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:48.533462 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0be41d-d5a1-4163-8ca9-b04bd016b6a6 None admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:48.534085 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0be41d-d5a1-4163-8ca9-b04bd016b6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:48.534085 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0be41d-d5a1-4163-8ca9-b04bd016b6a6 None admin] PATH_INFO: `/v3/projects/bb3d203487a349d2a09291beb69f3c8c/users/d619ae2e75a44a5b95d13a142d9c5bbd/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:48.535914 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0be41d-d5a1-4163-8ca9-b04bd016b6a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb3d203487a349d2a09291beb69f3c8c, user_id=d619ae2e75a44a5b95d13a142d9c5bbd, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:48.537355 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0be41d-d5a1-4163-8ca9-b04bd016b6a6 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:48.551199 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 554/1098] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Aug 23 22:14:48 2022] PUT /identity/v3/projects/bb3d203487a349d2a09291beb69f3c8c/users/d619ae2e75a44a5b95d13a142d9c5bbd/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:14:50.531294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23924f-f731-4f74-bfdd-f421bde141cf None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:50.531885 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23924f-f731-4f74-bfdd-f421bde141cf None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:50.531984 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23924f-f731-4f74-bfdd-f421bde141cf None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:50.533343 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 545/1099] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:50.539454 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b48f76-c627-4edf-b29b-9fc7e588c873 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:50.539995 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b48f76-c627-4edf-b29b-9fc7e588c873 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:50.540136 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b48f76-c627-4edf-b29b-9fc7e588c873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:50.560367 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-06b48f76-c627-4edf-b29b-9fc7e588c873 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:50.561783 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-06b48f76-c627-4edf-b29b-9fc7e588c873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:50.645003 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 555/1100] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:14:50.920564 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23924f-f731-4f74-bfdd-f421bde141cf None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:50.925917 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:51.036175 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23924f-f731-4f74-bfdd-f421bde141cf None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:51.076365 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40d446-5624-4d3a-be01-3a3adf884217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:51.077117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40d446-5624-4d3a-be01-3a3adf884217 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:51.077426 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40d446-5624-4d3a-be01-3a3adf884217 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:51.077801 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40d446-5624-4d3a-be01-3a3adf884217 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:51.095232 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40d446-5624-4d3a-be01-3a3adf884217 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:14:51.100067 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-7d40d446-5624-4d3a-be01-3a3adf884217 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:14:51.100067 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:14:51.100067 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:14:51.100067 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:14:51.100067 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:14:51.100067 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:14:51.100067 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:14:51.100067 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:14:51.100067 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:14:51.100067 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:14:51.100067 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:14:51.100067 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:14:51.100067 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:14:51.100067 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:14:51.100067 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:14:51.100067 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:14:51.101546 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:14:51.101546 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:14:51.101546 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:14:51.101546 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:14:51.101546 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:14:51.101546 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:14:51.101546 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:14:51.101546 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:14:51.101546 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:14:51.101546 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:14:51.101546 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:14:51.101546 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:14:51.101546 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:14:51.101546 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:14:51.101546 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:14:51.101546 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:14:51.103342 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:14:51.103342 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:14:51.103342 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:14:51.103342 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:14:51.103342 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:14:51.103342 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:14:51.103342 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:14:51.103342 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:14:51.103342 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:14:51.103342 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:14:51.103342 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:14:51.103342 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:14:51.103342 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 546/1101] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:14:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:14:51.112309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b48f76-c627-4edf-b29b-9fc7e588c873 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:51.225925 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:51.254418 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b48f76-c627-4edf-b29b-9fc7e588c873 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:51.297009 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fdb49-cc84-4fe1-b44b-c872bde94caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:51.297730 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fdb49-cc84-4fe1-b44b-c872bde94caa None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:51.298007 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fdb49-cc84-4fe1-b44b-c872bde94caa None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:51.298325 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fdb49-cc84-4fe1-b44b-c872bde94caa None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:51.299374 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9fdb49-cc84-4fe1-b44b-c872bde94caa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:51.299763 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9fdb49-cc84-4fe1-b44b-c872bde94caa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:51.301818 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9fdb49-cc84-4fe1-b44b-c872bde94caa None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:51.316617 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 556/1102] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:14:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:51.324244 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40d446-5624-4d3a-be01-3a3adf884217 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:51.398130 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:51.453733 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40d446-5624-4d3a-be01-3a3adf884217 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:51.497899 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52eeb1-37cf-4f9e-b0c6-480805db22f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:51.498472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52eeb1-37cf-4f9e-b0c6-480805db22f1 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:51.498753 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52eeb1-37cf-4f9e-b0c6-480805db22f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:51.499031 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52eeb1-37cf-4f9e-b0c6-480805db22f1 None admin] PATH_INFO: `/v3/users/d619ae2e75a44a5b95d13a142d9c5bbd` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:51.500262 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52eeb1-37cf-4f9e-b0c6-480805db22f1 None admin] RBAC: Authorizing `identity:get_user(user_id=d619ae2e75a44a5b95d13a142d9c5bbd)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:51.501878 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52eeb1-37cf-4f9e-b0c6-480805db22f1 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:51.503642 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 547/1103] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:14:51 2022] GET /identity/v3/users/d619ae2e75a44a5b95d13a142d9c5bbd => generated 285 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:51.510610 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fdb49-cc84-4fe1-b44b-c872bde94caa None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:51.666594 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fdb49-cc84-4fe1-b44b-c872bde94caa None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:51.709854 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc44ad-483d-4a7a-9e03-60a270dd6029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:51.710529 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc44ad-483d-4a7a-9e03-60a270dd6029 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:51.710982 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc44ad-483d-4a7a-9e03-60a270dd6029 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:51.712059 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc44ad-483d-4a7a-9e03-60a270dd6029 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:51.730358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:51.813093 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc44ad-483d-4a7a-9e03-60a270dd6029 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:51.814508 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc44ad-483d-4a7a-9e03-60a270dd6029 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:51.950648 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 557/1104] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:14:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:14:51.956935 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52eeb1-37cf-4f9e-b0c6-480805db22f1 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:52.068387 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52eeb1-37cf-4f9e-b0c6-480805db22f1 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:52.113571 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:52.119584 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb08ed0-8ceb-4c9a-8a2a-538caf10159a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:52.120229 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb08ed0-8ceb-4c9a-8a2a-538caf10159a None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:52.120502 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb08ed0-8ceb-4c9a-8a2a-538caf10159a None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:52.120769 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb08ed0-8ceb-4c9a-8a2a-538caf10159a None admin] PATH_INFO: `/v3/projects/bb3d203487a349d2a09291beb69f3c8c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:52.121959 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb08ed0-8ceb-4c9a-8a2a-538caf10159a None admin] RBAC: Authorizing `identity:get_project(project_id=bb3d203487a349d2a09291beb69f3c8c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:52.123378 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb08ed0-8ceb-4c9a-8a2a-538caf10159a None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:52.125033 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 548/1105] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:14:51 2022] GET /identity/v3/projects/bb3d203487a349d2a09291beb69f3c8c => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:52.131419 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc44ad-483d-4a7a-9e03-60a270dd6029 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:52.180272 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:52.250536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc44ad-483d-4a7a-9e03-60a270dd6029 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:52.311586 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720fdc1-16f5-4945-a16c-7528d0aac0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:52.312495 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720fdc1-16f5-4945-a16c-7528d0aac0ae None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:52.312993 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720fdc1-16f5-4945-a16c-7528d0aac0ae None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:52.313514 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720fdc1-16f5-4945-a16c-7528d0aac0ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:52.314728 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e720fdc1-16f5-4945-a16c-7528d0aac0ae None admin] RBAC: Adding query filter params (role.id=e806ce849cf34b92979b5524f3ea9ff6, scope.project.id=bb3d203487a349d2a09291beb69f3c8c, user.id=d619ae2e75a44a5b95d13a142d9c5bbd) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:52.315286 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e720fdc1-16f5-4945-a16c-7528d0aac0ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:52.317923 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e720fdc1-16f5-4945-a16c-7528d0aac0ae None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:52.328960 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 558/1106] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:14:52 2022] GET /identity/v3/role_assignments?user.id=d619ae2e75a44a5b95d13a142d9c5bbd&scope.project.id=bb3d203487a349d2a09291beb69f3c8c&role.id=e806ce849cf34b92979b5524f3ea9ff6 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:54.378055 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48935a-ba9f-4813-9d24-07b93d7421c5 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:54.378624 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48935a-ba9f-4813-9d24-07b93d7421c5 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:54.378624 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48935a-ba9f-4813-9d24-07b93d7421c5 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:54.379946 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 549/1107] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:54.386567 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429ae16-20cb-48d4-9a94-dc4c37d41844 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:54.387213 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429ae16-20cb-48d4-9a94-dc4c37d41844 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:54.387213 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429ae16-20cb-48d4-9a94-dc4c37d41844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:54.408037 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-4429ae16-20cb-48d4-9a94-dc4c37d41844 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:54.409246 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-4429ae16-20cb-48d4-9a94-dc4c37d41844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:54.476404 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 559/1108] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:14:54.761288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48935a-ba9f-4813-9d24-07b93d7421c5 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:54.878843 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48935a-ba9f-4813-9d24-07b93d7421c5 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:54.917154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeff6c2-0406-47ee-8e71-6c6a1cf2de5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:54.917841 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeff6c2-0406-47ee-8e71-6c6a1cf2de5b None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:54.918121 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeff6c2-0406-47ee-8e71-6c6a1cf2de5b None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:54.918398 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeff6c2-0406-47ee-8e71-6c6a1cf2de5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:54.919600 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeff6c2-0406-47ee-8e71-6c6a1cf2de5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:54.921041 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeff6c2-0406-47ee-8e71-6c6a1cf2de5b None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:54.922753 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 550/1109] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:14:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:54.928697 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429ae16-20cb-48d4-9a94-dc4c37d41844 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:54.973183 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:55.048731 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429ae16-20cb-48d4-9a94-dc4c37d41844 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:55.088734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ebff0-f75a-4d61-9c51-af83a5c2ef42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:55.089403 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ebff0-f75a-4d61-9c51-af83a5c2ef42 None admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:55.089690 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ebff0-f75a-4d61-9c51-af83a5c2ef42 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:55.089961 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ebff0-f75a-4d61-9c51-af83a5c2ef42 None admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:55.090630 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ebff0-f75a-4d61-9c51-af83a5c2ef42 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:55.092062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ebff0-f75a-4d61-9c51-af83a5c2ef42 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:55.119992 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 560/1110] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Aug 23 22:14:54 2022] POST /identity/v3/users => generated 286 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:14:57.195495 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed190f2e-25cc-4c9b-8d2a-a0753987982b None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:57.196058 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed190f2e-25cc-4c9b-8d2a-a0753987982b None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:57.196156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed190f2e-25cc-4c9b-8d2a-a0753987982b None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:57.197543 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 551/1111] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:57.203467 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebaf03-9652-4eb4-b591-21bb7a2a0479 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:57.203930 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebaf03-9652-4eb4-b591-21bb7a2a0479 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:57.204016 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebaf03-9652-4eb4-b591-21bb7a2a0479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:57.228574 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-feebaf03-9652-4eb4-b591-21bb7a2a0479 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:57.230739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-feebaf03-9652-4eb4-b591-21bb7a2a0479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:57.336683 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 561/1112] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:14:57.624106 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed190f2e-25cc-4c9b-8d2a-a0753987982b None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:57.716480 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:57.764248 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed190f2e-25cc-4c9b-8d2a-a0753987982b None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:57.809058 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084788c-b3fc-4797-a1d1-8663677038a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:57.810012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084788c-b3fc-4797-a1d1-8663677038a0 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:57.810298 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084788c-b3fc-4797-a1d1-8663677038a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:57.810575 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084788c-b3fc-4797-a1d1-8663677038a0 None admin] PATH_INFO: `/v3/roles/a0449d430ec54adcabb96193af2f7cd5` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:57.812156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084788c-b3fc-4797-a1d1-8663677038a0 None admin] RBAC: Authorizing `identity:get_role(role_id=a0449d430ec54adcabb96193af2f7cd5)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:57.813638 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084788c-b3fc-4797-a1d1-8663677038a0 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:57.815265 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 552/1113] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:14:57 2022] GET /identity/v3/roles/a0449d430ec54adcabb96193af2f7cd5 => generated 223 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:57.823664 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebaf03-9652-4eb4-b591-21bb7a2a0479 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:57.855228 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:57.949675 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebaf03-9652-4eb4-b591-21bb7a2a0479 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:57.997277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cdcae-4eaf-413d-adbe-2bf3e3fc1a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:57.997994 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cdcae-4eaf-413d-adbe-2bf3e3fc1a93 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:57.998376 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cdcae-4eaf-413d-adbe-2bf3e3fc1a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:57.998825 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cdcae-4eaf-413d-adbe-2bf3e3fc1a93 None admin] PATH_INFO: `/v3/users/5c8e171b545348b89364379d19ae090b` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:58.024306 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5cdcae-4eaf-413d-adbe-2bf3e3fc1a93 None admin] RBAC: Authorizing `identity:get_user(user_id=5c8e171b545348b89364379d19ae090b)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:58.025997 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5cdcae-4eaf-413d-adbe-2bf3e3fc1a93 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:58.027928 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 562/1114] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:14:57 2022] GET /identity/v3/users/5c8e171b545348b89364379d19ae090b => generated 286 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:14:58.035344 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084788c-b3fc-4797-a1d1-8663677038a0 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:58.156975 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084788c-b3fc-4797-a1d1-8663677038a0 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:58.201396 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebf2af-972c-434e-94cf-c1993fc0368a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:58.202406 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebf2af-972c-434e-94cf-c1993fc0368a None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:58.202618 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebf2af-972c-434e-94cf-c1993fc0368a None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:58.202968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebf2af-972c-434e-94cf-c1993fc0368a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:58.208181 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:58.295391 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ebf2af-972c-434e-94cf-c1993fc0368a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:58.296864 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ebf2af-972c-434e-94cf-c1993fc0368a None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:58.441677 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 553/1115] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:14:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 22:14:58.448464 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cdcae-4eaf-413d-adbe-2bf3e3fc1a93 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:58.550979 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:58.583739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cdcae-4eaf-413d-adbe-2bf3e3fc1a93 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:58.627291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b88861-0d0b-4872-9bee-7270cc8c0d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:58.627982 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b88861-0d0b-4872-9bee-7270cc8c0d8a None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:58.628333 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b88861-0d0b-4872-9bee-7270cc8c0d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:58.628654 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b88861-0d0b-4872-9bee-7270cc8c0d8a None admin] PATH_INFO: `/v3/projects/bb3d203487a349d2a09291beb69f3c8c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:58.629898 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b88861-0d0b-4872-9bee-7270cc8c0d8a None admin] RBAC: Authorizing `identity:get_project(project_id=bb3d203487a349d2a09291beb69f3c8c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:58.631390 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b88861-0d0b-4872-9bee-7270cc8c0d8a None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:58.633780 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 563/1116] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:14:58 2022] GET /identity/v3/projects/bb3d203487a349d2a09291beb69f3c8c => generated 311 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:14:58.640385 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebf2af-972c-434e-94cf-c1993fc0368a None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:58.682315 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:58.759038 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebf2af-972c-434e-94cf-c1993fc0368a None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:58.799823 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384e3bc-cc9d-4c35-83d1-88685a3ae10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:58.800492 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384e3bc-cc9d-4c35-83d1-88685a3ae10b None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:58.800816 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384e3bc-cc9d-4c35-83d1-88685a3ae10b None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:58.801184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384e3bc-cc9d-4c35-83d1-88685a3ae10b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:58.801972 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384e3bc-cc9d-4c35-83d1-88685a3ae10b None admin] RBAC: Adding query filter params (role.id=a0449d430ec54adcabb96193af2f7cd5, scope.project.id=bb3d203487a349d2a09291beb69f3c8c, user.id=5c8e171b545348b89364379d19ae090b) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:14:58.802336 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384e3bc-cc9d-4c35-83d1-88685a3ae10b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:58.803849 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384e3bc-cc9d-4c35-83d1-88685a3ae10b None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:58.810622 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 554/1117] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:14:58 2022] GET /identity/v3/role_assignments?user.id=5c8e171b545348b89364379d19ae090b&scope.project.id=bb3d203487a349d2a09291beb69f3c8c&role.id=a0449d430ec54adcabb96193af2f7cd5 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:15:00.841549 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9438c-8460-48ae-94c9-8641fd8b2a6b None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:00.842120 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9438c-8460-48ae-94c9-8641fd8b2a6b None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:00.842120 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9438c-8460-48ae-94c9-8641fd8b2a6b None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:00.843466 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 564/1118] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:15:00.849170 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3a6e0-9934-44ab-be4e-3f9e81f8c2f0 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:00.849746 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3a6e0-9934-44ab-be4e-3f9e81f8c2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:00.849746 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3a6e0-9934-44ab-be4e-3f9e81f8c2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:00.868933 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-f9d3a6e0-9934-44ab-be4e-3f9e81f8c2f0 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:00.870196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-f9d3a6e0-9934-44ab-be4e-3f9e81f8c2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:00.944978 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 555/1119] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:15:01.219970 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9438c-8460-48ae-94c9-8641fd8b2a6b None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:01.330927 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9438c-8460-48ae-94c9-8641fd8b2a6b None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:01.365654 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627cf4d-5049-4801-a232-968f1b22cc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:01.366277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627cf4d-5049-4801-a232-968f1b22cc74 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:01.366551 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627cf4d-5049-4801-a232-968f1b22cc74 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:01.366818 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627cf4d-5049-4801-a232-968f1b22cc74 None admin] PATH_INFO: `/v3/roles/a0449d430ec54adcabb96193af2f7cd5` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:01.368917 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0627cf4d-5049-4801-a232-968f1b22cc74 None admin] RBAC: Authorizing `identity:get_role(role_id=a0449d430ec54adcabb96193af2f7cd5)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:01.370329 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0627cf4d-5049-4801-a232-968f1b22cc74 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:01.371703 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 565/1120] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:15:01 2022] GET /identity/v3/roles/a0449d430ec54adcabb96193af2f7cd5 => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:01.377973 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3a6e0-9934-44ab-be4e-3f9e81f8c2f0 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:01.412253 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:01.487061 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3a6e0-9934-44ab-be4e-3f9e81f8c2f0 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:01.522947 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda1b41-2438-4433-a073-2da2ba2618a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:01.523640 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda1b41-2438-4433-a073-2da2ba2618a3 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:01.523936 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda1b41-2438-4433-a073-2da2ba2618a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:01.524188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda1b41-2438-4433-a073-2da2ba2618a3 None admin] PATH_INFO: `/v3/users/5c8e171b545348b89364379d19ae090b` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:01.525345 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda1b41-2438-4433-a073-2da2ba2618a3 None admin] RBAC: Authorizing `identity:get_user(user_id=5c8e171b545348b89364379d19ae090b)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:01.526864 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda1b41-2438-4433-a073-2da2ba2618a3 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:01.528477 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 556/1121] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:15:01 2022] GET /identity/v3/users/5c8e171b545348b89364379d19ae090b => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:01.534502 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627cf4d-5049-4801-a232-968f1b22cc74 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:01.553556 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:01.642904 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627cf4d-5049-4801-a232-968f1b22cc74 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:01.703812 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3a14c-a2ac-4b1b-8345-24fd2d4f4bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:01.704882 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3a14c-a2ac-4b1b-8345-24fd2d4f4bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:01.705418 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3a14c-a2ac-4b1b-8345-24fd2d4f4bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:01.705892 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3a14c-a2ac-4b1b-8345-24fd2d4f4bb4 None admin] PATH_INFO: `/v3/projects/bb3d203487a349d2a09291beb69f3c8c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:01.707862 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c3a14c-a2ac-4b1b-8345-24fd2d4f4bb4 None admin] RBAC: Authorizing `identity:get_project(project_id=bb3d203487a349d2a09291beb69f3c8c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:01.710639 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c3a14c-a2ac-4b1b-8345-24fd2d4f4bb4 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:01.714710 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 566/1122] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:15:01 2022] GET /identity/v3/projects/bb3d203487a349d2a09291beb69f3c8c => generated 311 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:01.724319 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda1b41-2438-4433-a073-2da2ba2618a3 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:01.846131 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:01.852673 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda1b41-2438-4433-a073-2da2ba2618a3 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:01.893293 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3c424-0cd7-4ae1-92fe-b5712bbefea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:01.893988 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3c424-0cd7-4ae1-92fe-b5712bbefea6 None admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:01.894268 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3c424-0cd7-4ae1-92fe-b5712bbefea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:01.894543 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3c424-0cd7-4ae1-92fe-b5712bbefea6 None admin] PATH_INFO: `/v3/projects/bb3d203487a349d2a09291beb69f3c8c/users/5c8e171b545348b89364379d19ae090b/roles/a0449d430ec54adcabb96193af2f7cd5` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:01.896721 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3c424-0cd7-4ae1-92fe-b5712bbefea6 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb3d203487a349d2a09291beb69f3c8c, user_id=5c8e171b545348b89364379d19ae090b, role_id=a0449d430ec54adcabb96193af2f7cd5)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:01.898377 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3c424-0cd7-4ae1-92fe-b5712bbefea6 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:01.912703 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 557/1123] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Aug 23 22:15:01 2022] PUT /identity/v3/projects/bb3d203487a349d2a09291beb69f3c8c/users/5c8e171b545348b89364379d19ae090b/roles/a0449d430ec54adcabb96193af2f7cd5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:15:03.879952 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f8248-cbb4-4eaa-87f1-c9a173dffcbb None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:03.880517 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f8248-cbb4-4eaa-87f1-c9a173dffcbb None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:03.880666 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f8248-cbb4-4eaa-87f1-c9a173dffcbb None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:03.882090 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 567/1124] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:15:03.888942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a317f7-6524-466c-95a3-1aa41afc561c None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:03.889573 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a317f7-6524-466c-95a3-1aa41afc561c None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:03.889573 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a317f7-6524-466c-95a3-1aa41afc561c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:03.909697 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-98a317f7-6524-466c-95a3-1aa41afc561c None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:03.910934 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-98a317f7-6524-466c-95a3-1aa41afc561c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:03.994735 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 558/1125] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:15:04.278788 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f8248-cbb4-4eaa-87f1-c9a173dffcbb None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:04.377440 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:04.396331 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f8248-cbb4-4eaa-87f1-c9a173dffcbb None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:04.437502 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931bc52-5e08-4e0d-b6b0-d0ba50b86d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:04.438145 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931bc52-5e08-4e0d-b6b0-d0ba50b86d3b None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:04.438431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931bc52-5e08-4e0d-b6b0-d0ba50b86d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:04.438704 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931bc52-5e08-4e0d-b6b0-d0ba50b86d3b None admin] PATH_INFO: `/v3/roles/a0449d430ec54adcabb96193af2f7cd5` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:04.440173 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3931bc52-5e08-4e0d-b6b0-d0ba50b86d3b None admin] RBAC: Authorizing `identity:get_role(role_id=a0449d430ec54adcabb96193af2f7cd5)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:04.441593 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3931bc52-5e08-4e0d-b6b0-d0ba50b86d3b None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:04.443081 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 568/1126] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:15:04 2022] GET /identity/v3/roles/a0449d430ec54adcabb96193af2f7cd5 => generated 223 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:04.450064 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a317f7-6524-466c-95a3-1aa41afc561c None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:04.556343 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:04.572810 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a317f7-6524-466c-95a3-1aa41afc561c None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:04.613938 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b84da-bc28-4dfb-9b4c-ecce90413fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:04.614582 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b84da-bc28-4dfb-9b4c-ecce90413fda None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:04.614866 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b84da-bc28-4dfb-9b4c-ecce90413fda None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:04.615133 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b84da-bc28-4dfb-9b4c-ecce90413fda None admin] PATH_INFO: `/v3/users/5c8e171b545348b89364379d19ae090b` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:04.616427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b84da-bc28-4dfb-9b4c-ecce90413fda None admin] RBAC: Authorizing `identity:get_user(user_id=5c8e171b545348b89364379d19ae090b)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:04.619030 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b84da-bc28-4dfb-9b4c-ecce90413fda None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:04.620729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 559/1127] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:15:04 2022] GET /identity/v3/users/5c8e171b545348b89364379d19ae090b => generated 286 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:04.626991 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931bc52-5e08-4e0d-b6b0-d0ba50b86d3b None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:04.760685 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931bc52-5e08-4e0d-b6b0-d0ba50b86d3b None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:04.807582 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52300a-5483-44d8-8073-4ff97b2a5774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:04.808123 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52300a-5483-44d8-8073-4ff97b2a5774 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:04.808400 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52300a-5483-44d8-8073-4ff97b2a5774 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:04.808670 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52300a-5483-44d8-8073-4ff97b2a5774 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:04.835117 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:04.893064 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52300a-5483-44d8-8073-4ff97b2a5774 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:04.894635 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52300a-5483-44d8-8073-4ff97b2a5774 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:05.016029 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 569/1128] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:15:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 22:15:05.025745 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b84da-bc28-4dfb-9b4c-ecce90413fda None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:05.167791 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b84da-bc28-4dfb-9b4c-ecce90413fda None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:05.207063 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d541d-c14f-4fee-b0a8-6ff61a7e4023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:05.207708 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d541d-c14f-4fee-b0a8-6ff61a7e4023 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:05.207992 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d541d-c14f-4fee-b0a8-6ff61a7e4023 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:05.208270 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d541d-c14f-4fee-b0a8-6ff61a7e4023 None admin] PATH_INFO: `/v3/projects/bb3d203487a349d2a09291beb69f3c8c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:05.209483 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d541d-c14f-4fee-b0a8-6ff61a7e4023 None admin] RBAC: Authorizing `identity:get_project(project_id=bb3d203487a349d2a09291beb69f3c8c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:05.211612 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d541d-c14f-4fee-b0a8-6ff61a7e4023 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:05.213505 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 560/1129] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:15:05 2022] GET /identity/v3/projects/bb3d203487a349d2a09291beb69f3c8c => generated 311 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:05.220551 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52300a-5483-44d8-8073-4ff97b2a5774 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:05.285190 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:05.344571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52300a-5483-44d8-8073-4ff97b2a5774 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:05.386492 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d475f6-8d26-411b-bbb6-b75d82612bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:05.387141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d475f6-8d26-411b-bbb6-b75d82612bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:05.387398 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d475f6-8d26-411b-bbb6-b75d82612bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:05.387669 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d475f6-8d26-411b-bbb6-b75d82612bf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:05.388409 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d475f6-8d26-411b-bbb6-b75d82612bf9 None admin] RBAC: Adding query filter params (role.id=a0449d430ec54adcabb96193af2f7cd5, scope.project.id=bb3d203487a349d2a09291beb69f3c8c, user.id=5c8e171b545348b89364379d19ae090b) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:05.388968 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d475f6-8d26-411b-bbb6-b75d82612bf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:05.393461 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d475f6-8d26-411b-bbb6-b75d82612bf9 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:05.396868 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 570/1130] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:15:05 2022] GET /identity/v3/role_assignments?user.id=5c8e171b545348b89364379d19ae090b&scope.project.id=bb3d203487a349d2a09291beb69f3c8c&role.id=a0449d430ec54adcabb96193af2f7cd5 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:15:07.978607 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6ebcc-3225-4267-a449-d702e2debf1f None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:07.979416 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6ebcc-3225-4267-a449-d702e2debf1f None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:07.979628 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6ebcc-3225-4267-a449-d702e2debf1f None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:07.981039 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 561/1131] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:15:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:15:07.987301 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb762b87-b200-4e54-99a1-a95c6e24fc62 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:07.987998 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb762b87-b200-4e54-99a1-a95c6e24fc62 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:07.987998 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb762b87-b200-4e54-99a1-a95c6e24fc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:08.008505 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-cb762b87-b200-4e54-99a1-a95c6e24fc62 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:08.010013 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-cb762b87-b200-4e54-99a1-a95c6e24fc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:08.090961 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 571/1132] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:15:08.370336 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6ebcc-3225-4267-a449-d702e2debf1f None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:08.397285 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:08.485692 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6ebcc-3225-4267-a449-d702e2debf1f None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:08.520783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e8a69-49f8-4b72-a94b-76c2b94b370d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:08.521436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e8a69-49f8-4b72-a94b-76c2b94b370d None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:08.521717 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e8a69-49f8-4b72-a94b-76c2b94b370d None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:08.522008 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e8a69-49f8-4b72-a94b-76c2b94b370d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:08.523194 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e8a69-49f8-4b72-a94b-76c2b94b370d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:08.524729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e8a69-49f8-4b72-a94b-76c2b94b370d None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:08.526353 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 562/1133] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:15:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:08.532523 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb762b87-b200-4e54-99a1-a95c6e24fc62 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:08.582253 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:08.654456 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb762b87-b200-4e54-99a1-a95c6e24fc62 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:08.704613 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da450d47-b73a-411a-973c-2a5544637695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:08.705672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da450d47-b73a-411a-973c-2a5544637695 None admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:08.706161 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da450d47-b73a-411a-973c-2a5544637695 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:08.706638 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da450d47-b73a-411a-973c-2a5544637695 None admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:08.707851 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da450d47-b73a-411a-973c-2a5544637695 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:08.710595 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da450d47-b73a-411a-973c-2a5544637695 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:08.755804 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 572/1134] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Aug 23 22:15:08 2022] POST /identity/v3/projects => generated 311 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:15:10.737215 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac89f7-dc9b-498f-8081-e9155b4dcbcb None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:10.737808 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac89f7-dc9b-498f-8081-e9155b4dcbcb None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:10.737808 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac89f7-dc9b-498f-8081-e9155b4dcbcb None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:10.739140 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 563/1135] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:15:10.745901 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3020e-d3c4-4880-be25-ecd95aafca76 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:10.746386 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3020e-d3c4-4880-be25-ecd95aafca76 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:10.746499 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3020e-d3c4-4880-be25-ecd95aafca76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:10.764762 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-7bf3020e-d3c4-4880-be25-ecd95aafca76 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:10.766016 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-7bf3020e-d3c4-4880-be25-ecd95aafca76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:10.837033 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 573/1136] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:15:11.108436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac89f7-dc9b-498f-8081-e9155b4dcbcb None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:11.204016 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:11.215040 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac89f7-dc9b-498f-8081-e9155b4dcbcb None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:11.253101 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7887e-b3d8-4b05-8093-4dcdcb8b9210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:11.253769 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7887e-b3d8-4b05-8093-4dcdcb8b9210 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:11.254048 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7887e-b3d8-4b05-8093-4dcdcb8b9210 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:11.254320 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7887e-b3d8-4b05-8093-4dcdcb8b9210 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:11.255467 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7887e-b3d8-4b05-8093-4dcdcb8b9210 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:11.256899 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7887e-b3d8-4b05-8093-4dcdcb8b9210 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:11.258766 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 564/1137] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:15:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:11.264758 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3020e-d3c4-4880-be25-ecd95aafca76 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:11.295161 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:11.392542 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3020e-d3c4-4880-be25-ecd95aafca76 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:11.453923 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd5308-2372-4e53-95d4-701740c3c15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:11.454951 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd5308-2372-4e53-95d4-701740c3c15f None admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:11.455462 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd5308-2372-4e53-95d4-701740c3c15f None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:11.455957 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd5308-2372-4e53-95d4-701740c3c15f None admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:11.457196 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd5308-2372-4e53-95d4-701740c3c15f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:11.460037 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd5308-2372-4e53-95d4-701740c3c15f None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:11.495870 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 574/1138] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Aug 23 22:15:11 2022] POST /identity/v3/users => generated 286 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:15:13.570913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec7acb-b021-40c6-8981-e677ea14b9ca None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:13.571543 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec7acb-b021-40c6-8981-e677ea14b9ca None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:13.571645 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec7acb-b021-40c6-8981-e677ea14b9ca None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:13.572990 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 565/1139] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:15:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:15:13.579176 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7747c-d96c-40d2-b874-492844a7dc94 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:13.579725 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7747c-d96c-40d2-b874-492844a7dc94 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:13.579725 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7747c-d96c-40d2-b874-492844a7dc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:13.598878 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-4ee7747c-d96c-40d2-b874-492844a7dc94 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:13.600108 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-4ee7747c-d96c-40d2-b874-492844a7dc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:13.672675 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 575/1140] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:15:13.945936 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec7acb-b021-40c6-8981-e677ea14b9ca None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:14.055902 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec7acb-b021-40c6-8981-e677ea14b9ca None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:14.093023 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e3197-52e5-45ae-9b7b-afdc527dbc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:14.093693 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e3197-52e5-45ae-9b7b-afdc527dbc5e None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:14.093971 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e3197-52e5-45ae-9b7b-afdc527dbc5e None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:14.094245 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e3197-52e5-45ae-9b7b-afdc527dbc5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:14.105848 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e3197-52e5-45ae-9b7b-afdc527dbc5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:15:14.110534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-d49e3197-52e5-45ae-9b7b-afdc527dbc5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:15:14.110534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:14.110534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:14.110534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:14.110534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:14.110534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:14.110534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:14.110534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:14.110534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:14.110534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:14.110534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:14.110534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:14.110534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:15:14.110534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:15:14.110534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:15:14.110534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:15:14.111748 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:15:14.111748 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:15:14.111748 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:15:14.111748 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:15:14.111748 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:14.111748 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:14.111748 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:14.111748 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:14.111748 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:14.111748 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:14.111748 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:14.111748 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:14.111748 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:14.111748 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:14.111748 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:14.111748 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:14.112874 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:14.112874 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:14.112874 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:14.112874 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:14.112874 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:15:14.112874 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:15:14.112874 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:15:14.112874 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:15:14.112874 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:15:14.112874 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:15:14.112874 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:15:14.112874 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:15:14.112874 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 566/1141] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:15:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:14.118490 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7747c-d96c-40d2-b874-492844a7dc94 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:14.136989 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:14.254869 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7747c-d96c-40d2-b874-492844a7dc94 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:14.306300 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ef491-e4a7-4c7b-86ee-5a6aae260248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:14.307235 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ef491-e4a7-4c7b-86ee-5a6aae260248 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:14.307681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ef491-e4a7-4c7b-86ee-5a6aae260248 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:14.308100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ef491-e4a7-4c7b-86ee-5a6aae260248 None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:14.309205 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ef491-e4a7-4c7b-86ee-5a6aae260248 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:14.309963 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ef491-e4a7-4c7b-86ee-5a6aae260248 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:14.312156 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ef491-e4a7-4c7b-86ee-5a6aae260248 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:14.325160 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 576/1142] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:15:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:15:14.331102 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e3197-52e5-45ae-9b7b-afdc527dbc5e None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:14.354485 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:14.436143 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e3197-52e5-45ae-9b7b-afdc527dbc5e None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:14.471387 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb2c6c-4074-49c0-8554-2298327b4301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:14.472019 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb2c6c-4074-49c0-8554-2298327b4301 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:14.472301 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb2c6c-4074-49c0-8554-2298327b4301 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:14.472575 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb2c6c-4074-49c0-8554-2298327b4301 None admin] PATH_INFO: `/v3/users/cbe17f18b98d4b73a2909280395c6e13` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:14.488293 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb2c6c-4074-49c0-8554-2298327b4301 None admin] RBAC: Authorizing `identity:get_user(user_id=cbe17f18b98d4b73a2909280395c6e13)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:14.489768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb2c6c-4074-49c0-8554-2298327b4301 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:14.491480 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 567/1143] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:15:14 2022] GET /identity/v3/users/cbe17f18b98d4b73a2909280395c6e13 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:14.497935 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ef491-e4a7-4c7b-86ee-5a6aae260248 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:14.589934 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:14.615900 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ef491-e4a7-4c7b-86ee-5a6aae260248 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:14.656054 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e62ec-7e9f-486b-a210-b19f9946dab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:14.656686 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e62ec-7e9f-486b-a210-b19f9946dab7 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:14.656967 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e62ec-7e9f-486b-a210-b19f9946dab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:14.657241 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e62ec-7e9f-486b-a210-b19f9946dab7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:14.735329 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e62ec-7e9f-486b-a210-b19f9946dab7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:14.737093 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e62ec-7e9f-486b-a210-b19f9946dab7 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:14.827240 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:14.853082 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 577/1144] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:15:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 22:15:14.860407 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb2c6c-4074-49c0-8554-2298327b4301 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:14.941197 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:14.964461 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb2c6c-4074-49c0-8554-2298327b4301 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:15.000749 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6bd94-17b4-403f-b0e0-b2c5e8aafa22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:15.001415 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6bd94-17b4-403f-b0e0-b2c5e8aafa22 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:15.001704 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6bd94-17b4-403f-b0e0-b2c5e8aafa22 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:15.001980 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6bd94-17b4-403f-b0e0-b2c5e8aafa22 None admin] PATH_INFO: `/v3/projects/f28022f21b0a41ae9e5c55a767eefe65` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:15.003134 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6bd94-17b4-403f-b0e0-b2c5e8aafa22 None admin] RBAC: Authorizing `identity:get_project(project_id=f28022f21b0a41ae9e5c55a767eefe65)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:15.004569 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6bd94-17b4-403f-b0e0-b2c5e8aafa22 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:15.006320 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 568/1145] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:15:14 2022] GET /identity/v3/projects/f28022f21b0a41ae9e5c55a767eefe65 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:15.013153 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e62ec-7e9f-486b-a210-b19f9946dab7 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:15.118496 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e62ec-7e9f-486b-a210-b19f9946dab7 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:15.154047 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e40e03-21cc-4a48-86a7-9e57122cfa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:15.154667 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e40e03-21cc-4a48-86a7-9e57122cfa06 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:15.154944 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e40e03-21cc-4a48-86a7-9e57122cfa06 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:15.155217 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e40e03-21cc-4a48-86a7-9e57122cfa06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:15.155950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e40e03-21cc-4a48-86a7-9e57122cfa06 None admin] RBAC: Adding query filter params (role.id=e806ce849cf34b92979b5524f3ea9ff6, scope.project.id=f28022f21b0a41ae9e5c55a767eefe65, user.id=cbe17f18b98d4b73a2909280395c6e13) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:15.156259 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e40e03-21cc-4a48-86a7-9e57122cfa06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:15.157742 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e40e03-21cc-4a48-86a7-9e57122cfa06 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:15.164214 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 578/1146] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:15:15 2022] GET /identity/v3/role_assignments?user.id=cbe17f18b98d4b73a2909280395c6e13&scope.project.id=f28022f21b0a41ae9e5c55a767eefe65&role.id=e806ce849cf34b92979b5524f3ea9ff6 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:17.092046 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4c624-139c-4dc8-98b2-f3ee95e11a69 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:17.092743 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4c624-139c-4dc8-98b2-f3ee95e11a69 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:17.092743 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4c624-139c-4dc8-98b2-f3ee95e11a69 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:17.094139 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 569/1147] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:15:17.100220 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af51e76-5d26-4cb5-acdd-012763b62d04 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:17.101325 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af51e76-5d26-4cb5-acdd-012763b62d04 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:17.101453 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af51e76-5d26-4cb5-acdd-012763b62d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:17.121390 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-8af51e76-5d26-4cb5-acdd-012763b62d04 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:17.122649 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-8af51e76-5d26-4cb5-acdd-012763b62d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:17.165832 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:17.203487 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 579/1148] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:15:17.483629 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4c624-139c-4dc8-98b2-f3ee95e11a69 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:17.592813 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4c624-139c-4dc8-98b2-f3ee95e11a69 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:17.629554 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ae495-3b2a-42a2-a88f-c6243a680b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:17.630198 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ae495-3b2a-42a2-a88f-c6243a680b61 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:17.630462 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ae495-3b2a-42a2-a88f-c6243a680b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:17.630737 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ae495-3b2a-42a2-a88f-c6243a680b61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:17.642143 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ae495-3b2a-42a2-a88f-c6243a680b61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:15:17.646857 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-e18ae495-3b2a-42a2-a88f-c6243a680b61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:15:17.646857 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:17.646857 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:17.646857 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:17.646857 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:17.646857 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:17.646857 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:17.646857 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:17.646857 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:17.646857 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:17.646857 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:17.646857 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:17.646857 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:15:17.646857 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:15:17.646857 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:15:17.646857 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:15:17.649064 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:15:17.649064 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:15:17.649064 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:15:17.649064 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:15:17.649064 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:17.649064 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:17.649064 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:17.649064 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:17.649064 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:17.649064 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:17.649064 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:17.649064 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:17.649064 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:17.649064 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:17.649064 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:17.649064 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:17.650263 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:17.650263 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:17.650263 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:17.650263 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:17.650263 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:15:17.650263 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:15:17.650263 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:15:17.650263 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:15:17.650263 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:15:17.650263 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:15:17.650263 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:15:17.650263 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:15:17.650263 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 570/1149] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:15:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:17.655767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af51e76-5d26-4cb5-acdd-012763b62d04 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:17.778821 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af51e76-5d26-4cb5-acdd-012763b62d04 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:17.820644 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8597f-e1e4-45d8-ab82-65658bc6f483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:17.821965 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8597f-e1e4-45d8-ab82-65658bc6f483 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:17.821965 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8597f-e1e4-45d8-ab82-65658bc6f483 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:17.822289 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8597f-e1e4-45d8-ab82-65658bc6f483 None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:17.822905 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8597f-e1e4-45d8-ab82-65658bc6f483 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:17.823348 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8597f-e1e4-45d8-ab82-65658bc6f483 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:17.824956 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8597f-e1e4-45d8-ab82-65658bc6f483 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:17.837825 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 580/1150] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:15:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:17.845303 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ae495-3b2a-42a2-a88f-c6243a680b61 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:17.859129 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:17.967932 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ae495-3b2a-42a2-a88f-c6243a680b61 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:18.012470 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36ac20-19e8-4a6d-b25a-ed5ab4006452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:18.013018 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36ac20-19e8-4a6d-b25a-ed5ab4006452 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:18.013297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36ac20-19e8-4a6d-b25a-ed5ab4006452 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:18.013739 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36ac20-19e8-4a6d-b25a-ed5ab4006452 None admin] PATH_INFO: `/v3/users/cbe17f18b98d4b73a2909280395c6e13` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:18.015033 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36ac20-19e8-4a6d-b25a-ed5ab4006452 None admin] RBAC: Authorizing `identity:get_user(user_id=cbe17f18b98d4b73a2909280395c6e13)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:18.016497 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36ac20-19e8-4a6d-b25a-ed5ab4006452 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:18.018251 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 571/1151] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:15:17 2022] GET /identity/v3/users/cbe17f18b98d4b73a2909280395c6e13 => generated 286 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:18.025249 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8597f-e1e4-45d8-ab82-65658bc6f483 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:18.064825 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:18.143723 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8597f-e1e4-45d8-ab82-65658bc6f483 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:18.181062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176927f1-12a9-4a8c-acfe-701ab1f6d7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:18.181735 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176927f1-12a9-4a8c-acfe-701ab1f6d7a2 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:18.182021 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176927f1-12a9-4a8c-acfe-701ab1f6d7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:18.182287 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176927f1-12a9-4a8c-acfe-701ab1f6d7a2 None admin] PATH_INFO: `/v3/projects/f28022f21b0a41ae9e5c55a767eefe65` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:18.183457 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176927f1-12a9-4a8c-acfe-701ab1f6d7a2 None admin] RBAC: Authorizing `identity:get_project(project_id=f28022f21b0a41ae9e5c55a767eefe65)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:18.185150 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176927f1-12a9-4a8c-acfe-701ab1f6d7a2 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:18.186874 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 581/1152] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:15:18 2022] GET /identity/v3/projects/f28022f21b0a41ae9e5c55a767eefe65 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:18.197300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36ac20-19e8-4a6d-b25a-ed5ab4006452 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:18.279238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:18.323014 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36ac20-19e8-4a6d-b25a-ed5ab4006452 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:18.372546 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73697cb0-341a-4263-8410-7493c3c33ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:18.373205 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73697cb0-341a-4263-8410-7493c3c33ef9 None admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:18.373512 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73697cb0-341a-4263-8410-7493c3c33ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:18.373786 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73697cb0-341a-4263-8410-7493c3c33ef9 None admin] PATH_INFO: `/v3/projects/f28022f21b0a41ae9e5c55a767eefe65/users/cbe17f18b98d4b73a2909280395c6e13/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:18.375757 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73697cb0-341a-4263-8410-7493c3c33ef9 None admin] RBAC: Authorizing `identity:create_grant(project_id=f28022f21b0a41ae9e5c55a767eefe65, user_id=cbe17f18b98d4b73a2909280395c6e13, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:18.377498 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73697cb0-341a-4263-8410-7493c3c33ef9 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:18.393983 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 572/1153] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Aug 23 22:15:18 2022] PUT /identity/v3/projects/f28022f21b0a41ae9e5c55a767eefe65/users/cbe17f18b98d4b73a2909280395c6e13/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:15:20.400128 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748344e-0eaa-4fc0-97a9-52ad29ba04de None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:20.400759 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748344e-0eaa-4fc0-97a9-52ad29ba04de None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:20.401075 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748344e-0eaa-4fc0-97a9-52ad29ba04de None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:20.403651 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 582/1154] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:15:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:15:20.412565 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e0dc1-0ab1-48ae-9eae-d5e801677457 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:20.413537 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e0dc1-0ab1-48ae-9eae-d5e801677457 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:20.413537 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e0dc1-0ab1-48ae-9eae-d5e801677457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:20.435069 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-b93e0dc1-0ab1-48ae-9eae-d5e801677457 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:20.436432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-b93e0dc1-0ab1-48ae-9eae-d5e801677457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:20.521168 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 573/1155] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:15:20.801640 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748344e-0eaa-4fc0-97a9-52ad29ba04de None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:20.918448 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:20.923681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748344e-0eaa-4fc0-97a9-52ad29ba04de None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:20.962578 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd09c1-d19b-404f-9088-0d10e342444f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:20.963227 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd09c1-d19b-404f-9088-0d10e342444f None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:20.963505 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd09c1-d19b-404f-9088-0d10e342444f None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:20.963773 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd09c1-d19b-404f-9088-0d10e342444f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:20.975403 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd09c1-d19b-404f-9088-0d10e342444f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:15:20.980966 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-e1dd09c1-d19b-404f-9088-0d10e342444f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:15:20.980966 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:20.980966 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:20.980966 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:20.980966 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:20.980966 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:20.980966 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:20.980966 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:20.980966 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:20.980966 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:20.980966 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:20.980966 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:20.980966 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:15:20.980966 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:15:20.980966 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:15:20.980966 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:15:20.982364 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:15:20.982364 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:15:20.982364 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:15:20.982364 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:15:20.982364 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:20.982364 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:20.982364 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:20.982364 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:20.982364 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:20.982364 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:20.982364 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:20.982364 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:20.982364 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:20.982364 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:20.982364 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:20.982364 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:20.983714 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:20.983714 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:20.983714 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:20.983714 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:20.983714 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:15:20.983714 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:15:20.983714 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:15:20.983714 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:15:20.983714 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:15:20.983714 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:15:20.983714 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:15:20.983714 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:15:20.983714 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 583/1156] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:15:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:20.988549 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e0dc1-0ab1-48ae-9eae-d5e801677457 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:21.059556 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:21.106749 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e0dc1-0ab1-48ae-9eae-d5e801677457 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:21.147224 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbcebb4-a5d6-460a-a991-fd40a8790f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:21.148435 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcebb4-a5d6-460a-a991-fd40a8790f4f None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:21.148759 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcebb4-a5d6-460a-a991-fd40a8790f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:21.149082 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcebb4-a5d6-460a-a991-fd40a8790f4f None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:21.149870 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbcebb4-a5d6-460a-a991-fd40a8790f4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:21.150219 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbcebb4-a5d6-460a-a991-fd40a8790f4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:21.151671 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbcebb4-a5d6-460a-a991-fd40a8790f4f None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:21.161225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 574/1157] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:15:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:21.167996 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd09c1-d19b-404f-9088-0d10e342444f None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:21.309772 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd09c1-d19b-404f-9088-0d10e342444f None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:21.353425 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea240a-3a31-49fc-889e-80052b81b1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:21.354150 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea240a-3a31-49fc-889e-80052b81b1fa None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:21.354470 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea240a-3a31-49fc-889e-80052b81b1fa None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:21.354784 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea240a-3a31-49fc-889e-80052b81b1fa None admin] PATH_INFO: `/v3/users/cbe17f18b98d4b73a2909280395c6e13` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:21.356121 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea240a-3a31-49fc-889e-80052b81b1fa None admin] RBAC: Authorizing `identity:get_user(user_id=cbe17f18b98d4b73a2909280395c6e13)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:21.357982 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea240a-3a31-49fc-889e-80052b81b1fa None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:21.360991 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 584/1158] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:15:21 2022] GET /identity/v3/users/cbe17f18b98d4b73a2909280395c6e13 => generated 286 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:21.367935 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbcebb4-a5d6-460a-a991-fd40a8790f4f None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:21.505100 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbcebb4-a5d6-460a-a991-fd40a8790f4f None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:21.546795 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:21.564672 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1e3a5-c997-4323-96a2-d91c1818ae69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:21.565668 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1e3a5-c997-4323-96a2-d91c1818ae69 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:21.566164 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1e3a5-c997-4323-96a2-d91c1818ae69 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:21.566651 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1e3a5-c997-4323-96a2-d91c1818ae69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:21.656963 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1e3a5-c997-4323-96a2-d91c1818ae69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:21.658591 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1e3a5-c997-4323-96a2-d91c1818ae69 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:21.792811 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 575/1159] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:15:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:15:21.799635 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea240a-3a31-49fc-889e-80052b81b1fa None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:21.830840 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:21.910602 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea240a-3a31-49fc-889e-80052b81b1fa None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:21.950811 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8718671-fb21-4973-bfca-489ed647c95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:21.951456 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8718671-fb21-4973-bfca-489ed647c95d None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:21.951735 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8718671-fb21-4973-bfca-489ed647c95d None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:21.952011 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8718671-fb21-4973-bfca-489ed647c95d None admin] PATH_INFO: `/v3/projects/f28022f21b0a41ae9e5c55a767eefe65` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:21.953153 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8718671-fb21-4973-bfca-489ed647c95d None admin] RBAC: Authorizing `identity:get_project(project_id=f28022f21b0a41ae9e5c55a767eefe65)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:21.954618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8718671-fb21-4973-bfca-489ed647c95d None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:21.956286 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 585/1160] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:15:21 2022] GET /identity/v3/projects/f28022f21b0a41ae9e5c55a767eefe65 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:21.963409 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1e3a5-c997-4323-96a2-d91c1818ae69 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:21.993509 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:22.079451 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1e3a5-c997-4323-96a2-d91c1818ae69 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:22.117433 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953afe9c-4ce8-4cd0-9571-8af23f376e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:22.117971 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953afe9c-4ce8-4cd0-9571-8af23f376e5a None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:22.118256 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953afe9c-4ce8-4cd0-9571-8af23f376e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:22.118536 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953afe9c-4ce8-4cd0-9571-8af23f376e5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:22.119275 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953afe9c-4ce8-4cd0-9571-8af23f376e5a None admin] RBAC: Adding query filter params (role.id=e806ce849cf34b92979b5524f3ea9ff6, scope.project.id=f28022f21b0a41ae9e5c55a767eefe65, user.id=cbe17f18b98d4b73a2909280395c6e13) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:22.119587 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953afe9c-4ce8-4cd0-9571-8af23f376e5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:22.121026 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953afe9c-4ce8-4cd0-9571-8af23f376e5a None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:22.127342 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 576/1161] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:15:21 2022] GET /identity/v3/role_assignments?user.id=cbe17f18b98d4b73a2909280395c6e13&scope.project.id=f28022f21b0a41ae9e5c55a767eefe65&role.id=e806ce849cf34b92979b5524f3ea9ff6 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:24.166694 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d2486-dc06-4159-b5f1-a13db8bd54b7 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:24.167204 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d2486-dc06-4159-b5f1-a13db8bd54b7 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:24.167616 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d2486-dc06-4159-b5f1-a13db8bd54b7 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:24.170271 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 586/1162] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:15:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:15:24.176162 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2b8a0-0fb4-44a9-af1f-f832aab04edf None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:24.176668 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2b8a0-0fb4-44a9-af1f-f832aab04edf None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:24.176760 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2b8a0-0fb4-44a9-af1f-f832aab04edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:24.198429 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-9ce2b8a0-0fb4-44a9-af1f-f832aab04edf None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:24.199711 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-9ce2b8a0-0fb4-44a9-af1f-f832aab04edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:24.275021 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 577/1163] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:15:24.562169 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d2486-dc06-4159-b5f1-a13db8bd54b7 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:24.691878 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:24.700682 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d2486-dc06-4159-b5f1-a13db8bd54b7 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:24.744702 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26b181-310a-4e11-b66e-1470cf09b741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:24.745405 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26b181-310a-4e11-b66e-1470cf09b741 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:24.745745 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26b181-310a-4e11-b66e-1470cf09b741 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:24.746063 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26b181-310a-4e11-b66e-1470cf09b741 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:24.827752 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26b181-310a-4e11-b66e-1470cf09b741 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:24.830416 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26b181-310a-4e11-b66e-1470cf09b741 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:24.997604 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:25.009709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 587/1164] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:15:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:15:25.015818 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2b8a0-0fb4-44a9-af1f-f832aab04edf None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:25.040765 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:25.147698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2b8a0-0fb4-44a9-af1f-f832aab04edf None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:25.189177 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d211c1-aee0-4ffb-a7a4-d544ebefbadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:25.190211 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d211c1-aee0-4ffb-a7a4-d544ebefbadd None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:25.190211 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d211c1-aee0-4ffb-a7a4-d544ebefbadd None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:25.190515 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d211c1-aee0-4ffb-a7a4-d544ebefbadd None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:25.198518 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d211c1-aee0-4ffb-a7a4-d544ebefbadd None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:25.199998 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d211c1-aee0-4ffb-a7a4-d544ebefbadd None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:25.215560 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-a6d211c1-aee0-4ffb-a7a4-d544ebefbadd None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 23 22:15:25.215560 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:25.215560 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 23 22:15:25.215560 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 23 22:15:25.215560 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:15:25.215560 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:15:25.215560 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:15:25.215560 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:15:25.215560 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 23 22:15:25.215560 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:15:25.215560 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:15:25.215560 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:15:25.215560 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:25.215560 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:25.215560 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:25.215560 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:25.215560 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:25.217634 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:25.217634 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:25.217634 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:25.217634 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:25.217634 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:25.217634 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:25.217634 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:15:25.217634 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:15:25.217634 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:15:25.217634 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:15:25.217634 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:25.217634 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:25.217634 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:25.217634 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:25.217634 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:25.217634 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:25.218987 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:25.218987 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:25.218987 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:25.218987 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:25.218987 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:25.218987 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:25.218987 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:25.218987 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:25.218987 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:25.218987 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:25.218987 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 23 22:15:25.218987 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:15:25.218987 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 23 22:15:25.218987 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:15:25.218987 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 578/1165] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Aug 23 22:15:25 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:25.223800 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26b181-310a-4e11-b66e-1470cf09b741 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:25.351940 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26b181-310a-4e11-b66e-1470cf09b741 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:25.395303 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ced46-6980-42b6-819f-0f5b96025488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:25.395920 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ced46-6980-42b6-819f-0f5b96025488 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:25.396193 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ced46-6980-42b6-819f-0f5b96025488 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:25.396468 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ced46-6980-42b6-819f-0f5b96025488 None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:25.397150 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ced46-6980-42b6-819f-0f5b96025488 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:25.398252 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ced46-6980-42b6-819f-0f5b96025488 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:25.399706 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ced46-6980-42b6-819f-0f5b96025488 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:25.408082 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 588/1166] 10.222.0.77 () {56 vars in 1115 bytes} [Tue Aug 23 22:15:25 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:27.470050 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab2f4e-400a-421e-8f0b-d79f6192918f None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:27.470607 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab2f4e-400a-421e-8f0b-d79f6192918f None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:27.470966 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab2f4e-400a-421e-8f0b-d79f6192918f None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:27.474565 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 579/1167] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:15:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:15:27.480646 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeed61c-beb5-40bd-a746-084ad00dac01 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:27.481413 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeed61c-beb5-40bd-a746-084ad00dac01 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:27.481413 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeed61c-beb5-40bd-a746-084ad00dac01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:27.506367 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-afeed61c-beb5-40bd-a746-084ad00dac01 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:27.508440 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-afeed61c-beb5-40bd-a746-084ad00dac01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:27.592237 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:27.611490 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 589/1168] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:15:27.953055 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab2f4e-400a-421e-8f0b-d79f6192918f None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:28.057094 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:28.088024 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab2f4e-400a-421e-8f0b-d79f6192918f None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:28.128969 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cff60b-08b2-4db4-97fe-88c670aa8133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:28.129747 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cff60b-08b2-4db4-97fe-88c670aa8133 None admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:28.130204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cff60b-08b2-4db4-97fe-88c670aa8133 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:28.130633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cff60b-08b2-4db4-97fe-88c670aa8133 None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:28.132238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cff60b-08b2-4db4-97fe-88c670aa8133 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:28.134735 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cff60b-08b2-4db4-97fe-88c670aa8133 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:28.156911 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 580/1169] 10.222.0.77 () {60 vars in 1138 bytes} [Tue Aug 23 22:15:27 2022] POST /identity/v3/domains => generated 267 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:15:30.476139 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4598dba-145e-4a86-ad04-ffd5ca5673b4 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:30.478892 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4598dba-145e-4a86-ad04-ffd5ca5673b4 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:30.478892 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4598dba-145e-4a86-ad04-ffd5ca5673b4 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:30.478892 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 590/1170] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:15:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:15:30.487686 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d3c8d-aeb6-4a1f-908d-ccc3c45c3182 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:30.488523 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d3c8d-aeb6-4a1f-908d-ccc3c45c3182 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:30.488523 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d3c8d-aeb6-4a1f-908d-ccc3c45c3182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:30.518857 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-3b1d3c8d-aeb6-4a1f-908d-ccc3c45c3182 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:30.520859 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-3b1d3c8d-aeb6-4a1f-908d-ccc3c45c3182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:30.630238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 581/1171] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:15:31.169975 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4598dba-145e-4a86-ad04-ffd5ca5673b4 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:31.314825 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4598dba-145e-4a86-ad04-ffd5ca5673b4 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:31.358845 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c448f6-bcc4-42b7-aa2a-10953bb9d337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:31.359576 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c448f6-bcc4-42b7-aa2a-10953bb9d337 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:31.359901 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c448f6-bcc4-42b7-aa2a-10953bb9d337 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:31.360224 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c448f6-bcc4-42b7-aa2a-10953bb9d337 None admin] PATH_INFO: `/v3/domains/f0e14120c8de4949be7c499d2b2c8e66` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:31.374182 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c448f6-bcc4-42b7-aa2a-10953bb9d337 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f0e14120c8de4949be7c499d2b2c8e66)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:31.375681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c448f6-bcc4-42b7-aa2a-10953bb9d337 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:31.377770 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 591/1172] 10.222.0.77 () {56 vars in 1183 bytes} [Tue Aug 23 22:15:31 2022] GET /identity/v3/domains/f0e14120c8de4949be7c499d2b2c8e66 => generated 267 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:31.386683 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d3c8d-aeb6-4a1f-908d-ccc3c45c3182 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:31.473956 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:31.547933 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d3c8d-aeb6-4a1f-908d-ccc3c45c3182 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:31.607102 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513658a-ad49-434a-88cb-30a6ddf949d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:31.608060 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513658a-ad49-434a-88cb-30a6ddf949d7 None admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:31.608547 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513658a-ad49-434a-88cb-30a6ddf949d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:31.609009 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513658a-ad49-434a-88cb-30a6ddf949d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:31.610184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513658a-ad49-434a-88cb-30a6ddf949d7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:31.611872 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513658a-ad49-434a-88cb-30a6ddf949d7 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:31.651595 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 582/1173] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Aug 23 22:15:31 2022] POST /identity/v3/projects => generated 361 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:15:33.857188 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca584b4-ce85-4b81-b2ce-e34ff0f43890 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:33.858009 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca584b4-ce85-4b81-b2ce-e34ff0f43890 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:33.858009 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca584b4-ce85-4b81-b2ce-e34ff0f43890 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:33.859258 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 592/1174] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:15:33.867422 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268e469-cfee-48d8-be41-10596c417fab None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:33.868023 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268e469-cfee-48d8-be41-10596c417fab None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:33.868330 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268e469-cfee-48d8-be41-10596c417fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:33.900406 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-b268e469-cfee-48d8-be41-10596c417fab None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:33.908983 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-b268e469-cfee-48d8-be41-10596c417fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:34.037422 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 583/1175] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:15:34.323096 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca584b4-ce85-4b81-b2ce-e34ff0f43890 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:34.382448 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:34.458918 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca584b4-ce85-4b81-b2ce-e34ff0f43890 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:34.510022 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde10da-fcd7-4c24-bf07-95a41f9b8364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:34.510693 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde10da-fcd7-4c24-bf07-95a41f9b8364 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:34.510977 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde10da-fcd7-4c24-bf07-95a41f9b8364 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:34.511252 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde10da-fcd7-4c24-bf07-95a41f9b8364 None admin] PATH_INFO: `/v3/domains/f0e14120c8de4949be7c499d2b2c8e66` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:34.512658 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde10da-fcd7-4c24-bf07-95a41f9b8364 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f0e14120c8de4949be7c499d2b2c8e66)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:34.514740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde10da-fcd7-4c24-bf07-95a41f9b8364 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:34.516983 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 593/1176] 10.222.0.77 () {56 vars in 1183 bytes} [Tue Aug 23 22:15:34 2022] GET /identity/v3/domains/f0e14120c8de4949be7c499d2b2c8e66 => generated 267 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:15:34.524664 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268e469-cfee-48d8-be41-10596c417fab None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:34.606409 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:34.691251 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268e469-cfee-48d8-be41-10596c417fab None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:34.740308 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae38b71-cbd4-4d66-9ebf-9c0c7f515b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:34.741459 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae38b71-cbd4-4d66-9ebf-9c0c7f515b6b None admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:34.741875 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae38b71-cbd4-4d66-9ebf-9c0c7f515b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:34.742342 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae38b71-cbd4-4d66-9ebf-9c0c7f515b6b None admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:34.743563 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae38b71-cbd4-4d66-9ebf-9c0c7f515b6b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:34.746165 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae38b71-cbd4-4d66-9ebf-9c0c7f515b6b None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:34.783278 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 584/1177] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Aug 23 22:15:34 2022] POST /identity/v3/users => generated 311 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:15:38.514994 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb205e70-26a6-4295-8e0c-f808a5a60298 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:38.515838 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb205e70-26a6-4295-8e0c-f808a5a60298 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:38.515992 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb205e70-26a6-4295-8e0c-f808a5a60298 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:38.518663 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 594/1178] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:15:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:15:38.529888 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b65730-44ba-4a07-a8a3-f8cced89b60e None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:38.530706 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b65730-44ba-4a07-a8a3-f8cced89b60e None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:38.530875 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b65730-44ba-4a07-a8a3-f8cced89b60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:38.563186 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-92b65730-44ba-4a07-a8a3-f8cced89b60e None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:38.565318 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-92b65730-44ba-4a07-a8a3-f8cced89b60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:38.699005 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 585/1179] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:15:39.270870 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb205e70-26a6-4295-8e0c-f808a5a60298 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:39.496226 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb205e70-26a6-4295-8e0c-f808a5a60298 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:39.535952 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:39.572550 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df0a9b-0fc9-4534-b650-a684592291ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:39.573663 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df0a9b-0fc9-4534-b650-a684592291ef None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:39.574132 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df0a9b-0fc9-4534-b650-a684592291ef None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:39.574608 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df0a9b-0fc9-4534-b650-a684592291ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:39.598244 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df0a9b-0fc9-4534-b650-a684592291ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:15:39.609684 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-42df0a9b-0fc9-4534-b650-a684592291ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:15:39.609684 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:39.609684 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:39.609684 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:39.609684 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:39.609684 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:39.609684 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:39.609684 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:39.609684 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:39.609684 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:39.609684 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:39.609684 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:39.609684 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:15:39.609684 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:15:39.609684 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:15:39.609684 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:15:39.611768 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:15:39.611768 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:15:39.611768 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:15:39.611768 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:15:39.611768 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:39.611768 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:39.611768 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:39.611768 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:39.611768 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:39.611768 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:39.611768 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:39.611768 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:39.611768 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:39.611768 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:39.611768 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:39.611768 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:39.613715 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:39.613715 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:39.613715 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:39.613715 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:39.613715 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:15:39.613715 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:15:39.613715 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:15:39.613715 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:15:39.613715 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:15:39.613715 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:15:39.613715 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:15:39.613715 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:15:39.613715 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 595/1180] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:15:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:39.622538 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b65730-44ba-4a07-a8a3-f8cced89b60e None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:39.700975 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:39.828758 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b65730-44ba-4a07-a8a3-f8cced89b60e None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:39.884873 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f046cd1-cc45-4c3e-8d10-31b84c62acee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:39.885681 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f046cd1-cc45-4c3e-8d10-31b84c62acee None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:39.886066 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f046cd1-cc45-4c3e-8d10-31b84c62acee None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:39.886444 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f046cd1-cc45-4c3e-8d10-31b84c62acee None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:39.887226 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f046cd1-cc45-4c3e-8d10-31b84c62acee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:39.887635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f046cd1-cc45-4c3e-8d10-31b84c62acee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:39.889159 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f046cd1-cc45-4c3e-8d10-31b84c62acee None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:39.900182 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 586/1181] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:15:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:39.909444 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df0a9b-0fc9-4534-b650-a684592291ef None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:40.117148 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df0a9b-0fc9-4534-b650-a684592291ef None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:40.185446 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a60f7-dcb0-41b3-bf7d-e1848a70378d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:40.186500 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a60f7-dcb0-41b3-bf7d-e1848a70378d None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:40.186978 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a60f7-dcb0-41b3-bf7d-e1848a70378d None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:40.187439 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a60f7-dcb0-41b3-bf7d-e1848a70378d None admin] PATH_INFO: `/v3/users/0962a0c0cb274f84ad4254207a6476f7` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:40.216614 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a60f7-dcb0-41b3-bf7d-e1848a70378d None admin] RBAC: Authorizing `identity:get_user(user_id=0962a0c0cb274f84ad4254207a6476f7)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:40.219347 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a60f7-dcb0-41b3-bf7d-e1848a70378d None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:40.222612 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 596/1182] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:15:39 2022] GET /identity/v3/users/0962a0c0cb274f84ad4254207a6476f7 => generated 311 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:40.234116 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f046cd1-cc45-4c3e-8d10-31b84c62acee None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:40.423832 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:40.428980 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f046cd1-cc45-4c3e-8d10-31b84c62acee None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:40.499908 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43596fc6-00e4-4ca7-b329-3707dd26be62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:40.500979 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43596fc6-00e4-4ca7-b329-3707dd26be62 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:40.501506 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43596fc6-00e4-4ca7-b329-3707dd26be62 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:40.502004 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43596fc6-00e4-4ca7-b329-3707dd26be62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:40.617663 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43596fc6-00e4-4ca7-b329-3707dd26be62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:40.619233 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43596fc6-00e4-4ca7-b329-3707dd26be62 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:40.741053 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:40.748554 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 587/1183] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:15:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:15:40.758504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a60f7-dcb0-41b3-bf7d-e1848a70378d None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:40.829921 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:40.963091 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a60f7-dcb0-41b3-bf7d-e1848a70378d None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:41.019787 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b389f-5ebf-4a5e-8d8b-6c28d1825d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:41.020589 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b389f-5ebf-4a5e-8d8b-6c28d1825d48 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:41.020877 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b389f-5ebf-4a5e-8d8b-6c28d1825d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:41.021179 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b389f-5ebf-4a5e-8d8b-6c28d1825d48 None admin] PATH_INFO: `/v3/projects/a5dbb8a419f64c5bb67723c257cf35ab` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:41.023673 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b389f-5ebf-4a5e-8d8b-6c28d1825d48 None admin] RBAC: Authorizing `identity:get_project(project_id=a5dbb8a419f64c5bb67723c257cf35ab)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:41.025333 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b389f-5ebf-4a5e-8d8b-6c28d1825d48 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:41.027717 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 597/1184] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:15:40 2022] GET /identity/v3/projects/a5dbb8a419f64c5bb67723c257cf35ab => generated 361 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:41.034898 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43596fc6-00e4-4ca7-b329-3707dd26be62 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:41.169138 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43596fc6-00e4-4ca7-b329-3707dd26be62 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:41.213340 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9278582-a3f4-44ae-b242-dd0e563b292f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:41.214005 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9278582-a3f4-44ae-b242-dd0e563b292f None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:41.214286 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9278582-a3f4-44ae-b242-dd0e563b292f None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:41.214558 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9278582-a3f4-44ae-b242-dd0e563b292f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:41.215316 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9278582-a3f4-44ae-b242-dd0e563b292f None admin] RBAC: Adding query filter params (role.id=e806ce849cf34b92979b5524f3ea9ff6, scope.project.id=a5dbb8a419f64c5bb67723c257cf35ab, user.id=0962a0c0cb274f84ad4254207a6476f7) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:41.215627 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9278582-a3f4-44ae-b242-dd0e563b292f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:41.217248 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9278582-a3f4-44ae-b242-dd0e563b292f None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:41.224041 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 588/1185] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:15:41 2022] GET /identity/v3/role_assignments?user.id=0962a0c0cb274f84ad4254207a6476f7&scope.project.id=a5dbb8a419f64c5bb67723c257cf35ab&role.id=e806ce849cf34b92979b5524f3ea9ff6 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:43.321295 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00979a34-c40c-44df-b6b5-58cbc9747d5a None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:43.321964 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00979a34-c40c-44df-b6b5-58cbc9747d5a None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:43.321964 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00979a34-c40c-44df-b6b5-58cbc9747d5a None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:43.323964 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 598/1186] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:15:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:15:43.331631 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db502f7-6a6a-4471-8cf3-628ff98e81ed None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:43.332242 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db502f7-6a6a-4471-8cf3-628ff98e81ed None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:43.332441 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db502f7-6a6a-4471-8cf3-628ff98e81ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:43.357968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-5db502f7-6a6a-4471-8cf3-628ff98e81ed None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:43.359220 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-5db502f7-6a6a-4471-8cf3-628ff98e81ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:43.455714 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:43.466625 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 589/1187] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:15:43.766250 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00979a34-c40c-44df-b6b5-58cbc9747d5a None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:43.908077 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00979a34-c40c-44df-b6b5-58cbc9747d5a None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:43.911197 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:43.951924 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea8d67-9317-4702-aa75-8cb29c02c79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:43.952658 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea8d67-9317-4702-aa75-8cb29c02c79a None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:43.952966 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea8d67-9317-4702-aa75-8cb29c02c79a None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:43.953276 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea8d67-9317-4702-aa75-8cb29c02c79a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:43.970071 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ea8d67-9317-4702-aa75-8cb29c02c79a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:15:43.978722 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-86ea8d67-9317-4702-aa75-8cb29c02c79a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:15:43.978722 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:43.978722 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:43.978722 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:43.978722 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:43.978722 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:43.978722 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:43.978722 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:43.978722 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:43.978722 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:43.978722 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:43.978722 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:43.978722 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:15:43.978722 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:15:43.978722 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:15:43.978722 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:15:43.980767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:15:43.980767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:15:43.980767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:15:43.980767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:15:43.980767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:43.980767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:43.980767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:43.980767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:43.980767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:43.980767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:43.980767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:43.980767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:43.980767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:43.980767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:43.980767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:43.980767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:43.982489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:43.982489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:43.982489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:43.982489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:43.982489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:15:43.982489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:15:43.982489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:15:43.982489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:15:43.982489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:15:43.982489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:15:43.982489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:15:43.982489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:15:43.982489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 599/1188] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:15:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:43.990495 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db502f7-6a6a-4471-8cf3-628ff98e81ed None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:44.184022 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db502f7-6a6a-4471-8cf3-628ff98e81ed None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:44.225432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c665cd9-925b-4c55-98e3-bfc9b751f02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:44.226115 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c665cd9-925b-4c55-98e3-bfc9b751f02e None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:44.226451 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c665cd9-925b-4c55-98e3-bfc9b751f02e None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:44.226869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c665cd9-925b-4c55-98e3-bfc9b751f02e None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:44.227525 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c665cd9-925b-4c55-98e3-bfc9b751f02e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:44.227885 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c665cd9-925b-4c55-98e3-bfc9b751f02e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:44.229356 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c665cd9-925b-4c55-98e3-bfc9b751f02e None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:44.239189 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 590/1189] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:15:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:44.245731 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea8d67-9317-4702-aa75-8cb29c02c79a None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:44.366557 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea8d67-9317-4702-aa75-8cb29c02c79a None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:44.406619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73956790-4297-4065-a0dc-e707d20e0863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:44.407307 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73956790-4297-4065-a0dc-e707d20e0863 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:44.407584 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73956790-4297-4065-a0dc-e707d20e0863 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:44.407853 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73956790-4297-4065-a0dc-e707d20e0863 None admin] PATH_INFO: `/v3/users/0962a0c0cb274f84ad4254207a6476f7` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:44.409045 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73956790-4297-4065-a0dc-e707d20e0863 None admin] RBAC: Authorizing `identity:get_user(user_id=0962a0c0cb274f84ad4254207a6476f7)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:44.410544 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73956790-4297-4065-a0dc-e707d20e0863 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:44.412752 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 600/1190] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:15:44 2022] GET /identity/v3/users/0962a0c0cb274f84ad4254207a6476f7 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:44.418792 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c665cd9-925b-4c55-98e3-bfc9b751f02e None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:44.480888 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:44.530202 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c665cd9-925b-4c55-98e3-bfc9b751f02e None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:44.569158 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39e6e3-3edf-441a-9007-1460e91f79ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:44.569943 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39e6e3-3edf-441a-9007-1460e91f79ec None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:44.570261 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39e6e3-3edf-441a-9007-1460e91f79ec None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:44.570577 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39e6e3-3edf-441a-9007-1460e91f79ec None admin] PATH_INFO: `/v3/projects/a5dbb8a419f64c5bb67723c257cf35ab` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:44.571778 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39e6e3-3edf-441a-9007-1460e91f79ec None admin] RBAC: Authorizing `identity:get_project(project_id=a5dbb8a419f64c5bb67723c257cf35ab)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:44.573239 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39e6e3-3edf-441a-9007-1460e91f79ec None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:44.575216 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 591/1191] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:15:44 2022] GET /identity/v3/projects/a5dbb8a419f64c5bb67723c257cf35ab => generated 361 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:44.582015 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73956790-4297-4065-a0dc-e707d20e0863 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:44.622002 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:44.696612 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73956790-4297-4065-a0dc-e707d20e0863 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:44.737869 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeed11d-bf0b-4ef7-95f8-ac6242dfa0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:44.738567 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeed11d-bf0b-4ef7-95f8-ac6242dfa0eb None admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:44.738902 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeed11d-bf0b-4ef7-95f8-ac6242dfa0eb None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:44.739181 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeed11d-bf0b-4ef7-95f8-ac6242dfa0eb None admin] PATH_INFO: `/v3/projects/a5dbb8a419f64c5bb67723c257cf35ab/users/0962a0c0cb274f84ad4254207a6476f7/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:44.742271 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeed11d-bf0b-4ef7-95f8-ac6242dfa0eb None admin] RBAC: Authorizing `identity:create_grant(project_id=a5dbb8a419f64c5bb67723c257cf35ab, user_id=0962a0c0cb274f84ad4254207a6476f7, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:44.743732 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeed11d-bf0b-4ef7-95f8-ac6242dfa0eb None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:44.758651 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 601/1192] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Aug 23 22:15:44 2022] PUT /identity/v3/projects/a5dbb8a419f64c5bb67723c257cf35ab/users/0962a0c0cb274f84ad4254207a6476f7/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:15:46.714459 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5e92e-6536-4c79-9ab4-276e13322e37 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:46.715033 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5e92e-6536-4c79-9ab4-276e13322e37 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:46.715033 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5e92e-6536-4c79-9ab4-276e13322e37 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:46.716656 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 592/1193] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:15:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:15:46.723132 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07569fd5-9582-44ca-a8c5-7b2a161143a4 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:46.725066 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07569fd5-9582-44ca-a8c5-7b2a161143a4 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:46.725066 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07569fd5-9582-44ca-a8c5-7b2a161143a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:46.748447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-07569fd5-9582-44ca-a8c5-7b2a161143a4 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:46.749729 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-07569fd5-9582-44ca-a8c5-7b2a161143a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:46.840976 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 602/1194] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:15:47.114417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5e92e-6536-4c79-9ab4-276e13322e37 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:47.259440 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5e92e-6536-4c79-9ab4-276e13322e37 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:47.289462 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:47.301696 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5c1a0-a13c-4c4e-a91d-e1e02c6aece9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:47.302490 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5c1a0-a13c-4c4e-a91d-e1e02c6aece9 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:47.302860 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5c1a0-a13c-4c4e-a91d-e1e02c6aece9 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:47.303223 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5c1a0-a13c-4c4e-a91d-e1e02c6aece9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:47.315324 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5c1a0-a13c-4c4e-a91d-e1e02c6aece9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:15:47.320125 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-96b5c1a0-a13c-4c4e-a91d-e1e02c6aece9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:15:47.320125 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:47.320125 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:47.320125 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:47.320125 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:47.320125 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:47.320125 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:47.320125 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:47.320125 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:47.320125 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:47.320125 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:47.320125 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:47.320125 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:15:47.320125 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:15:47.320125 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:15:47.320125 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:15:47.321967 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:15:47.321967 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:15:47.321967 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:15:47.321967 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:15:47.321967 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:47.321967 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:47.321967 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:47.321967 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:47.321967 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:47.321967 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:47.321967 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:47.321967 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:47.321967 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:47.321967 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:47.321967 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:47.321967 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:47.323658 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:47.323658 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:47.323658 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:47.323658 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:47.323658 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:15:47.323658 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:15:47.323658 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:15:47.323658 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:15:47.323658 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:15:47.323658 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:15:47.323658 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:15:47.323658 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:15:47.323658 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 593/1195] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:15:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:47.327647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07569fd5-9582-44ca-a8c5-7b2a161143a4 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:47.358755 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:47.458392 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07569fd5-9582-44ca-a8c5-7b2a161143a4 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:47.502096 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0211a-4e04-418e-bf35-64a0b0963cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:47.502778 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0211a-4e04-418e-bf35-64a0b0963cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:47.503065 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0211a-4e04-418e-bf35-64a0b0963cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:47.503334 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0211a-4e04-418e-bf35-64a0b0963cf4 None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:47.504022 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0211a-4e04-418e-bf35-64a0b0963cf4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:47.505202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0211a-4e04-418e-bf35-64a0b0963cf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:47.506404 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0211a-4e04-418e-bf35-64a0b0963cf4 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:47.516962 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 603/1196] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:15:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:47.523952 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5c1a0-a13c-4c4e-a91d-e1e02c6aece9 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:47.667923 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5c1a0-a13c-4c4e-a91d-e1e02c6aece9 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:47.733955 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2be030-f921-40bd-abef-0a180fb41d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:47.734985 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2be030-f921-40bd-abef-0a180fb41d3f None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:47.735497 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2be030-f921-40bd-abef-0a180fb41d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:47.735975 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2be030-f921-40bd-abef-0a180fb41d3f None admin] PATH_INFO: `/v3/users/0962a0c0cb274f84ad4254207a6476f7` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:47.738155 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2be030-f921-40bd-abef-0a180fb41d3f None admin] RBAC: Authorizing `identity:get_user(user_id=0962a0c0cb274f84ad4254207a6476f7)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:47.741546 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2be030-f921-40bd-abef-0a180fb41d3f None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:47.744925 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 594/1197] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Aug 23 22:15:47 2022] GET /identity/v3/users/0962a0c0cb274f84ad4254207a6476f7 => generated 311 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:47.753729 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0211a-4e04-418e-bf35-64a0b0963cf4 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:47.852476 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:47.871025 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0211a-4e04-418e-bf35-64a0b0963cf4 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:47.915586 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc28d5-1d98-4d77-8e33-d4ee3df03a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:47.916577 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc28d5-1d98-4d77-8e33-d4ee3df03a92 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:47.917049 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc28d5-1d98-4d77-8e33-d4ee3df03a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:47.917546 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc28d5-1d98-4d77-8e33-d4ee3df03a92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:47.995213 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc28d5-1d98-4d77-8e33-d4ee3df03a92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:47.996580 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc28d5-1d98-4d77-8e33-d4ee3df03a92 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:48.086957 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:48.115478 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 604/1198] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:15:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 22:15:48.122390 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2be030-f921-40bd-abef-0a180fb41d3f None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:48.179133 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:48.235606 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2be030-f921-40bd-abef-0a180fb41d3f None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:48.270969 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69f36d-ef13-4702-874e-e516ac3b5ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:48.272073 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69f36d-ef13-4702-874e-e516ac3b5ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:48.272350 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69f36d-ef13-4702-874e-e516ac3b5ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:48.272616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69f36d-ef13-4702-874e-e516ac3b5ad5 None admin] PATH_INFO: `/v3/projects/a5dbb8a419f64c5bb67723c257cf35ab` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:48.273824 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69f36d-ef13-4702-874e-e516ac3b5ad5 None admin] RBAC: Authorizing `identity:get_project(project_id=a5dbb8a419f64c5bb67723c257cf35ab)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:48.275278 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69f36d-ef13-4702-874e-e516ac3b5ad5 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:48.276952 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 595/1199] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Aug 23 22:15:48 2022] GET /identity/v3/projects/a5dbb8a419f64c5bb67723c257cf35ab => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:48.283307 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc28d5-1d98-4d77-8e33-d4ee3df03a92 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:48.392202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc28d5-1d98-4d77-8e33-d4ee3df03a92 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:48.429618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364ee45-c96a-4631-a253-e751f9ec2419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:48.430175 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364ee45-c96a-4631-a253-e751f9ec2419 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:48.430452 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364ee45-c96a-4631-a253-e751f9ec2419 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:48.430757 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364ee45-c96a-4631-a253-e751f9ec2419 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:48.431505 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364ee45-c96a-4631-a253-e751f9ec2419 None admin] RBAC: Adding query filter params (role.id=e806ce849cf34b92979b5524f3ea9ff6, scope.project.id=a5dbb8a419f64c5bb67723c257cf35ab, user.id=0962a0c0cb274f84ad4254207a6476f7) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:48.431857 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364ee45-c96a-4631-a253-e751f9ec2419 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:48.433605 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364ee45-c96a-4631-a253-e751f9ec2419 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:48.440673 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 605/1200] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:15:48 2022] GET /identity/v3/role_assignments?user.id=0962a0c0cb274f84ad4254207a6476f7&scope.project.id=a5dbb8a419f64c5bb67723c257cf35ab&role.id=e806ce849cf34b92979b5524f3ea9ff6 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:58.266689 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=40 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:58.437740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=76 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:54.127148 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8f53f-4660-4f0f-b941-4a593a9e3e52 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:54.131767 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8f53f-4660-4f0f-b941-4a593a9e3e52 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:54.131767 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8f53f-4660-4f0f-b941-4a593a9e3e52 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:54.133324 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 596/1201] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:16:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:16:54.141664 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37484c5e-d0e0-46a1-b84e-0653ecdf036b None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:54.144652 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37484c5e-d0e0-46a1-b84e-0653ecdf036b None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:54.144652 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37484c5e-d0e0-46a1-b84e-0653ecdf036b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:54.177169 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-37484c5e-d0e0-46a1-b84e-0653ecdf036b None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:16:54.178808 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-37484c5e-d0e0-46a1-b84e-0653ecdf036b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:54.315454 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 606/1202] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:16:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:16:54.753939 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8f53f-4660-4f0f-b941-4a593a9e3e52 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:16:54.936231 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8f53f-4660-4f0f-b941-4a593a9e3e52 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:16:55.011490 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a90cd-08d5-4934-aa54-002891013643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:16:55.012470 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a90cd-08d5-4934-aa54-002891013643 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:55.013007 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a90cd-08d5-4934-aa54-002891013643 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:55.013532 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a90cd-08d5-4934-aa54-002891013643 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:55.039756 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a90cd-08d5-4934-aa54-002891013643 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:16:55.042521 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a90cd-08d5-4934-aa54-002891013643 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:16:55.076698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-338a90cd-08d5-4934-aa54-002891013643 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:16:55.076698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:16:55.076698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:16:55.076698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:16:55.076698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:16:55.076698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:16:55.076698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:16:55.076698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:16:55.076698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:16:55.076698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:16:55.076698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:16:55.076698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:16:55.076698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:16:55.076698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:16:55.076698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:16:55.076698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:16:55.081783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:16:55.081783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:16:55.081783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:16:55.081783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:16:55.081783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:16:55.081783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:16:55.081783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:16:55.081783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:16:55.081783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:16:55.081783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:16:55.081783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:16:55.081783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:16:55.081783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:16:55.081783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:16:55.081783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:16:55.081783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:16:55.081783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:16:55.083791 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:16:55.083791 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:16:55.083791 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:16:55.083791 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 597/1203] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:16:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:16:55.094495 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37484c5e-d0e0-46a1-b84e-0653ecdf036b None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:16:55.304069 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37484c5e-d0e0-46a1-b84e-0653ecdf036b None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:16:55.359517 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:55.379490 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ff673-09db-4973-a6ef-4b8356f03edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:16:55.381065 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ff673-09db-4973-a6ef-4b8356f03edd None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:55.381584 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ff673-09db-4973-a6ef-4b8356f03edd None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:55.382003 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ff673-09db-4973-a6ef-4b8356f03edd None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:55.383215 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ff673-09db-4973-a6ef-4b8356f03edd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:16:55.391022 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ff673-09db-4973-a6ef-4b8356f03edd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:16:55.393827 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ff673-09db-4973-a6ef-4b8356f03edd None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:16:55.413139 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 607/1204] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:16:55.419618 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a90cd-08d5-4934-aa54-002891013643 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:16:55.531957 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:55.620363 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a90cd-08d5-4934-aa54-002891013643 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:16:55.701667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11759eee-0c35-439b-8305-534a61313778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:16:55.702742 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11759eee-0c35-439b-8305-534a61313778 None admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:55.703233 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11759eee-0c35-439b-8305-534a61313778 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:55.703713 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11759eee-0c35-439b-8305-534a61313778 None admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:55.704962 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11759eee-0c35-439b-8305-534a61313778 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:16:55.709752 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11759eee-0c35-439b-8305-534a61313778 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:16:55.758225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 598/1205] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Aug 23 22:16:55 2022] POST /identity/v3/users => generated 251 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:16:58.543177 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791b125-c8a6-4a1d-9e67-90f6c82a0b4a None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:58.543907 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791b125-c8a6-4a1d-9e67-90f6c82a0b4a None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:58.543907 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791b125-c8a6-4a1d-9e67-90f6c82a0b4a None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:58.547747 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 608/1206] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:16:58.555121 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa11cfd-236e-4a3c-bbad-86563933916a None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:58.556423 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa11cfd-236e-4a3c-bbad-86563933916a None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:58.556423 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa11cfd-236e-4a3c-bbad-86563933916a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:58.578577 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-9fa11cfd-236e-4a3c-bbad-86563933916a None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:16:58.579947 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-9fa11cfd-236e-4a3c-bbad-86563933916a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:58.702694 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 599/1207] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:16:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:16:59.086993 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791b125-c8a6-4a1d-9e67-90f6c82a0b4a None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:16:59.293701 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791b125-c8a6-4a1d-9e67-90f6c82a0b4a None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:16:59.362684 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d025bb-c06b-434e-99e7-6d86481ee1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:16:59.362684 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d025bb-c06b-434e-99e7-6d86481ee1a9 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:59.363105 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d025bb-c06b-434e-99e7-6d86481ee1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:59.363592 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d025bb-c06b-434e-99e7-6d86481ee1a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:59.389051 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d025bb-c06b-434e-99e7-6d86481ee1a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:16:59.400647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-e2d025bb-c06b-434e-99e7-6d86481ee1a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:16:59.400647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:16:59.400647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:16:59.400647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:16:59.400647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:16:59.400647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:16:59.400647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:16:59.400647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:16:59.400647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:16:59.400647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:16:59.400647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:16:59.400647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:16:59.400647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:16:59.400647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:16:59.400647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:16:59.400647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:16:59.402767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:16:59.402767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:16:59.402767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:16:59.402767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:16:59.402767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:16:59.402767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:16:59.402767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:16:59.402767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:16:59.402767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:16:59.402767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:16:59.402767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:16:59.402767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:16:59.402767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:16:59.402767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:16:59.402767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:16:59.402767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:16:59.404843 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:16:59.404843 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:16:59.404843 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:16:59.404843 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:16:59.404843 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:16:59.404843 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:16:59.404843 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:16:59.404843 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:16:59.404843 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:16:59.404843 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:16:59.404843 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:16:59.404843 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:16:59.404843 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 609/1208] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Aug 23 22:16:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:16:59.412738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa11cfd-236e-4a3c-bbad-86563933916a None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:16:59.504172 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:59.611982 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa11cfd-236e-4a3c-bbad-86563933916a None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:16:59.667681 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e7765-0573-4893-b70e-27da4c3b870c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:16:59.667681 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e7765-0573-4893-b70e-27da4c3b870c None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:59.667681 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e7765-0573-4893-b70e-27da4c3b870c None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:59.668263 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e7765-0573-4893-b70e-27da4c3b870c None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:59.669198 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e7765-0573-4893-b70e-27da4c3b870c None admin] RBAC: Adding query filter params (name=service) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:16:59.669813 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e7765-0573-4893-b70e-27da4c3b870c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:16:59.671964 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e7765-0573-4893-b70e-27da4c3b870c None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:16:59.684906 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 600/1209] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Aug 23 22:16:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:16:59.694803 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d025bb-c06b-434e-99e7-6d86481ee1a9 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:16:59.797135 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:59.884616 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d025bb-c06b-434e-99e7-6d86481ee1a9 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:16:59.948308 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a681688-eb34-41ec-92fe-b3de3f95056d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:16:59.949643 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a681688-eb34-41ec-92fe-b3de3f95056d None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:59.950243 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a681688-eb34-41ec-92fe-b3de3f95056d None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:59.950786 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a681688-eb34-41ec-92fe-b3de3f95056d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:59.975538 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a681688-eb34-41ec-92fe-b3de3f95056d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:16:59.978432 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a681688-eb34-41ec-92fe-b3de3f95056d None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:00.011376 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-4a681688-eb34-41ec-92fe-b3de3f95056d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:17:00.011376 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:17:00.011376 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:17:00.011376 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:17:00.011376 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:17:00.011376 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:17:00.011376 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:17:00.011376 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:17:00.011376 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:17:00.011376 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:17:00.011376 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:17:00.011376 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:17:00.011376 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:17:00.011376 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:17:00.011376 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:17:00.011376 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:17:00.012659 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:17:00.012659 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:17:00.012659 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:17:00.012659 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:17:00.012659 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:17:00.012659 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:17:00.012659 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:17:00.012659 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:17:00.012659 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:17:00.012659 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:17:00.012659 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:17:00.012659 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:17:00.012659 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:17:00.012659 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:17:00.012659 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:17:00.012659 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:17:00.012659 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:17:00.019872 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:17:00.019872 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:17:00.019872 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:17:00.019872 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 610/1210] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:16:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:17:00.020554 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e7765-0573-4893-b70e-27da4c3b870c None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:00.232448 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:00.238842 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e7765-0573-4893-b70e-27da4c3b870c None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:00.289243 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc9470-9c83-42be-86c6-a09f093d9b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:00.290301 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc9470-9c83-42be-86c6-a09f093d9b41 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:00.290713 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc9470-9c83-42be-86c6-a09f093d9b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:00.291229 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc9470-9c83-42be-86c6-a09f093d9b41 None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:00.292200 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc9470-9c83-42be-86c6-a09f093d9b41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:00.292676 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc9470-9c83-42be-86c6-a09f093d9b41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:00.295385 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc9470-9c83-42be-86c6-a09f093d9b41 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:00.313419 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 601/1211] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:17:00.323373 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a681688-eb34-41ec-92fe-b3de3f95056d None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:00.514781 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a681688-eb34-41ec-92fe-b3de3f95056d None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:00.516527 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:00.575280 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ee612-7c42-4a49-a0af-3c941c764e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:00.576008 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ee612-7c42-4a49-a0af-3c941c764e28 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:00.576284 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ee612-7c42-4a49-a0af-3c941c764e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:00.576551 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ee612-7c42-4a49-a0af-3c941c764e28 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:00.592774 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ee612-7c42-4a49-a0af-3c941c764e28 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:00.595425 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ee612-7c42-4a49-a0af-3c941c764e28 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:00.613057 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-5e5ee612-7c42-4a49-a0af-3c941c764e28 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:17:00.613057 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:17:00.613057 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:17:00.613057 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:17:00.613057 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:17:00.613057 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:17:00.613057 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:17:00.613057 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:17:00.613057 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:17:00.613057 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:17:00.613057 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:17:00.613057 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:17:00.613057 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:17:00.613057 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:17:00.613057 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:17:00.613057 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:17:00.615152 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:17:00.615152 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:17:00.615152 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:17:00.615152 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:17:00.615152 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:17:00.615152 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:17:00.615152 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:17:00.615152 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:17:00.615152 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:17:00.615152 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:17:00.615152 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:17:00.615152 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:17:00.615152 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:17:00.615152 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:17:00.615152 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:17:00.615152 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:17:00.615152 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:17:00.615152 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:17:00.617290 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:17:00.617290 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:17:00.617290 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:17:00.617290 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:17:00.617290 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:17:00.617290 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:17:00.617290 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:17:00.617290 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:17:00.617290 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:17:00.617290 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:17:00.619744 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 611/1212] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:17:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:17:00.621629 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc9470-9c83-42be-86c6-a09f093d9b41 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:00.787026 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc9470-9c83-42be-86c6-a09f093d9b41 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:00.858836 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb357a5-2df1-474e-bdf2-cbd0831528c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:00.859761 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb357a5-2df1-474e-bdf2-cbd0831528c3 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:00.860038 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb357a5-2df1-474e-bdf2-cbd0831528c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:00.860358 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb357a5-2df1-474e-bdf2-cbd0831528c3 None admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:00.861316 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb357a5-2df1-474e-bdf2-cbd0831528c3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:00.861793 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb357a5-2df1-474e-bdf2-cbd0831528c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:00.863474 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb357a5-2df1-474e-bdf2-cbd0831528c3 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:00.888974 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 602/1213] 10.222.0.77 () {56 vars in 1143 bytes} [Tue Aug 23 22:17:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:17:00.896699 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ee612-7c42-4a49-a0af-3c941c764e28 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:01.078898 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ee612-7c42-4a49-a0af-3c941c764e28 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:01.130545 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96826bd8-9a53-49b6-ad47-8e93cc57b068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:01.131638 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96826bd8-9a53-49b6-ad47-8e93cc57b068 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:01.132008 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96826bd8-9a53-49b6-ad47-8e93cc57b068 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:01.132372 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96826bd8-9a53-49b6-ad47-8e93cc57b068 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:01.179247 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:01.233251 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96826bd8-9a53-49b6-ad47-8e93cc57b068 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:01.235492 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96826bd8-9a53-49b6-ad47-8e93cc57b068 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:01.370246 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 612/1214] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:17:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:17:01.380368 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb357a5-2df1-474e-bdf2-cbd0831528c3 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:01.413690 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:01.571721 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb357a5-2df1-474e-bdf2-cbd0831528c3 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:01.634281 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39c13e-fe75-4dfb-8e7b-b63bfca235f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:01.636413 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39c13e-fe75-4dfb-8e7b-b63bfca235f5 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:01.636413 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39c13e-fe75-4dfb-8e7b-b63bfca235f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:01.636413 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39c13e-fe75-4dfb-8e7b-b63bfca235f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:01.656103 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39c13e-fe75-4dfb-8e7b-b63bfca235f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:01.659168 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39c13e-fe75-4dfb-8e7b-b63bfca235f5 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:01.678858 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-0e39c13e-fe75-4dfb-8e7b-b63bfca235f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:17:01.678858 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:17:01.678858 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:17:01.678858 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:17:01.678858 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:17:01.678858 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:17:01.678858 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:17:01.678858 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:17:01.678858 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:17:01.678858 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:17:01.678858 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:17:01.678858 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:17:01.678858 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:17:01.678858 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:17:01.678858 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:17:01.678858 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:17:01.680456 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:17:01.680456 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:17:01.680456 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:17:01.680456 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:17:01.680456 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:17:01.680456 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:17:01.680456 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:17:01.680456 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:17:01.680456 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:17:01.680456 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:17:01.680456 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:17:01.680456 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:17:01.680456 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:17:01.680456 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:17:01.680456 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:17:01.680456 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:17:01.680456 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:17:01.683238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:17:01.683238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:17:01.683238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:17:01.683238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 603/1215] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:17:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:17:01.688166 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96826bd8-9a53-49b6-ad47-8e93cc57b068 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:01.810321 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:01.863912 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96826bd8-9a53-49b6-ad47-8e93cc57b068 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:01.922240 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee1722-409d-4f92-9624-4c7eba67f4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:01.923600 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee1722-409d-4f92-9624-4c7eba67f4fc None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:01.923600 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee1722-409d-4f92-9624-4c7eba67f4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:01.923600 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee1722-409d-4f92-9624-4c7eba67f4fc None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:01.924316 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee1722-409d-4f92-9624-4c7eba67f4fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:01.924568 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee1722-409d-4f92-9624-4c7eba67f4fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:01.930096 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee1722-409d-4f92-9624-4c7eba67f4fc None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:01.953080 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 613/1216] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:17:01.955938 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39c13e-fe75-4dfb-8e7b-b63bfca235f5 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:02.109731 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:02.192649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39c13e-fe75-4dfb-8e7b-b63bfca235f5 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:02.274130 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32749549-98d8-4ca1-abeb-1b50a94cfd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:02.275256 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32749549-98d8-4ca1-abeb-1b50a94cfd5d None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:02.275691 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32749549-98d8-4ca1-abeb-1b50a94cfd5d None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:02.276110 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32749549-98d8-4ca1-abeb-1b50a94cfd5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:02.295880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32749549-98d8-4ca1-abeb-1b50a94cfd5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:02.298478 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32749549-98d8-4ca1-abeb-1b50a94cfd5d None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:02.322296 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-32749549-98d8-4ca1-abeb-1b50a94cfd5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:17:02.322296 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:17:02.322296 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:17:02.322296 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:17:02.322296 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:17:02.322296 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:17:02.322296 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:17:02.322296 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:17:02.322296 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:17:02.322296 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:17:02.322296 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:17:02.322296 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:17:02.322296 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:17:02.322296 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:17:02.322296 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:17:02.326106 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:17:02.326106 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:17:02.326106 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:17:02.326106 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:17:02.326106 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:17:02.326106 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:17:02.326106 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:17:02.326106 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:17:02.326106 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:17:02.326106 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:17:02.326106 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:17:02.326106 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:17:02.326106 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:17:02.326106 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:17:02.326106 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:17:02.326106 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:17:02.326106 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:17:02.328267 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:17:02.328267 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:17:02.328267 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:17:02.328267 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:17:02.328267 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:17:02.328267 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:17:02.328267 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:17:02.328267 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:17:02.328267 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 604/1217] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:17:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:17:02.337864 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee1722-409d-4f92-9624-4c7eba67f4fc None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:02.556329 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee1722-409d-4f92-9624-4c7eba67f4fc None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:02.594130 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:02.623864 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cbabf-594b-420c-8e65-a929f6cd7c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:02.625099 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cbabf-594b-420c-8e65-a929f6cd7c28 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:02.625550 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cbabf-594b-420c-8e65-a929f6cd7c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:02.625975 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cbabf-594b-420c-8e65-a929f6cd7c28 None admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:02.627674 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330cbabf-594b-420c-8e65-a929f6cd7c28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:02.628172 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330cbabf-594b-420c-8e65-a929f6cd7c28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:02.630785 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330cbabf-594b-420c-8e65-a929f6cd7c28 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:02.657463 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 614/1218] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:17:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:17:02.666442 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32749549-98d8-4ca1-abeb-1b50a94cfd5d None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:02.836444 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32749549-98d8-4ca1-abeb-1b50a94cfd5d None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:02.886184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:02.895898 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc30ab9-b8a4-4a45-81d5-1b484cb96cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:02.896859 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc30ab9-b8a4-4a45-81d5-1b484cb96cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:02.897243 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc30ab9-b8a4-4a45-81d5-1b484cb96cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:02.897795 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc30ab9-b8a4-4a45-81d5-1b484cb96cd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:02.899312 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc30ab9-b8a4-4a45-81d5-1b484cb96cd8 None admin] RBAC: Adding query filter params (role.id=fb1c5c0f0edb47bf828f63bc685f98ba, scope.project.id=da9a86463d68412884746b115667d2fc, user.id=2000b80e34ae45d2a8b658cd394419f2) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:02.901591 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc30ab9-b8a4-4a45-81d5-1b484cb96cd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:02.904607 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc30ab9-b8a4-4a45-81d5-1b484cb96cd8 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:02.915445 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 605/1219] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:17:02 2022] GET /identity/v3/role_assignments?user.id=2000b80e34ae45d2a8b658cd394419f2&scope.project.id=da9a86463d68412884746b115667d2fc&role.id=fb1c5c0f0edb47bf828f63bc685f98ba => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:17:05.119707 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ac92a-adc8-4bfc-adf4-5c967677bf95 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:05.120418 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ac92a-adc8-4bfc-adf4-5c967677bf95 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:05.120731 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ac92a-adc8-4bfc-adf4-5c967677bf95 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:05.122878 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 615/1220] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:17:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:17:05.129766 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee818c02-cbc6-48a6-9cd6-4fa461df4646 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:05.131077 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee818c02-cbc6-48a6-9cd6-4fa461df4646 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:05.131077 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee818c02-cbc6-48a6-9cd6-4fa461df4646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:05.157425 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-ee818c02-cbc6-48a6-9cd6-4fa461df4646 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:17:05.160221 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-ee818c02-cbc6-48a6-9cd6-4fa461df4646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:05.266645 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 606/1221] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:17:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:17:05.560451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ac92a-adc8-4bfc-adf4-5c967677bf95 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:05.750284 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ac92a-adc8-4bfc-adf4-5c967677bf95 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:05.815333 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92647fb1-2a7d-4fe7-9e8d-2136fe67176f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:05.816284 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92647fb1-2a7d-4fe7-9e8d-2136fe67176f None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:05.816770 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92647fb1-2a7d-4fe7-9e8d-2136fe67176f None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:05.817251 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92647fb1-2a7d-4fe7-9e8d-2136fe67176f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:05.835972 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92647fb1-2a7d-4fe7-9e8d-2136fe67176f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:17:05.841418 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-92647fb1-2a7d-4fe7-9e8d-2136fe67176f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:17:05.841418 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:17:05.841418 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:17:05.841418 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:17:05.841418 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:17:05.841418 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:17:05.841418 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:17:05.841418 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:17:05.841418 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:17:05.841418 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:17:05.841418 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:17:05.841418 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:17:05.841418 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:17:05.841418 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:17:05.841418 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:17:05.841418 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:17:05.843271 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:17:05.843271 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:17:05.843271 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:17:05.843271 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:17:05.843271 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:17:05.843271 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:17:05.843271 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:17:05.843271 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:17:05.843271 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:17:05.843271 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:17:05.843271 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:17:05.843271 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:17:05.843271 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:17:05.843271 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:17:05.843271 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:17:05.843271 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:17:05.844617 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:17:05.844617 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:17:05.844617 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:17:05.844617 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:17:05.844617 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:17:05.844617 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:17:05.844617 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:17:05.844617 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:17:05.844617 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:17:05.844617 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:17:05.844617 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:17:05.844617 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:17:05.844617 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 616/1222] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Aug 23 22:17:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:17:05.850929 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee818c02-cbc6-48a6-9cd6-4fa461df4646 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:06.020727 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee818c02-cbc6-48a6-9cd6-4fa461df4646 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:06.055648 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:06.072688 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d26c97-d267-4867-8432-7fb1305284b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:06.073359 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d26c97-d267-4867-8432-7fb1305284b5 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:06.073719 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d26c97-d267-4867-8432-7fb1305284b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:06.074079 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d26c97-d267-4867-8432-7fb1305284b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:06.075274 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d26c97-d267-4867-8432-7fb1305284b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:06.075791 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d26c97-d267-4867-8432-7fb1305284b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:06.078412 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d26c97-d267-4867-8432-7fb1305284b5 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:06.093938 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 607/1223] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Aug 23 22:17:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:17:06.101342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92647fb1-2a7d-4fe7-9e8d-2136fe67176f None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:06.167959 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:06.245692 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92647fb1-2a7d-4fe7-9e8d-2136fe67176f None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:06.293913 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20aa3a-8b3a-40d3-b433-c52f348b04e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:06.294570 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20aa3a-8b3a-40d3-b433-c52f348b04e6 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:06.294853 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20aa3a-8b3a-40d3-b433-c52f348b04e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:06.295130 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20aa3a-8b3a-40d3-b433-c52f348b04e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:06.309835 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d20aa3a-8b3a-40d3-b433-c52f348b04e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:06.311751 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d20aa3a-8b3a-40d3-b433-c52f348b04e6 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:06.331883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-7d20aa3a-8b3a-40d3-b433-c52f348b04e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:17:06.331883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:17:06.331883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:17:06.331883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:17:06.331883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:17:06.331883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:17:06.331883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:17:06.331883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:17:06.331883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:17:06.331883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:17:06.331883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:17:06.331883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:17:06.331883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:17:06.331883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:17:06.331883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:17:06.331883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:17:06.333179 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:17:06.333179 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:17:06.333179 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:17:06.333179 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:17:06.333179 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:17:06.333179 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:17:06.333179 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:17:06.333179 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:17:06.333179 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:17:06.333179 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:17:06.333179 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:17:06.333179 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:17:06.333179 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:17:06.333179 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:17:06.333179 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:17:06.333179 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:17:06.333179 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:17:06.334294 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:17:06.334294 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:17:06.334294 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:17:06.334294 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 617/1224] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:17:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:17:06.340455 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d26c97-d267-4867-8432-7fb1305284b5 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:06.496464 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d26c97-d267-4867-8432-7fb1305284b5 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:06.545986 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da7722-80d7-4db7-a297-f5bb2d72e952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:06.546995 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da7722-80d7-4db7-a297-f5bb2d72e952 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:06.547412 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da7722-80d7-4db7-a297-f5bb2d72e952 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:06.547684 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da7722-80d7-4db7-a297-f5bb2d72e952 None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:06.549216 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da7722-80d7-4db7-a297-f5bb2d72e952 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:06.550125 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da7722-80d7-4db7-a297-f5bb2d72e952 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:06.551420 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da7722-80d7-4db7-a297-f5bb2d72e952 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:06.584771 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 608/1225] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:17:06.586030 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20aa3a-8b3a-40d3-b433-c52f348b04e6 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:06.713115 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:06.722585 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20aa3a-8b3a-40d3-b433-c52f348b04e6 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:06.765440 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b5942-1cf3-47c4-897f-6ca3c9ea2faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:06.766109 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b5942-1cf3-47c4-897f-6ca3c9ea2faa None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:06.766474 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b5942-1cf3-47c4-897f-6ca3c9ea2faa None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:06.766749 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b5942-1cf3-47c4-897f-6ca3c9ea2faa None admin] PATH_INFO: `/v3/users/placement` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:06.777402 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b5942-1cf3-47c4-897f-6ca3c9ea2faa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:06.779614 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b5942-1cf3-47c4-897f-6ca3c9ea2faa None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:06.800291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-1d0b5942-1cf3-47c4-897f-6ca3c9ea2faa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:17:06.800291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:17:06.800291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:17:06.800291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:17:06.800291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:17:06.800291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:17:06.800291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:17:06.800291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:17:06.800291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:17:06.800291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:17:06.800291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:17:06.800291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:17:06.800291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:17:06.800291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:17:06.800291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:17:06.800291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:17:06.802299 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:17:06.802299 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:17:06.802299 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:17:06.802299 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:17:06.802299 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:17:06.802299 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:17:06.802299 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:17:06.802299 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:17:06.802299 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:17:06.802299 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:17:06.802299 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:17:06.802299 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:17:06.802299 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:17:06.802299 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:17:06.802299 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:17:06.802299 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:17:06.802299 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:17:06.802299 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:17:06.804153 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:17:06.804153 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:17:06.804153 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:17:06.804153 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:17:06.804153 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:17:06.804153 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:17:06.804153 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:17:06.804153 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:17:06.804153 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:17:06.804153 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:17:06.804153 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 618/1226] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:17:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:17:06.817842 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da7722-80d7-4db7-a297-f5bb2d72e952 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:06.898234 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:06.991458 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da7722-80d7-4db7-a297-f5bb2d72e952 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:07.050059 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8338e1-d05d-46f2-964b-026372866654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:07.051416 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8338e1-d05d-46f2-964b-026372866654 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:07.051655 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8338e1-d05d-46f2-964b-026372866654 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:07.052151 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8338e1-d05d-46f2-964b-026372866654 None admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:07.053537 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8338e1-d05d-46f2-964b-026372866654 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:07.054066 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8338e1-d05d-46f2-964b-026372866654 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:07.057040 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8338e1-d05d-46f2-964b-026372866654 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:07.097528 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 609/1227] 10.222.0.77 () {56 vars in 1143 bytes} [Tue Aug 23 22:17:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:17:07.099480 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b5942-1cf3-47c4-897f-6ca3c9ea2faa None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:07.286626 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b5942-1cf3-47c4-897f-6ca3c9ea2faa None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:07.340475 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4dc97-c851-45be-87df-bd8a694c6a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:07.341515 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4dc97-c851-45be-87df-bd8a694c6a77 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:07.342023 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4dc97-c851-45be-87df-bd8a694c6a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:07.342555 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4dc97-c851-45be-87df-bd8a694c6a77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:07.366679 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f4dc97-c851-45be-87df-bd8a694c6a77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:07.369621 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f4dc97-c851-45be-87df-bd8a694c6a77 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:07.392910 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-48f4dc97-c851-45be-87df-bd8a694c6a77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:17:07.392910 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:17:07.392910 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:17:07.392910 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:17:07.392910 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:17:07.392910 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:17:07.392910 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:17:07.392910 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:17:07.392910 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:17:07.392910 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:17:07.392910 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:17:07.392910 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:17:07.392910 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:17:07.392910 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:17:07.392910 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:17:07.392910 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:17:07.394356 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:17:07.394356 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:17:07.394356 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:17:07.394356 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:17:07.394356 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:17:07.394356 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:17:07.394356 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:17:07.394356 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:17:07.394356 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:17:07.394356 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:17:07.394356 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:17:07.394356 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:17:07.394356 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:17:07.394356 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:17:07.394356 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:17:07.394356 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:17:07.394356 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:17:07.395525 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:17:07.395525 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:17:07.395525 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:17:07.395525 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 619/1228] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:17:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:17:07.403549 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8338e1-d05d-46f2-964b-026372866654 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:07.568509 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8338e1-d05d-46f2-964b-026372866654 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:07.571561 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:07.617858 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e876177-ec6e-40c2-9fab-93e58f004055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:07.618657 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e876177-ec6e-40c2-9fab-93e58f004055 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:07.619086 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e876177-ec6e-40c2-9fab-93e58f004055 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:07.619566 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e876177-ec6e-40c2-9fab-93e58f004055 None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:07.620329 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e876177-ec6e-40c2-9fab-93e58f004055 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:07.620718 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e876177-ec6e-40c2-9fab-93e58f004055 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:07.622660 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e876177-ec6e-40c2-9fab-93e58f004055 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:07.636982 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 610/1229] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:17:07.645125 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4dc97-c851-45be-87df-bd8a694c6a77 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:07.662639 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:07.816191 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4dc97-c851-45be-87df-bd8a694c6a77 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:07.859898 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85746839-d173-49a6-9ccb-996654cc0746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:07.860485 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85746839-d173-49a6-9ccb-996654cc0746 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:07.860972 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85746839-d173-49a6-9ccb-996654cc0746 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:07.862242 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85746839-d173-49a6-9ccb-996654cc0746 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:07.872180 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85746839-d173-49a6-9ccb-996654cc0746 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:07.874247 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85746839-d173-49a6-9ccb-996654cc0746 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:07.892261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-85746839-d173-49a6-9ccb-996654cc0746 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:17:07.892261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:17:07.892261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:17:07.892261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:17:07.892261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:17:07.892261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:17:07.892261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:17:07.892261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:17:07.892261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:17:07.892261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:17:07.892261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:17:07.892261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:17:07.892261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:17:07.892261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:17:07.892261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:17:07.894583 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:17:07.894583 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:17:07.894583 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:17:07.894583 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:17:07.894583 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:17:07.894583 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:17:07.894583 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:17:07.894583 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:17:07.894583 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:17:07.894583 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:17:07.894583 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:17:07.894583 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:17:07.894583 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:17:07.894583 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:17:07.894583 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:17:07.894583 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:17:07.894583 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:17:07.895829 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:17:07.895829 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:17:07.895829 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:17:07.895829 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:17:07.895829 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:17:07.895829 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:17:07.895829 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:17:07.895829 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:17:07.897481 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 620/1230] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:17:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:17:07.905538 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e876177-ec6e-40c2-9fab-93e58f004055 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:08.083159 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e876177-ec6e-40c2-9fab-93e58f004055 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:08.148696 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d38b5f-513e-4326-94de-d377da1fe7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:08.149916 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d38b5f-513e-4326-94de-d377da1fe7b4 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:08.150517 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d38b5f-513e-4326-94de-d377da1fe7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:08.151068 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d38b5f-513e-4326-94de-d377da1fe7b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:08.152609 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d38b5f-513e-4326-94de-d377da1fe7b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:08.153329 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d38b5f-513e-4326-94de-d377da1fe7b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:08.156555 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d38b5f-513e-4326-94de-d377da1fe7b4 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:08.175041 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 611/1231] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:17:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:17:08.183498 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85746839-d173-49a6-9ccb-996654cc0746 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:08.327263 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:08.395869 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85746839-d173-49a6-9ccb-996654cc0746 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:08.441562 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5445e3-4f3b-4829-8ca0-e52216ac9cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:08.442257 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5445e3-4f3b-4829-8ca0-e52216ac9cd7 None admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:08.442616 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5445e3-4f3b-4829-8ca0-e52216ac9cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:08.443150 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5445e3-4f3b-4829-8ca0-e52216ac9cd7 None admin] PATH_INFO: `/v3/projects/da9a86463d68412884746b115667d2fc/users/2000b80e34ae45d2a8b658cd394419f2/roles/fb1c5c0f0edb47bf828f63bc685f98ba` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:08.464316 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5445e3-4f3b-4829-8ca0-e52216ac9cd7 None admin] RBAC: Authorizing `identity:create_grant(project_id=da9a86463d68412884746b115667d2fc, user_id=2000b80e34ae45d2a8b658cd394419f2, role_id=fb1c5c0f0edb47bf828f63bc685f98ba)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:08.467650 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5445e3-4f3b-4829-8ca0-e52216ac9cd7 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:08.491095 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 621/1232] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Aug 23 22:17:08 2022] PUT /identity/v3/projects/da9a86463d68412884746b115667d2fc/users/2000b80e34ae45d2a8b658cd394419f2/roles/fb1c5c0f0edb47bf828f63bc685f98ba => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:17:10.714845 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3cdab-7429-4f4a-be13-29901ed77929 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:10.715687 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3cdab-7429-4f4a-be13-29901ed77929 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:10.715687 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3cdab-7429-4f4a-be13-29901ed77929 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:10.717043 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 612/1233] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:17:10.724240 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2f636-b29a-424a-a59a-e95d9242bba3 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:10.725020 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2f636-b29a-424a-a59a-e95d9242bba3 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:10.725530 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2f636-b29a-424a-a59a-e95d9242bba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:10.744679 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-b2f2f636-b29a-424a-a59a-e95d9242bba3 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:17:10.745942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-b2f2f636-b29a-424a-a59a-e95d9242bba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:10.844390 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 622/1234] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:17:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:17:11.136656 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3cdab-7429-4f4a-be13-29901ed77929 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:11.171750 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:11.284850 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3cdab-7429-4f4a-be13-29901ed77929 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:11.332844 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382bd1e-03ad-4981-8a6c-cfd0105bbcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:11.333607 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382bd1e-03ad-4981-8a6c-cfd0105bbcc1 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:11.333899 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382bd1e-03ad-4981-8a6c-cfd0105bbcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:11.334308 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382bd1e-03ad-4981-8a6c-cfd0105bbcc1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:11.347435 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4382bd1e-03ad-4981-8a6c-cfd0105bbcc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:17:11.352779 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-4382bd1e-03ad-4981-8a6c-cfd0105bbcc1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:17:11.352779 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:17:11.352779 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:17:11.352779 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:17:11.352779 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:17:11.352779 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:17:11.352779 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:17:11.352779 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:17:11.352779 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:17:11.352779 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:17:11.352779 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:17:11.352779 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:17:11.352779 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:17:11.352779 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:17:11.352779 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:17:11.352779 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:17:11.354014 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:17:11.354014 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:17:11.354014 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:17:11.354014 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:17:11.354014 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:17:11.354014 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:17:11.354014 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:17:11.354014 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:17:11.354014 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:17:11.354014 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:17:11.354014 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:17:11.354014 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:17:11.354014 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:17:11.354014 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:17:11.354014 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:17:11.354014 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:17:11.354883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:17:11.354883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:17:11.354883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:17:11.354883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:17:11.354883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:17:11.354883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:17:11.354883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:17:11.354883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:17:11.354883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:17:11.354883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:17:11.354883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:17:11.354883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:17:11.354883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 613/1235] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Aug 23 22:17:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:17:11.361282 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2f636-b29a-424a-a59a-e95d9242bba3 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:11.433626 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:11.521408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2f636-b29a-424a-a59a-e95d9242bba3 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:11.574890 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63911fe0-69ee-411d-b91a-6180da71bdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:11.575927 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63911fe0-69ee-411d-b91a-6180da71bdff None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:11.576302 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63911fe0-69ee-411d-b91a-6180da71bdff None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:11.576819 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63911fe0-69ee-411d-b91a-6180da71bdff None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:11.577964 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63911fe0-69ee-411d-b91a-6180da71bdff None admin] RBAC: Adding query filter params (name=service) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:11.578488 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63911fe0-69ee-411d-b91a-6180da71bdff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:11.581059 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63911fe0-69ee-411d-b91a-6180da71bdff None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:11.597395 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 623/1236] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Aug 23 22:17:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:17:11.606262 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382bd1e-03ad-4981-8a6c-cfd0105bbcc1 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:11.743867 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:11.770091 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382bd1e-03ad-4981-8a6c-cfd0105bbcc1 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:11.826186 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace1647-646a-42fa-aa8a-c69d42c13e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:11.826877 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace1647-646a-42fa-aa8a-c69d42c13e58 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:11.827187 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace1647-646a-42fa-aa8a-c69d42c13e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:11.827487 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace1647-646a-42fa-aa8a-c69d42c13e58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:11.841092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace1647-646a-42fa-aa8a-c69d42c13e58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:11.842957 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace1647-646a-42fa-aa8a-c69d42c13e58 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:11.864880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-7ace1647-646a-42fa-aa8a-c69d42c13e58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:17:11.864880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:17:11.864880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:17:11.864880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:17:11.864880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:17:11.864880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:17:11.864880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:17:11.864880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:17:11.864880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:17:11.864880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:17:11.864880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:17:11.864880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:17:11.864880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:17:11.864880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:17:11.864880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:17:11.864880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:17:11.866369 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:17:11.866369 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:17:11.866369 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:17:11.866369 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:17:11.866369 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:17:11.866369 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:17:11.866369 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:17:11.866369 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:17:11.866369 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:17:11.866369 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:17:11.866369 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:17:11.866369 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:17:11.866369 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:17:11.866369 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:17:11.866369 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:17:11.866369 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:17:11.866369 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:17:11.867407 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:17:11.867407 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:17:11.867407 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:17:11.867407 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 614/1237] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:17:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:17:11.872915 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63911fe0-69ee-411d-b91a-6180da71bdff None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:12.007119 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63911fe0-69ee-411d-b91a-6180da71bdff None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:12.019487 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:12.056205 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72c01d-84af-4c6a-818b-713cd3efc732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:12.056877 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72c01d-84af-4c6a-818b-713cd3efc732 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:12.057116 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72c01d-84af-4c6a-818b-713cd3efc732 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:12.057416 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72c01d-84af-4c6a-818b-713cd3efc732 None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:12.058076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72c01d-84af-4c6a-818b-713cd3efc732 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:12.058381 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72c01d-84af-4c6a-818b-713cd3efc732 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:12.059784 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72c01d-84af-4c6a-818b-713cd3efc732 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:12.076187 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 624/1238] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:17:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:17:12.084872 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace1647-646a-42fa-aa8a-c69d42c13e58 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:12.247046 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace1647-646a-42fa-aa8a-c69d42c13e58 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:12.302821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4851e0-361e-469c-9b8d-143c1edceb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:12.303389 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4851e0-361e-469c-9b8d-143c1edceb30 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:12.303687 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4851e0-361e-469c-9b8d-143c1edceb30 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:12.303982 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4851e0-361e-469c-9b8d-143c1edceb30 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:12.307544 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:12.314824 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4851e0-361e-469c-9b8d-143c1edceb30 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:12.316355 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4851e0-361e-469c-9b8d-143c1edceb30 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:12.329734 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-ac4851e0-361e-469c-9b8d-143c1edceb30 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:17:12.329734 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:17:12.329734 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:17:12.329734 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:17:12.329734 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:17:12.329734 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:17:12.329734 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:17:12.329734 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:17:12.329734 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:17:12.329734 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:17:12.329734 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:17:12.329734 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:17:12.329734 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:17:12.329734 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:17:12.329734 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:17:12.329734 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:17:12.331346 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:17:12.331346 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:17:12.331346 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:17:12.331346 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:17:12.331346 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:17:12.331346 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:17:12.331346 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:17:12.331346 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:17:12.331346 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:17:12.331346 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:17:12.331346 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:17:12.331346 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:17:12.331346 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:17:12.331346 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:17:12.331346 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:17:12.331346 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:17:12.331346 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:17:12.331346 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:17:12.332364 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:17:12.332364 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:17:12.332364 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:17:12.332364 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:17:12.332364 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:17:12.332364 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:17:12.332364 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:17:12.332364 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:17:12.332364 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:17:12.332364 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:17:12.332364 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 615/1239] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:17:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:17:12.338695 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72c01d-84af-4c6a-818b-713cd3efc732 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:12.486305 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72c01d-84af-4c6a-818b-713cd3efc732 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:12.562001 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcaf2c1-a7ce-4b89-8a01-85680ea794c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:12.562752 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcaf2c1-a7ce-4b89-8a01-85680ea794c5 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:12.563062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcaf2c1-a7ce-4b89-8a01-85680ea794c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:12.563360 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcaf2c1-a7ce-4b89-8a01-85680ea794c5 None admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:12.564826 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcaf2c1-a7ce-4b89-8a01-85680ea794c5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:12.565204 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcaf2c1-a7ce-4b89-8a01-85680ea794c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:12.567721 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcaf2c1-a7ce-4b89-8a01-85680ea794c5 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:12.596984 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 625/1240] 10.222.0.77 () {56 vars in 1143 bytes} [Tue Aug 23 22:17:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:17:12.604351 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4851e0-361e-469c-9b8d-143c1edceb30 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:12.757029 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4851e0-361e-469c-9b8d-143c1edceb30 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:12.819805 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e9002-b0fb-476f-94a5-856ff83fb886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:12.820750 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e9002-b0fb-476f-94a5-856ff83fb886 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:12.820980 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e9002-b0fb-476f-94a5-856ff83fb886 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:12.821254 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e9002-b0fb-476f-94a5-856ff83fb886 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:12.920347 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:12.930098 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e9002-b0fb-476f-94a5-856ff83fb886 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:12.932854 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e9002-b0fb-476f-94a5-856ff83fb886 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:13.068736 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 616/1241] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:17:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 22:17:13.075708 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcaf2c1-a7ce-4b89-8a01-85680ea794c5 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:13.128741 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:13.226681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcaf2c1-a7ce-4b89-8a01-85680ea794c5 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:13.270968 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b83b1b5-3824-465c-a90b-323a22abde5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:13.271645 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83b1b5-3824-465c-a90b-323a22abde5c None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:13.271928 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83b1b5-3824-465c-a90b-323a22abde5c None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:13.272204 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83b1b5-3824-465c-a90b-323a22abde5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:13.287791 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b83b1b5-3824-465c-a90b-323a22abde5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:13.289998 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b83b1b5-3824-465c-a90b-323a22abde5c None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:13.312339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-7b83b1b5-3824-465c-a90b-323a22abde5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:17:13.312339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:17:13.312339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:17:13.312339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:17:13.312339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:17:13.312339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:17:13.312339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:17:13.312339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:17:13.312339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:17:13.312339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:17:13.312339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:17:13.312339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:17:13.312339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:17:13.312339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:17:13.312339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:17:13.312339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:17:13.313726 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:17:13.313726 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:17:13.313726 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:17:13.313726 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:17:13.313726 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:17:13.313726 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:17:13.313726 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:17:13.313726 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:17:13.313726 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:17:13.313726 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:17:13.313726 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:17:13.313726 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:17:13.313726 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:17:13.313726 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:17:13.313726 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:17:13.313726 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:17:13.313726 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:17:13.314785 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:17:13.314785 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:17:13.314785 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:17:13.314785 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 626/1242] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:17:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:17:13.320916 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e9002-b0fb-476f-94a5-856ff83fb886 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:13.473722 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:13.483867 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e9002-b0fb-476f-94a5-856ff83fb886 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:13.538380 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370a8ed-3d5d-4b38-99b1-187faea9948f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:13.539222 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370a8ed-3d5d-4b38-99b1-187faea9948f None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:13.539541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370a8ed-3d5d-4b38-99b1-187faea9948f None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:13.539886 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370a8ed-3d5d-4b38-99b1-187faea9948f None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:13.540877 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370a8ed-3d5d-4b38-99b1-187faea9948f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:13.541254 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370a8ed-3d5d-4b38-99b1-187faea9948f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:13.543142 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370a8ed-3d5d-4b38-99b1-187faea9948f None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:13.560649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 617/1243] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:17:13.570685 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b83b1b5-3824-465c-a90b-323a22abde5c None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:13.688066 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:13.725282 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b83b1b5-3824-465c-a90b-323a22abde5c None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:13.774415 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429b273-1396-497d-87e8-37da65577caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:13.775669 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429b273-1396-497d-87e8-37da65577caa None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:13.776380 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429b273-1396-497d-87e8-37da65577caa None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:13.776866 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429b273-1396-497d-87e8-37da65577caa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:13.791779 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429b273-1396-497d-87e8-37da65577caa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:13.794612 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429b273-1396-497d-87e8-37da65577caa None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:13.816335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-4429b273-1396-497d-87e8-37da65577caa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:17:13.816335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:17:13.816335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:17:13.816335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:17:13.816335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:17:13.816335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:17:13.816335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:17:13.816335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:17:13.816335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:17:13.816335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:17:13.816335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:17:13.816335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:17:13.816335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:17:13.816335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:17:13.816335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:17:13.817775 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:17:13.817775 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:17:13.817775 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:17:13.817775 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:17:13.817775 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:17:13.817775 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:17:13.817775 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:17:13.817775 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:17:13.817775 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:17:13.817775 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:17:13.817775 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:17:13.817775 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:17:13.817775 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:17:13.817775 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:17:13.817775 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:17:13.817775 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:17:13.817775 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:17:13.829411 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:17:13.829411 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:17:13.829411 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:17:13.829411 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:17:13.829411 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:17:13.829411 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:17:13.829411 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:17:13.829411 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:17:13.829411 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 627/1244] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:17:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:17:13.831313 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370a8ed-3d5d-4b38-99b1-187faea9948f None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:13.966028 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370a8ed-3d5d-4b38-99b1-187faea9948f None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:14.019668 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700aee9-9db6-4806-8bd9-4515145c8280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:14.020607 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700aee9-9db6-4806-8bd9-4515145c8280 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:14.021027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700aee9-9db6-4806-8bd9-4515145c8280 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:14.021561 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700aee9-9db6-4806-8bd9-4515145c8280 None admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:14.022435 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700aee9-9db6-4806-8bd9-4515145c8280 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:14.022801 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700aee9-9db6-4806-8bd9-4515145c8280 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:14.024577 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700aee9-9db6-4806-8bd9-4515145c8280 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:14.051098 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 618/1245] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:17:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:17:14.053274 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429b273-1396-497d-87e8-37da65577caa None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:14.198623 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429b273-1396-497d-87e8-37da65577caa None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:14.249986 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b0afa-4c3b-47d9-9333-737ba36095a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:14.250609 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b0afa-4c3b-47d9-9333-737ba36095a6 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:14.250892 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b0afa-4c3b-47d9-9333-737ba36095a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:14.251807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b0afa-4c3b-47d9-9333-737ba36095a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:14.252588 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b0afa-4c3b-47d9-9333-737ba36095a6 None admin] RBAC: Adding query filter params (role.id=fb1c5c0f0edb47bf828f63bc685f98ba, scope.project.id=da9a86463d68412884746b115667d2fc, user.id=2000b80e34ae45d2a8b658cd394419f2) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:14.252902 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b0afa-4c3b-47d9-9333-737ba36095a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:14.254403 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b0afa-4c3b-47d9-9333-737ba36095a6 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:14.260848 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 628/1246] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:17:14 2022] GET /identity/v3/role_assignments?user.id=2000b80e34ae45d2a8b658cd394419f2&scope.project.id=da9a86463d68412884746b115667d2fc&role.id=fb1c5c0f0edb47bf828f63bc685f98ba => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:17:16.716874 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48890dd0-3497-4c96-b882-8613dbe7cb2b None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:16.717749 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48890dd0-3497-4c96-b882-8613dbe7cb2b None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:16.717749 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48890dd0-3497-4c96-b882-8613dbe7cb2b None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:16.721414 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 619/1247] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:17:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:17:16.730544 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39997811-7113-4352-9e39-4c4c75ba5748 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:16.731249 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39997811-7113-4352-9e39-4c4c75ba5748 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:16.731696 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39997811-7113-4352-9e39-4c4c75ba5748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:16.744258 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:16.761731 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-39997811-7113-4352-9e39-4c4c75ba5748 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:17:16.763165 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-39997811-7113-4352-9e39-4c4c75ba5748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:16.870124 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 629/1248] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:17:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:17:17.207458 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48890dd0-3497-4c96-b882-8613dbe7cb2b None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:17.245946 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:17.383759 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48890dd0-3497-4c96-b882-8613dbe7cb2b None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:17.459824 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf222941-421c-4c5a-b100-5c5384561953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:17.460888 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf222941-421c-4c5a-b100-5c5384561953 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:17.461603 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf222941-421c-4c5a-b100-5c5384561953 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:17.462257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf222941-421c-4c5a-b100-5c5384561953 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:17.484058 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf222941-421c-4c5a-b100-5c5384561953 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:17:17.491475 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-bf222941-421c-4c5a-b100-5c5384561953 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:17:17.491475 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:17:17.491475 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:17:17.491475 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:17:17.491475 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:17:17.491475 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:17:17.491475 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:17:17.491475 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:17:17.491475 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:17:17.491475 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:17:17.491475 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:17:17.491475 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:17:17.491475 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:17:17.491475 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:17:17.491475 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:17:17.491475 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:17:17.493476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:17:17.493476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:17:17.493476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:17:17.493476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:17:17.493476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:17:17.493476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:17:17.493476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:17:17.493476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:17:17.493476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:17:17.493476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:17:17.493476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:17:17.493476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:17:17.493476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:17:17.493476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:17:17.493476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:17:17.493476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:17:17.495650 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:17:17.495650 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:17:17.495650 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:17:17.495650 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:17:17.495650 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:17:17.495650 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:17:17.495650 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:17:17.495650 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:17:17.495650 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:17:17.495650 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:17:17.495650 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:17:17.495650 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:17:17.495650 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 620/1249] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:17:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:17:17.506587 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39997811-7113-4352-9e39-4c4c75ba5748 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:17.675757 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39997811-7113-4352-9e39-4c4c75ba5748 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:17.722172 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:17.728743 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c08dda-f342-4c0f-95c4-cd1cb8d3f195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:17.729398 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c08dda-f342-4c0f-95c4-cd1cb8d3f195 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:17.729829 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c08dda-f342-4c0f-95c4-cd1cb8d3f195 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:17.730096 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c08dda-f342-4c0f-95c4-cd1cb8d3f195 None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:17.730776 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c08dda-f342-4c0f-95c4-cd1cb8d3f195 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:17.731635 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c08dda-f342-4c0f-95c4-cd1cb8d3f195 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:17.733047 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c08dda-f342-4c0f-95c4-cd1cb8d3f195 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:17.753602 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 630/1250] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:17:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:17:17.755352 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf222941-421c-4c5a-b100-5c5384561953 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:17.885329 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:17.914396 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf222941-421c-4c5a-b100-5c5384561953 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:17.959993 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f996f18-8bc8-4b38-ae18-191d4945421b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:17.961101 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f996f18-8bc8-4b38-ae18-191d4945421b None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:17.961614 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f996f18-8bc8-4b38-ae18-191d4945421b None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:17.962069 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f996f18-8bc8-4b38-ae18-191d4945421b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:17.978312 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f996f18-8bc8-4b38-ae18-191d4945421b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:17.980273 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f996f18-8bc8-4b38-ae18-191d4945421b None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:18.010334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-5f996f18-8bc8-4b38-ae18-191d4945421b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:17:18.010334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:17:18.010334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:17:18.010334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:17:18.010334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:17:18.010334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:17:18.010334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:17:18.010334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:17:18.010334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:17:18.010334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:17:18.010334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:17:18.010334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:17:18.010334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:17:18.010334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:17:18.010334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:17:18.010334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:17:18.011573 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:17:18.011573 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:17:18.011573 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:17:18.011573 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:17:18.011573 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:17:18.011573 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:17:18.011573 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:17:18.011573 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:17:18.011573 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:17:18.011573 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:17:18.011573 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:17:18.011573 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:17:18.011573 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:17:18.011573 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:17:18.011573 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:17:18.011573 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:17:18.011573 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:17:18.012739 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:17:18.012739 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:17:18.012739 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:17:18.012921 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 621/1251] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:17:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:17:18.019292 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c08dda-f342-4c0f-95c4-cd1cb8d3f195 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:18.169446 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c08dda-f342-4c0f-95c4-cd1cb8d3f195 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:18.216771 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3ba4d-42b7-44f0-9c8a-6017111e6248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:18.217853 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3ba4d-42b7-44f0-9c8a-6017111e6248 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:18.218306 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3ba4d-42b7-44f0-9c8a-6017111e6248 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:18.218755 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3ba4d-42b7-44f0-9c8a-6017111e6248 None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:18.219823 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3ba4d-42b7-44f0-9c8a-6017111e6248 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:18.220865 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3ba4d-42b7-44f0-9c8a-6017111e6248 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:18.223034 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3ba4d-42b7-44f0-9c8a-6017111e6248 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:18.239494 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 631/1252] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:17:18.245521 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f996f18-8bc8-4b38-ae18-191d4945421b None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:18.391176 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f996f18-8bc8-4b38-ae18-191d4945421b None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:18.428604 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:18.440072 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d352829-b497-4ba2-9bd6-e1eef9db7f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:18.440755 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d352829-b497-4ba2-9bd6-e1eef9db7f46 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:18.441030 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d352829-b497-4ba2-9bd6-e1eef9db7f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:18.441307 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d352829-b497-4ba2-9bd6-e1eef9db7f46 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:18.450892 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d352829-b497-4ba2-9bd6-e1eef9db7f46 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:18.453713 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d352829-b497-4ba2-9bd6-e1eef9db7f46 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:18.470409 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-0d352829-b497-4ba2-9bd6-e1eef9db7f46 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:17:18.470409 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:17:18.470409 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:17:18.470409 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:17:18.470409 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:17:18.470409 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:17:18.470409 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:17:18.470409 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:17:18.470409 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:17:18.470409 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:17:18.470409 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:17:18.470409 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:17:18.470409 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:17:18.470409 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:17:18.470409 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:17:18.470409 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:17:18.472631 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:17:18.472631 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:17:18.472631 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:17:18.472631 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:17:18.472631 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:17:18.472631 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:17:18.472631 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:17:18.472631 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:17:18.472631 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:17:18.472631 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:17:18.472631 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:17:18.472631 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:17:18.472631 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:17:18.472631 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:17:18.472631 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:17:18.472631 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:17:18.472631 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:17:18.472631 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:17:18.474630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:17:18.474630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:17:18.474630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:17:18.474630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:17:18.474630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:17:18.474630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:17:18.474630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:17:18.474630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:17:18.474630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:17:18.474630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:17:18.474630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 622/1253] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:17:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:17:18.478970 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3ba4d-42b7-44f0-9c8a-6017111e6248 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:18.577646 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:18.668048 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3ba4d-42b7-44f0-9c8a-6017111e6248 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:18.716954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15097d-dc3d-4280-82e3-7fb1e1f92c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:18.717618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15097d-dc3d-4280-82e3-7fb1e1f92c3f None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:18.717896 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15097d-dc3d-4280-82e3-7fb1e1f92c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:18.718272 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15097d-dc3d-4280-82e3-7fb1e1f92c3f None admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:18.719396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15097d-dc3d-4280-82e3-7fb1e1f92c3f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:18.720562 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15097d-dc3d-4280-82e3-7fb1e1f92c3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:18.722681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15097d-dc3d-4280-82e3-7fb1e1f92c3f None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:18.759221 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 632/1254] 10.222.0.77 () {56 vars in 1143 bytes} [Tue Aug 23 22:17:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:17:18.768218 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d352829-b497-4ba2-9bd6-e1eef9db7f46 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:18.942485 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d352829-b497-4ba2-9bd6-e1eef9db7f46 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:18.987180 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad7c61-22d7-4f8a-b892-f3372d9fbf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:18.987971 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad7c61-22d7-4f8a-b892-f3372d9fbf9e None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:18.988370 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad7c61-22d7-4f8a-b892-f3372d9fbf9e None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:18.988849 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad7c61-22d7-4f8a-b892-f3372d9fbf9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:19.078172 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:19.102437 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad7c61-22d7-4f8a-b892-f3372d9fbf9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:19.104586 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad7c61-22d7-4f8a-b892-f3372d9fbf9e None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:19.257289 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 623/1255] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:17:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:17:19.263952 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15097d-dc3d-4280-82e3-7fb1e1f92c3f None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:19.432802 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15097d-dc3d-4280-82e3-7fb1e1f92c3f None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:19.464236 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:19.495501 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37369d-ce59-4cd2-9744-e8043bc8493c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:19.496542 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37369d-ce59-4cd2-9744-e8043bc8493c None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:19.496921 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37369d-ce59-4cd2-9744-e8043bc8493c None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:19.497406 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37369d-ce59-4cd2-9744-e8043bc8493c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:19.515552 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37369d-ce59-4cd2-9744-e8043bc8493c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:19.518823 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37369d-ce59-4cd2-9744-e8043bc8493c None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:19.542807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-3c37369d-ce59-4cd2-9744-e8043bc8493c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:17:19.542807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:17:19.542807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:17:19.542807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:17:19.542807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:17:19.542807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:17:19.542807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:17:19.542807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:17:19.542807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:17:19.542807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:17:19.542807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:17:19.542807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:17:19.542807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:17:19.542807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:17:19.542807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:17:19.542807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:17:19.544447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:17:19.544447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:17:19.544447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:17:19.544447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:17:19.544447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:17:19.544447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:17:19.544447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:17:19.544447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:17:19.544447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:17:19.544447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:17:19.544447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:17:19.544447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:17:19.544447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:17:19.544447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:17:19.544447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:17:19.544447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:17:19.544447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:17:19.546041 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:17:19.546041 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:17:19.546041 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:17:19.546041 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 633/1256] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:17:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:17:19.557336 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad7c61-22d7-4f8a-b892-f3372d9fbf9e None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:19.681702 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:19.700497 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad7c61-22d7-4f8a-b892-f3372d9fbf9e None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:19.750057 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45a8f5-cc9b-400f-9da9-cf7770f8f145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:19.750680 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45a8f5-cc9b-400f-9da9-cf7770f8f145 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:19.751695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45a8f5-cc9b-400f-9da9-cf7770f8f145 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:19.751995 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45a8f5-cc9b-400f-9da9-cf7770f8f145 None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:19.752873 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d45a8f5-cc9b-400f-9da9-cf7770f8f145 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:19.753249 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d45a8f5-cc9b-400f-9da9-cf7770f8f145 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:19.754677 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d45a8f5-cc9b-400f-9da9-cf7770f8f145 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:19.774243 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 624/1257] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:17:19.783852 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37369d-ce59-4cd2-9744-e8043bc8493c None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:19.947924 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37369d-ce59-4cd2-9744-e8043bc8493c None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:20.005443 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe664e53-ba7b-42ff-a3cb-9ea49502d2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:20.006301 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe664e53-ba7b-42ff-a3cb-9ea49502d2ca None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:20.006771 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe664e53-ba7b-42ff-a3cb-9ea49502d2ca None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:20.007109 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe664e53-ba7b-42ff-a3cb-9ea49502d2ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:20.020861 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe664e53-ba7b-42ff-a3cb-9ea49502d2ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:20.022754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe664e53-ba7b-42ff-a3cb-9ea49502d2ca None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:20.036203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-fe664e53-ba7b-42ff-a3cb-9ea49502d2ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:17:20.036203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:17:20.036203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:17:20.036203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:17:20.036203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:17:20.036203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:17:20.036203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:17:20.036203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:17:20.036203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:17:20.036203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:17:20.036203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:17:20.036203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:17:20.036203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:17:20.036203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:17:20.036203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:17:20.038537 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:17:20.038537 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:17:20.038537 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:17:20.038537 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:17:20.038537 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:17:20.038537 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:17:20.038537 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:17:20.038537 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:17:20.038537 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:17:20.038537 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:17:20.038537 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:17:20.038537 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:17:20.038537 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:17:20.038537 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:17:20.038537 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:17:20.038537 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:17:20.038537 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:17:20.040622 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:17:20.040622 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:17:20.040622 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:17:20.040622 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:17:20.040622 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:17:20.040622 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:17:20.040622 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:17:20.040622 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:17:20.040622 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 634/1258] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:17:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:17:20.044395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45a8f5-cc9b-400f-9da9-cf7770f8f145 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:20.213188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45a8f5-cc9b-400f-9da9-cf7770f8f145 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:20.267399 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adda11-43ec-48b7-8c10-5bd8bc069b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:20.268498 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adda11-43ec-48b7-8c10-5bd8bc069b8b None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:20.268498 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adda11-43ec-48b7-8c10-5bd8bc069b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:20.269098 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adda11-43ec-48b7-8c10-5bd8bc069b8b None admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:20.269502 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79adda11-43ec-48b7-8c10-5bd8bc069b8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:20.269936 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79adda11-43ec-48b7-8c10-5bd8bc069b8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:20.271467 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79adda11-43ec-48b7-8c10-5bd8bc069b8b None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:20.300578 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 625/1259] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:17:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:17:20.308264 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe664e53-ba7b-42ff-a3cb-9ea49502d2ca None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:20.357392 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:20.491283 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe664e53-ba7b-42ff-a3cb-9ea49502d2ca None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:20.552078 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976ed7b-5ec4-4a4a-b1e6-659cd9254378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:20.552595 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976ed7b-5ec4-4a4a-b1e6-659cd9254378 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:20.552880 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976ed7b-5ec4-4a4a-b1e6-659cd9254378 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:20.553168 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976ed7b-5ec4-4a4a-b1e6-659cd9254378 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:20.553954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976ed7b-5ec4-4a4a-b1e6-659cd9254378 None admin] RBAC: Adding query filter params (role.id=e806ce849cf34b92979b5524f3ea9ff6, scope.project.id=da9a86463d68412884746b115667d2fc, user.id=2000b80e34ae45d2a8b658cd394419f2) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:20.554433 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976ed7b-5ec4-4a4a-b1e6-659cd9254378 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:20.556046 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976ed7b-5ec4-4a4a-b1e6-659cd9254378 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:20.566017 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 635/1260] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:17:20 2022] GET /identity/v3/role_assignments?user.id=2000b80e34ae45d2a8b658cd394419f2&scope.project.id=da9a86463d68412884746b115667d2fc&role.id=e806ce849cf34b92979b5524f3ea9ff6 => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:17:22.836023 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568afd09-aa0d-4433-8c1c-4b884c2ef374 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:22.836617 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568afd09-aa0d-4433-8c1c-4b884c2ef374 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:22.836617 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568afd09-aa0d-4433-8c1c-4b884c2ef374 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:22.838427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 626/1261] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:17:22.844210 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f2547-6802-426a-895f-cfc052058fec None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:22.845384 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f2547-6802-426a-895f-cfc052058fec None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:22.845384 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f2547-6802-426a-895f-cfc052058fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:22.868637 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-840f2547-6802-426a-895f-cfc052058fec None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:17:22.870609 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-840f2547-6802-426a-895f-cfc052058fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:22.993256 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 636/1262] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:17:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:17:23.387480 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568afd09-aa0d-4433-8c1c-4b884c2ef374 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:23.402340 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:23.552481 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568afd09-aa0d-4433-8c1c-4b884c2ef374 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:23.611086 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08d7c6-8dfd-4ce2-b3ab-623b11d4c65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:23.611835 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08d7c6-8dfd-4ce2-b3ab-623b11d4c65f None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:23.612120 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08d7c6-8dfd-4ce2-b3ab-623b11d4c65f None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:23.612394 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08d7c6-8dfd-4ce2-b3ab-623b11d4c65f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:23.625481 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08d7c6-8dfd-4ce2-b3ab-623b11d4c65f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:17:23.631622 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-9c08d7c6-8dfd-4ce2-b3ab-623b11d4c65f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:17:23.631622 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:17:23.631622 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:17:23.631622 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:17:23.631622 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:17:23.631622 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:17:23.631622 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:17:23.631622 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:17:23.631622 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:17:23.631622 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:17:23.631622 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:17:23.631622 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:17:23.631622 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:17:23.631622 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:17:23.631622 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:17:23.631622 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:17:23.632961 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:17:23.632961 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:17:23.632961 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:17:23.632961 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:17:23.632961 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:17:23.632961 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:17:23.632961 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:17:23.632961 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:17:23.632961 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:17:23.632961 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:17:23.632961 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:17:23.632961 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:17:23.632961 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:17:23.632961 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:17:23.632961 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:17:23.632961 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:17:23.634181 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:17:23.634181 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:17:23.634181 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:17:23.634181 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:17:23.634181 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:17:23.634181 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:17:23.634181 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:17:23.634181 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:17:23.634181 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:17:23.634181 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:17:23.634181 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:17:23.634181 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:17:23.634181 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 627/1263] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:17:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:17:23.640047 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f2547-6802-426a-895f-cfc052058fec None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:23.662495 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:23.791390 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f2547-6802-426a-895f-cfc052058fec None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:23.845177 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf2c49-5df5-434a-b3df-080318091142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:23.846106 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf2c49-5df5-434a-b3df-080318091142 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:23.846461 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf2c49-5df5-434a-b3df-080318091142 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:23.846881 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf2c49-5df5-434a-b3df-080318091142 None admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:23.847652 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf2c49-5df5-434a-b3df-080318091142 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:23.848008 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf2c49-5df5-434a-b3df-080318091142 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:23.849481 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf2c49-5df5-434a-b3df-080318091142 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:23.859794 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 637/1264] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:17:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:17:23.866596 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08d7c6-8dfd-4ce2-b3ab-623b11d4c65f None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:23.955260 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:24.000796 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08d7c6-8dfd-4ce2-b3ab-623b11d4c65f None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:24.043850 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107ca4f-927c-4400-a325-575882f8a799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:24.044512 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107ca4f-927c-4400-a325-575882f8a799 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:24.044795 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107ca4f-927c-4400-a325-575882f8a799 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:24.045070 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107ca4f-927c-4400-a325-575882f8a799 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:24.064073 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107ca4f-927c-4400-a325-575882f8a799 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:24.066803 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107ca4f-927c-4400-a325-575882f8a799 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:24.092027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-e107ca4f-927c-4400-a325-575882f8a799 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:17:24.092027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:17:24.092027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:17:24.092027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:17:24.092027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:17:24.092027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:17:24.092027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:17:24.092027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:17:24.092027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:17:24.092027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:17:24.092027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:17:24.092027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:17:24.092027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:17:24.092027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:17:24.092027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:17:24.092027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:17:24.093692 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:17:24.093692 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:17:24.093692 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:17:24.093692 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:17:24.093692 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:17:24.093692 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:17:24.093692 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:17:24.093692 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:17:24.093692 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:17:24.093692 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:17:24.093692 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:17:24.093692 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:17:24.093692 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:17:24.093692 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:17:24.093692 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:17:24.093692 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:17:24.093692 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:17:24.095805 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:17:24.095805 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:17:24.095805 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:17:24.095805 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 628/1265] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:17:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:17:24.101148 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf2c49-5df5-434a-b3df-080318091142 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:24.206057 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:24.242187 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf2c49-5df5-434a-b3df-080318091142 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:24.296059 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ea0da-4ef0-453b-9e77-b845ea5807cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:24.296948 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ea0da-4ef0-453b-9e77-b845ea5807cc None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:24.297223 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ea0da-4ef0-453b-9e77-b845ea5807cc None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:24.297599 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ea0da-4ef0-453b-9e77-b845ea5807cc None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:24.298620 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ea0da-4ef0-453b-9e77-b845ea5807cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:24.299095 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ea0da-4ef0-453b-9e77-b845ea5807cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:24.301237 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ea0da-4ef0-453b-9e77-b845ea5807cc None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:24.318488 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 638/1266] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:17:24.324651 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107ca4f-927c-4400-a325-575882f8a799 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:24.464210 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107ca4f-927c-4400-a325-575882f8a799 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:24.503587 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:24.530531 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fb147-6dca-4852-993b-fed6dd1f7ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:24.531182 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fb147-6dca-4852-993b-fed6dd1f7ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:24.531462 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fb147-6dca-4852-993b-fed6dd1f7ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:24.531744 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fb147-6dca-4852-993b-fed6dd1f7ff8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:24.544133 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079fb147-6dca-4852-993b-fed6dd1f7ff8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:24.546466 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079fb147-6dca-4852-993b-fed6dd1f7ff8 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:24.560804 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-079fb147-6dca-4852-993b-fed6dd1f7ff8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:17:24.560804 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:17:24.560804 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:17:24.560804 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:17:24.560804 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:17:24.560804 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:17:24.560804 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:17:24.560804 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:17:24.560804 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:17:24.560804 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:17:24.560804 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:17:24.560804 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:17:24.560804 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:17:24.560804 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:17:24.560804 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:17:24.560804 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:17:24.562649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:17:24.562649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:17:24.562649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:17:24.562649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:17:24.562649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:17:24.562649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:17:24.562649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:17:24.562649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:17:24.562649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:17:24.562649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:17:24.562649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:17:24.562649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:17:24.562649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:17:24.562649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:17:24.562649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:17:24.562649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:17:24.562649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:17:24.562649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:17:24.565098 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:17:24.565098 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:17:24.565098 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:17:24.565098 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:17:24.565098 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:17:24.565098 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:17:24.565098 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:17:24.565098 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:17:24.565098 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:17:24.565098 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:17:24.565098 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 629/1267] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:17:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:17:24.570841 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ea0da-4ef0-453b-9e77-b845ea5807cc None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:24.738660 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ea0da-4ef0-453b-9e77-b845ea5807cc None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:24.777586 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfbc85-fee7-415e-afb8-0bc25ecff94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:24.778205 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfbc85-fee7-415e-afb8-0bc25ecff94b None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:24.778482 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfbc85-fee7-415e-afb8-0bc25ecff94b None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:24.778759 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfbc85-fee7-415e-afb8-0bc25ecff94b None admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:24.779535 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbfbc85-fee7-415e-afb8-0bc25ecff94b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:24.779839 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbfbc85-fee7-415e-afb8-0bc25ecff94b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:24.781269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbfbc85-fee7-415e-afb8-0bc25ecff94b None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:24.791679 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:24.802142 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 639/1268] 10.222.0.77 () {56 vars in 1143 bytes} [Tue Aug 23 22:17:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:17:24.809239 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fb147-6dca-4852-993b-fed6dd1f7ff8 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:24.919671 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fb147-6dca-4852-993b-fed6dd1f7ff8 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:24.961921 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8c746-2fa1-4a2d-a75f-22230b93effc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:24.963000 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8c746-2fa1-4a2d-a75f-22230b93effc None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:24.963517 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8c746-2fa1-4a2d-a75f-22230b93effc None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:24.964015 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8c746-2fa1-4a2d-a75f-22230b93effc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:24.984625 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8c746-2fa1-4a2d-a75f-22230b93effc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:24.988257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8c746-2fa1-4a2d-a75f-22230b93effc None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:25.015414 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-ecb8c746-2fa1-4a2d-a75f-22230b93effc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:17:25.015414 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:17:25.015414 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:17:25.015414 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:17:25.015414 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:17:25.015414 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:17:25.015414 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:17:25.015414 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:17:25.015414 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:17:25.015414 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:17:25.015414 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:17:25.015414 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:17:25.015414 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:17:25.015414 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:17:25.015414 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:17:25.015414 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:17:25.017417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:17:25.017417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:17:25.017417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:17:25.017417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:17:25.017417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:17:25.017417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:17:25.017417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:17:25.017417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:17:25.017417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:17:25.017417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:17:25.017417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:17:25.017417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:17:25.017417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:17:25.017417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:17:25.017417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:17:25.017417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:17:25.017417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:17:25.018358 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:17:25.018358 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:17:25.018358 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:17:25.018533 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 630/1269] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:17:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:17:25.027657 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfbc85-fee7-415e-afb8-0bc25ecff94b None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:25.144725 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfbc85-fee7-415e-afb8-0bc25ecff94b None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:25.186992 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abbe9d-6a7a-4d00-92c9-1e8a1dd104a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:25.187749 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abbe9d-6a7a-4d00-92c9-1e8a1dd104a3 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:25.188033 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abbe9d-6a7a-4d00-92c9-1e8a1dd104a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:25.189111 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abbe9d-6a7a-4d00-92c9-1e8a1dd104a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:25.190235 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abbe9d-6a7a-4d00-92c9-1e8a1dd104a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:25.190597 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abbe9d-6a7a-4d00-92c9-1e8a1dd104a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:25.192705 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abbe9d-6a7a-4d00-92c9-1e8a1dd104a3 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:25.214980 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 640/1270] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:17:25.222583 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8c746-2fa1-4a2d-a75f-22230b93effc None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:25.267877 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:25.391016 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8c746-2fa1-4a2d-a75f-22230b93effc None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:25.451593 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955959d-173b-419e-88c0-d24ed08816b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:25.452644 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955959d-173b-419e-88c0-d24ed08816b2 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:25.453127 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955959d-173b-419e-88c0-d24ed08816b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:25.453629 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955959d-173b-419e-88c0-d24ed08816b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:25.466981 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955959d-173b-419e-88c0-d24ed08816b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:25.469712 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955959d-173b-419e-88c0-d24ed08816b2 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:25.492457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-a955959d-173b-419e-88c0-d24ed08816b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:17:25.492457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:17:25.492457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:17:25.492457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:17:25.492457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:17:25.492457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:17:25.492457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:17:25.492457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:17:25.492457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:17:25.492457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:17:25.492457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:17:25.492457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:17:25.492457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:17:25.492457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:17:25.492457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:17:25.493663 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:17:25.493663 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:17:25.493663 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:17:25.493663 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:17:25.493663 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:17:25.493663 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:17:25.493663 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:17:25.493663 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:17:25.493663 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:17:25.493663 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:17:25.493663 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:17:25.493663 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:17:25.493663 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:17:25.493663 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:17:25.493663 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:17:25.493663 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:17:25.493663 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:17:25.494841 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:17:25.494841 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:17:25.494841 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:17:25.494841 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:17:25.494841 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:17:25.494841 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:17:25.494841 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:17:25.494841 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:17:25.494841 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 631/1271] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:17:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:17:25.505477 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abbe9d-6a7a-4d00-92c9-1e8a1dd104a3 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:25.618236 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:25.690186 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abbe9d-6a7a-4d00-92c9-1e8a1dd104a3 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:25.745274 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc6124-3952-4e6c-aa72-700aa30b74ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:25.745993 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc6124-3952-4e6c-aa72-700aa30b74ad None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:25.746348 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc6124-3952-4e6c-aa72-700aa30b74ad None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:25.746674 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc6124-3952-4e6c-aa72-700aa30b74ad None admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:25.747421 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc6124-3952-4e6c-aa72-700aa30b74ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:25.747768 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc6124-3952-4e6c-aa72-700aa30b74ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:25.749268 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc6124-3952-4e6c-aa72-700aa30b74ad None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:25.763960 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 641/1272] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:17:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:17:25.773120 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955959d-173b-419e-88c0-d24ed08816b2 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:25.889705 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:25.900831 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955959d-173b-419e-88c0-d24ed08816b2 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:25.939459 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f47d05-a631-4d6b-add3-b1406487a070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:25.940382 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f47d05-a631-4d6b-add3-b1406487a070 None admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:25.940584 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f47d05-a631-4d6b-add3-b1406487a070 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:25.940930 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f47d05-a631-4d6b-add3-b1406487a070 None admin] PATH_INFO: `/v3/projects/da9a86463d68412884746b115667d2fc/users/2000b80e34ae45d2a8b658cd394419f2/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:25.942975 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f47d05-a631-4d6b-add3-b1406487a070 None admin] RBAC: Authorizing `identity:create_grant(project_id=da9a86463d68412884746b115667d2fc, user_id=2000b80e34ae45d2a8b658cd394419f2, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:25.944451 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f47d05-a631-4d6b-add3-b1406487a070 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:25.961152 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 632/1273] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Aug 23 22:17:25 2022] PUT /identity/v3/projects/da9a86463d68412884746b115667d2fc/users/2000b80e34ae45d2a8b658cd394419f2/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:17:28.036954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc4105-70a0-4326-82c9-244cf5106f09 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:28.037685 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc4105-70a0-4326-82c9-244cf5106f09 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:28.037685 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc4105-70a0-4326-82c9-244cf5106f09 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:28.038806 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 642/1274] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:17:28.044914 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046404a-1f20-4ccc-9240-f6be4ebff4c5 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:28.045472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046404a-1f20-4ccc-9240-f6be4ebff4c5 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:28.045712 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046404a-1f20-4ccc-9240-f6be4ebff4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:28.066437 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-b046404a-1f20-4ccc-9240-f6be4ebff4c5 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:17:28.067638 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-b046404a-1f20-4ccc-9240-f6be4ebff4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:28.145402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 633/1275] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:17:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:17:28.684181 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc4105-70a0-4326-82c9-244cf5106f09 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:28.849922 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc4105-70a0-4326-82c9-244cf5106f09 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:28.869071 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:28.890339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326cb308-a1d3-4f5d-8a55-07a03a6dd500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:28.890972 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cb308-a1d3-4f5d-8a55-07a03a6dd500 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:28.891841 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cb308-a1d3-4f5d-8a55-07a03a6dd500 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:28.892138 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cb308-a1d3-4f5d-8a55-07a03a6dd500 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:28.903660 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326cb308-a1d3-4f5d-8a55-07a03a6dd500 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:17:28.908482 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-326cb308-a1d3-4f5d-8a55-07a03a6dd500 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:17:28.908482 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:17:28.908482 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:17:28.908482 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:17:28.908482 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:17:28.908482 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:17:28.908482 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:17:28.908482 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:17:28.908482 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:17:28.908482 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:17:28.908482 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:17:28.908482 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:17:28.908482 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:17:28.908482 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:17:28.908482 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:17:28.908482 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:17:28.910134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:17:28.910134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:17:28.910134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:17:28.910134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:17:28.910134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:17:28.910134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:17:28.910134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:17:28.910134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:17:28.910134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:17:28.910134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:17:28.910134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:17:28.910134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:17:28.910134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:17:28.910134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:17:28.910134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:17:28.910134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:17:28.911854 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:17:28.911854 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:17:28.911854 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:17:28.911854 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:17:28.911854 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:17:28.911854 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:17:28.911854 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:17:28.911854 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:17:28.911854 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:17:28.911854 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:17:28.911854 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:17:28.911854 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:17:28.911854 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 643/1276] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Aug 23 22:17:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:17:28.916349 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046404a-1f20-4ccc-9240-f6be4ebff4c5 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:29.008333 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:29.041321 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046404a-1f20-4ccc-9240-f6be4ebff4c5 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:29.095953 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906b7c5-98c0-459c-b906-57cd9411ce70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:29.096705 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906b7c5-98c0-459c-b906-57cd9411ce70 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:29.096849 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906b7c5-98c0-459c-b906-57cd9411ce70 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:29.097089 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906b7c5-98c0-459c-b906-57cd9411ce70 None admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:29.097809 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906b7c5-98c0-459c-b906-57cd9411ce70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:29.098110 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906b7c5-98c0-459c-b906-57cd9411ce70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:29.099520 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906b7c5-98c0-459c-b906-57cd9411ce70 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:29.108489 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 634/1277] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Aug 23 22:17:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:17:29.115854 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326cb308-a1d3-4f5d-8a55-07a03a6dd500 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:29.251591 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326cb308-a1d3-4f5d-8a55-07a03a6dd500 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:29.298014 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacd7bc-1aad-4209-b0ad-07c247d52e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:29.298744 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacd7bc-1aad-4209-b0ad-07c247d52e11 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:29.299030 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacd7bc-1aad-4209-b0ad-07c247d52e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:29.299299 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacd7bc-1aad-4209-b0ad-07c247d52e11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:29.311714 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dacd7bc-1aad-4209-b0ad-07c247d52e11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:29.316950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dacd7bc-1aad-4209-b0ad-07c247d52e11 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:29.333219 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-3dacd7bc-1aad-4209-b0ad-07c247d52e11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:17:29.333219 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:17:29.333219 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:17:29.333219 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:17:29.333219 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:17:29.333219 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:17:29.333219 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:17:29.333219 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:17:29.333219 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:17:29.333219 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:17:29.333219 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:17:29.333219 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:17:29.333219 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:17:29.333219 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:17:29.333219 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:17:29.333219 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:17:29.335353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:17:29.335353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:17:29.335353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:17:29.335353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:17:29.335353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:17:29.335353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:17:29.335353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:17:29.335353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:17:29.335353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:17:29.335353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:17:29.335353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:17:29.335353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:17:29.335353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:17:29.335353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:17:29.335353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:17:29.335353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:17:29.335353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:17:29.337746 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:17:29.337746 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:17:29.337746 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:17:29.337746 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 644/1278] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:17:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:17:29.341556 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906b7c5-98c0-459c-b906-57cd9411ce70 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:29.519172 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906b7c5-98c0-459c-b906-57cd9411ce70 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:29.574970 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdc14a-7000-4992-84b9-3755f8be5850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:29.575512 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdc14a-7000-4992-84b9-3755f8be5850 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:29.575791 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdc14a-7000-4992-84b9-3755f8be5850 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:29.576058 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdc14a-7000-4992-84b9-3755f8be5850 None admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:29.576735 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fdc14a-7000-4992-84b9-3755f8be5850 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:29.577041 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fdc14a-7000-4992-84b9-3755f8be5850 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:29.578552 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fdc14a-7000-4992-84b9-3755f8be5850 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:29.597397 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 635/1279] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:17:29.607825 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacd7bc-1aad-4209-b0ad-07c247d52e11 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:29.652166 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:29.737122 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacd7bc-1aad-4209-b0ad-07c247d52e11 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:29.783076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5347d4-c276-4286-8353-9b686c27316f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:29.783883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5347d4-c276-4286-8353-9b686c27316f None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:29.784164 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5347d4-c276-4286-8353-9b686c27316f None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:29.784436 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5347d4-c276-4286-8353-9b686c27316f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:29.794012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5347d4-c276-4286-8353-9b686c27316f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:29.796039 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5347d4-c276-4286-8353-9b686c27316f None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:29.809359 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-0c5347d4-c276-4286-8353-9b686c27316f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:17:29.809359 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:17:29.809359 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:17:29.809359 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:17:29.809359 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:17:29.809359 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:17:29.809359 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:17:29.809359 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:17:29.809359 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:17:29.809359 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:17:29.809359 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:17:29.809359 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:17:29.809359 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:17:29.809359 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:17:29.809359 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:17:29.809359 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:17:29.810734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:17:29.810734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:17:29.810734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:17:29.810734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:17:29.810734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:17:29.810734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:17:29.810734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:17:29.810734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:17:29.810734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:17:29.810734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:17:29.810734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:17:29.810734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:17:29.810734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:17:29.810734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:17:29.810734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:17:29.810734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:17:29.810734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:17:29.810734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:17:29.818672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:17:29.818672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:17:29.818672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:17:29.818672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:17:29.818672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:17:29.818672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:17:29.818672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:17:29.818672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:17:29.818672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:17:29.818672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:17:29.818672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 645/1280] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:17:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:17:29.820870 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdc14a-7000-4992-84b9-3755f8be5850 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:29.826230 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:30.008772 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdc14a-7000-4992-84b9-3755f8be5850 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:30.059586 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4edbc-2728-4464-af28-ce8fe0c51142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:30.060205 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4edbc-2728-4464-af28-ce8fe0c51142 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:30.060476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4edbc-2728-4464-af28-ce8fe0c51142 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:30.060749 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4edbc-2728-4464-af28-ce8fe0c51142 None admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:30.061546 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d4edbc-2728-4464-af28-ce8fe0c51142 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:30.061852 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d4edbc-2728-4464-af28-ce8fe0c51142 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:30.063338 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d4edbc-2728-4464-af28-ce8fe0c51142 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:30.086288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 636/1281] 10.222.0.77 () {56 vars in 1143 bytes} [Tue Aug 23 22:17:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:17:30.093246 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5347d4-c276-4286-8353-9b686c27316f None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:30.240711 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:30.255110 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5347d4-c276-4286-8353-9b686c27316f None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:30.299367 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b07c3-d388-4a1d-865a-61356833c35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:30.300129 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b07c3-d388-4a1d-865a-61356833c35e None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:30.300457 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b07c3-d388-4a1d-865a-61356833c35e None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:30.300778 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b07c3-d388-4a1d-865a-61356833c35e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:30.388294 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b07c3-d388-4a1d-865a-61356833c35e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:30.389902 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b07c3-d388-4a1d-865a-61356833c35e None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:30.554705 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:30.574047 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 646/1282] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Aug 23 22:17:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:17:30.581089 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4edbc-2728-4464-af28-ce8fe0c51142 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:30.655180 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:30.700442 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4edbc-2728-4464-af28-ce8fe0c51142 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:30.753970 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a72b2-053c-492b-82d5-7c8fa3d09a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:30.754727 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a72b2-053c-492b-82d5-7c8fa3d09a06 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:30.755001 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a72b2-053c-492b-82d5-7c8fa3d09a06 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:30.755270 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a72b2-053c-492b-82d5-7c8fa3d09a06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:30.783410 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a72b2-053c-492b-82d5-7c8fa3d09a06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:30.786457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a72b2-053c-492b-82d5-7c8fa3d09a06 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:30.819597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-379a72b2-053c-492b-82d5-7c8fa3d09a06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:17:30.819597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:17:30.819597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:17:30.819597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:17:30.819597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:17:30.819597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:17:30.819597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:17:30.819597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:17:30.819597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:17:30.819597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:17:30.819597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:17:30.819597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:17:30.819597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:17:30.819597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:17:30.819597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:17:30.819597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:17:30.820906 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:17:30.820906 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:17:30.820906 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:17:30.820906 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:17:30.820906 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:17:30.820906 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:17:30.820906 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:17:30.820906 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:17:30.820906 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:17:30.820906 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:17:30.820906 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:17:30.820906 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:17:30.820906 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:17:30.820906 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:17:30.820906 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:17:30.820906 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:17:30.820906 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:17:30.822000 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:17:30.822000 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:17:30.822000 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:17:30.822000 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 637/1283] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:17:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:17:30.828182 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b07c3-d388-4a1d-865a-61356833c35e None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:30.940707 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b07c3-d388-4a1d-865a-61356833c35e None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:30.980304 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdeaae-ccfc-4925-a617-2ec80e995e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:30.980909 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdeaae-ccfc-4925-a617-2ec80e995e96 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:30.981188 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdeaae-ccfc-4925-a617-2ec80e995e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:30.981498 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdeaae-ccfc-4925-a617-2ec80e995e96 None admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:30.982147 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdeaae-ccfc-4925-a617-2ec80e995e96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:30.982450 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdeaae-ccfc-4925-a617-2ec80e995e96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:30.983884 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdeaae-ccfc-4925-a617-2ec80e995e96 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:30.997000 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 647/1284] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Aug 23 22:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:17:31.004253 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a72b2-053c-492b-82d5-7c8fa3d09a06 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:31.127643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a72b2-053c-492b-82d5-7c8fa3d09a06 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:31.143301 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:31.167205 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16a3fd-b9ca-4c15-b3b7-a97d1b74c12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:31.167836 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16a3fd-b9ca-4c15-b3b7-a97d1b74c12c None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:31.168120 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16a3fd-b9ca-4c15-b3b7-a97d1b74c12c None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:31.168399 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16a3fd-b9ca-4c15-b3b7-a97d1b74c12c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:31.176495 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16a3fd-b9ca-4c15-b3b7-a97d1b74c12c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:31.177986 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16a3fd-b9ca-4c15-b3b7-a97d1b74c12c None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:31.190388 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application [None req-2a16a3fd-b9ca-4c15-b3b7-a97d1b74c12c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:17:31.190388 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:17:31.190388 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:17:31.190388 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:17:31.190388 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:17:31.190388 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:17:31.190388 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:17:31.190388 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:17:31.190388 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:17:31.190388 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:17:31.190388 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:17:31.190388 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:17:31.190388 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:17:31.190388 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:17:31.190388 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:17:31.191729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:17:31.191729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:17:31.191729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:17:31.191729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:17:31.191729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:17:31.191729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:17:31.191729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:17:31.191729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:17:31.191729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application with Lock( Aug 23 22:17:31.191729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:17:31.191729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:17:31.191729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:17:31.191729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:17:31.191729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:17:31.191729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:17:31.191729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:17:31.191729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:17:31.193473 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:17:31.193473 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:17:31.193473 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:17:31.193473 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:17:31.193473 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:17:31.193473 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:17:31.193473 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:17:31.193473 dv-cinder-850321-4-smb devstack@keystone.service[81751]: ERROR keystone.server.flask.application Aug 23 22:17:31.193473 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 638/1285] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Aug 23 22:17:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:17:31.198019 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdeaae-ccfc-4925-a617-2ec80e995e96 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:31.260754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:31.317735 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdeaae-ccfc-4925-a617-2ec80e995e96 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:31.352993 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23de7ae-59e9-497e-88a2-3666d7608ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:31.353630 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23de7ae-59e9-497e-88a2-3666d7608ddd None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:31.353908 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23de7ae-59e9-497e-88a2-3666d7608ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:31.354180 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23de7ae-59e9-497e-88a2-3666d7608ddd None admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:31.354879 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23de7ae-59e9-497e-88a2-3666d7608ddd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:31.355177 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23de7ae-59e9-497e-88a2-3666d7608ddd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:31.356618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23de7ae-59e9-497e-88a2-3666d7608ddd None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:31.370453 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 648/1286] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Aug 23 22:17:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:17:31.378315 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16a3fd-b9ca-4c15-b3b7-a97d1b74c12c None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:31.489281 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16a3fd-b9ca-4c15-b3b7-a97d1b74c12c None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:31.526740 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a31bcd9-4c32-4271-9ee5-00b03ad438e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:31.527351 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31bcd9-4c32-4271-9ee5-00b03ad438e0 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:31.527631 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31bcd9-4c32-4271-9ee5-00b03ad438e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:31.527906 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31bcd9-4c32-4271-9ee5-00b03ad438e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:31.528642 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a31bcd9-4c32-4271-9ee5-00b03ad438e0 None admin] RBAC: Adding query filter params (role.id=e806ce849cf34b92979b5524f3ea9ff6, scope.project.id=da9a86463d68412884746b115667d2fc, user.id=2000b80e34ae45d2a8b658cd394419f2) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:31.528964 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a31bcd9-4c32-4271-9ee5-00b03ad438e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:31.530446 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a31bcd9-4c32-4271-9ee5-00b03ad438e0 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:31.540164 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 639/1287] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Aug 23 22:17:31 2022] GET /identity/v3/role_assignments?user.id=2000b80e34ae45d2a8b658cd394419f2&scope.project.id=da9a86463d68412884746b115667d2fc&role.id=e806ce849cf34b92979b5524f3ea9ff6 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:17:33.534360 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9248891-6cc4-4d01-b70e-b7dd2299ddc5 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:33.534897 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9248891-6cc4-4d01-b70e-b7dd2299ddc5 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:33.534897 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9248891-6cc4-4d01-b70e-b7dd2299ddc5 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:33.536268 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 649/1288] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:17:33.543138 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a1249-35e9-4e49-bc0d-3383b4095f0f None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:33.543674 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a1249-35e9-4e49-bc0d-3383b4095f0f None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:33.544207 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a1249-35e9-4e49-bc0d-3383b4095f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:33.574696 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-f48a1249-35e9-4e49-bc0d-3383b4095f0f None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:17:33.576911 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-f48a1249-35e9-4e49-bc0d-3383b4095f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:33.628913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:33.671331 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 640/1289] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:17:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:17:33.961542 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9248891-6cc4-4d01-b70e-b7dd2299ddc5 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:34.083152 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9248891-6cc4-4d01-b70e-b7dd2299ddc5 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:34.095340 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:34.123615 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba56523-b7b1-4b1d-bf55-d216004d0034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:34.124261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba56523-b7b1-4b1d-bf55-d216004d0034 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:34.124545 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba56523-b7b1-4b1d-bf55-d216004d0034 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:34.124810 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba56523-b7b1-4b1d-bf55-d216004d0034 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:34.126263 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba56523-b7b1-4b1d-bf55-d216004d0034 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:34.127629 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba56523-b7b1-4b1d-bf55-d216004d0034 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:34.136939 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-bba56523-b7b1-4b1d-bf55-d216004d0034 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:17:34.136939 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:17:34.136939 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:17:34.136939 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:17:34.136939 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:17:34.136939 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:17:34.136939 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:17:34.136939 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:17:34.136939 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:17:34.136939 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:17:34.136939 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:17:34.136939 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:17:34.136939 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:17:34.136939 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:17:34.136939 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:17:34.136939 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:17:34.136939 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:17:34.138976 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:17:34.138976 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:17:34.138976 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:17:34.138976 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:17:34.138976 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:17:34.138976 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:17:34.138976 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:17:34.138976 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:17:34.138976 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:17:34.138976 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:17:34.138976 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:17:34.138976 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:17:34.138976 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:17:34.138976 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:17:34.138976 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:17:34.138976 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:17:34.140909 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:17:34.140909 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:17:34.140909 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:17:34.140909 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:17:34.140909 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:17:34.140909 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:17:34.140909 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:17:34.140909 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:17:34.140909 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:17:34.140909 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:17:34.140909 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:17:34.140909 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:17:34.140909 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:17:34.140909 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:17:34.140909 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 650/1290] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Aug 23 22:17:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:17:34.146693 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a1249-35e9-4e49-bc0d-3383b4095f0f None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:34.258625 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a1249-35e9-4e49-bc0d-3383b4095f0f None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:34.299690 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29a879-428f-42a4-8fde-42a1c7b9d731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:34.300311 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29a879-428f-42a4-8fde-42a1c7b9d731 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:34.300589 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29a879-428f-42a4-8fde-42a1c7b9d731 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:34.300861 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29a879-428f-42a4-8fde-42a1c7b9d731 None admin] PATH_INFO: `/v3/services` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:34.301539 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29a879-428f-42a4-8fde-42a1c7b9d731 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:34.301843 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29a879-428f-42a4-8fde-42a1c7b9d731 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:34.303255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29a879-428f-42a4-8fde-42a1c7b9d731 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:34.308978 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 641/1291] 10.222.0.77 () {56 vars in 1116 bytes} [Tue Aug 23 22:17:34 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:17:34.315738 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba56523-b7b1-4b1d-bf55-d216004d0034 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:34.429206 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba56523-b7b1-4b1d-bf55-d216004d0034 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:34.470609 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aebfe8-60ab-4a43-8a5b-48edd34f0e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:34.471348 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aebfe8-60ab-4a43-8a5b-48edd34f0e33 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:34.471583 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aebfe8-60ab-4a43-8a5b-48edd34f0e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:34.471893 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aebfe8-60ab-4a43-8a5b-48edd34f0e33 None admin] PATH_INFO: `/v3/services` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:34.472534 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aebfe8-60ab-4a43-8a5b-48edd34f0e33 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:34.472864 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aebfe8-60ab-4a43-8a5b-48edd34f0e33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:34.474298 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aebfe8-60ab-4a43-8a5b-48edd34f0e33 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:34.494829 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 651/1292] 10.222.0.77 () {56 vars in 1116 bytes} [Tue Aug 23 22:17:34 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:17:36.771147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79209e9-da9d-456c-80c2-d67968135d61 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:36.771750 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79209e9-da9d-456c-80c2-d67968135d61 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:36.771750 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79209e9-da9d-456c-80c2-d67968135d61 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:36.773108 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 642/1293] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:17:36.780947 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841fbce-106a-42b0-ac6f-52052e4dd5b6 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:36.782261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841fbce-106a-42b0-ac6f-52052e4dd5b6 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:36.782261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841fbce-106a-42b0-ac6f-52052e4dd5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:36.803262 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-a841fbce-106a-42b0-ac6f-52052e4dd5b6 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:17:36.804492 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-a841fbce-106a-42b0-ac6f-52052e4dd5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:36.848789 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:36.890121 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 652/1294] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:17:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:17:37.164889 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79209e9-da9d-456c-80c2-d67968135d61 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:37.203208 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:37.319344 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79209e9-da9d-456c-80c2-d67968135d61 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:37.380027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96097a-0569-4b66-99e9-045dcdf40010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:37.381074 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96097a-0569-4b66-99e9-045dcdf40010 None admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:37.381607 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96097a-0569-4b66-99e9-045dcdf40010 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:37.382092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96097a-0569-4b66-99e9-045dcdf40010 None admin] PATH_INFO: `/v3/services` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:37.383285 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96097a-0569-4b66-99e9-045dcdf40010 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:37.385870 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96097a-0569-4b66-99e9-045dcdf40010 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:37.410986 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 643/1295] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Aug 23 22:17:37 2022] POST /identity/v3/services => generated 246 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:17:39.389594 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e50d7a-6dc4-42da-8c56-1fa6611de4b6 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:39.390129 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e50d7a-6dc4-42da-8c56-1fa6611de4b6 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:39.390129 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e50d7a-6dc4-42da-8c56-1fa6611de4b6 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:39.392391 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 653/1296] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:17:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:17:39.398211 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279ab37-9e5c-4b0a-812a-225174a73657 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:39.398757 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279ab37-9e5c-4b0a-812a-225174a73657 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:39.398757 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279ab37-9e5c-4b0a-812a-225174a73657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:39.419828 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-a279ab37-9e5c-4b0a-812a-225174a73657 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:17:39.421052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-a279ab37-9e5c-4b0a-812a-225174a73657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:39.505768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 644/1297] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:17:39 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:17:39.790029 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e50d7a-6dc4-42da-8c56-1fa6611de4b6 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:39.902592 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e50d7a-6dc4-42da-8c56-1fa6611de4b6 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:39.939705 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a978ca6-7d99-42e8-9fb6-c79488740b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:39.940336 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a978ca6-7d99-42e8-9fb6-c79488740b7f None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:39.940613 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a978ca6-7d99-42e8-9fb6-c79488740b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:39.940878 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a978ca6-7d99-42e8-9fb6-c79488740b7f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:39.941493 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a978ca6-7d99-42e8-9fb6-c79488740b7f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:39.942845 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a978ca6-7d99-42e8-9fb6-c79488740b7f None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:39.951606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-2a978ca6-7d99-42e8-9fb6-c79488740b7f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:17:39.951606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:17:39.951606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:17:39.951606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:17:39.951606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:17:39.951606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:17:39.951606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:17:39.951606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:17:39.951606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:17:39.951606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:17:39.951606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:17:39.951606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:17:39.951606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:17:39.951606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:17:39.951606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:17:39.951606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:17:39.951606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:17:39.952859 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:17:39.952859 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:17:39.952859 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:17:39.952859 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:17:39.952859 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:17:39.952859 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:17:39.952859 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:17:39.952859 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:17:39.952859 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:17:39.952859 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:17:39.952859 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:17:39.952859 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:17:39.952859 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:17:39.952859 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:17:39.952859 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:17:39.952859 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:17:39.954697 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:17:39.954697 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:17:39.954697 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:17:39.954697 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:17:39.954697 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:17:39.954697 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:17:39.954697 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:17:39.954697 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:17:39.954697 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:17:39.954697 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:17:39.954697 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:17:39.954697 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:17:39.954697 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:17:39.954697 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:17:39.954697 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 654/1298] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Aug 23 22:17:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:17:39.959476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279ab37-9e5c-4b0a-812a-225174a73657 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:39.978553 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:40.074790 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279ab37-9e5c-4b0a-812a-225174a73657 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:40.116451 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0dcd52-f550-467b-bcb4-ce695fd44657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:40.117075 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0dcd52-f550-467b-bcb4-ce695fd44657 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:40.117359 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0dcd52-f550-467b-bcb4-ce695fd44657 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:40.117664 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0dcd52-f550-467b-bcb4-ce695fd44657 None admin] PATH_INFO: `/v3/services` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:40.118317 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0dcd52-f550-467b-bcb4-ce695fd44657 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:40.118621 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0dcd52-f550-467b-bcb4-ce695fd44657 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:40.120014 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0dcd52-f550-467b-bcb4-ce695fd44657 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:40.126055 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 645/1299] 10.222.0.77 () {56 vars in 1116 bytes} [Tue Aug 23 22:17:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:17:40.132603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a978ca6-7d99-42e8-9fb6-c79488740b7f None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:40.168286 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:40.245278 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a978ca6-7d99-42e8-9fb6-c79488740b7f None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:40.281070 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716cb36-6cfc-4c0d-91ec-3d2974a8a3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:40.282263 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716cb36-6cfc-4c0d-91ec-3d2974a8a3c2 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:40.282586 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716cb36-6cfc-4c0d-91ec-3d2974a8a3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:40.282881 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716cb36-6cfc-4c0d-91ec-3d2974a8a3c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:40.283647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716cb36-6cfc-4c0d-91ec-3d2974a8a3c2 None admin] RBAC: Adding query filter params (interface=public, service_id=ab5ea5116b544f28ba5b9bcd3f9891cb, region_id=RegionOne) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:40.283995 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716cb36-6cfc-4c0d-91ec-3d2974a8a3c2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:40.285491 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716cb36-6cfc-4c0d-91ec-3d2974a8a3c2 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:40.291238 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 655/1300] 10.222.0.77 () {56 vars in 1251 bytes} [Tue Aug 23 22:17:40 2022] GET /identity/v3/endpoints?service_id=ab5ea5116b544f28ba5b9bcd3f9891cb&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:17:40.298724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0dcd52-f550-467b-bcb4-ce695fd44657 None admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:40.398998 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:40.433183 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0dcd52-f550-467b-bcb4-ce695fd44657 None admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:40.474012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424539b4-9e2e-4b6d-be9d-ae30c90e1d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:40.474625 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424539b4-9e2e-4b6d-be9d-ae30c90e1d2f None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:40.474907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424539b4-9e2e-4b6d-be9d-ae30c90e1d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:40.475177 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424539b4-9e2e-4b6d-be9d-ae30c90e1d2f None admin] PATH_INFO: `/v3/services` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:40.475790 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424539b4-9e2e-4b6d-be9d-ae30c90e1d2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:40.477170 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424539b4-9e2e-4b6d-be9d-ae30c90e1d2f None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:40.484314 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 646/1301] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Aug 23 22:17:40 2022] GET /identity/v3/services => generated 2191 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:17:42.433575 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e80fbb-e3a9-4b81-9059-f39a1d06ae20 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:42.434111 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e80fbb-e3a9-4b81-9059-f39a1d06ae20 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:42.434111 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e80fbb-e3a9-4b81-9059-f39a1d06ae20 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:42.435464 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 656/1302] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:17:42.441792 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67920d-6696-4fde-8b49-b635c5dbfc31 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:42.442259 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67920d-6696-4fde-8b49-b635c5dbfc31 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:42.442334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67920d-6696-4fde-8b49-b635c5dbfc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:42.462144 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-9c67920d-6696-4fde-8b49-b635c5dbfc31 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:17:42.463690 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-9c67920d-6696-4fde-8b49-b635c5dbfc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:42.536618 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 647/1303] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:17:42 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:17:42.809722 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e80fbb-e3a9-4b81-9059-f39a1d06ae20 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:42.909241 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:42.917390 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e80fbb-e3a9-4b81-9059-f39a1d06ae20 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:42.955552 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820fecb8-ee35-4cd2-8a71-d30d266a3bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:42.956198 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fecb8-ee35-4cd2-8a71-d30d266a3bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:42.956478 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fecb8-ee35-4cd2-8a71-d30d266a3bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:42.956750 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fecb8-ee35-4cd2-8a71-d30d266a3bf0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:42.957338 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820fecb8-ee35-4cd2-8a71-d30d266a3bf0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:42.958761 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820fecb8-ee35-4cd2-8a71-d30d266a3bf0 None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:42.968037 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application [None req-820fecb8-ee35-4cd2-8a71-d30d266a3bf0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:17:42.968037 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:17:42.968037 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:17:42.968037 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:17:42.968037 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:17:42.968037 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:17:42.968037 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:17:42.968037 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:17:42.968037 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:17:42.968037 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:17:42.968037 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:17:42.968037 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:17:42.968037 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:17:42.968037 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:17:42.968037 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:17:42.968037 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:17:42.968037 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:17:42.970100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:17:42.970100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:17:42.970100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:17:42.970100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:17:42.970100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:17:42.970100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:17:42.970100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:17:42.970100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:17:42.970100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:17:42.970100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:17:42.970100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:17:42.970100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:17:42.970100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:17:42.970100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:17:42.970100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:17:42.970100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:17:42.971176 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:17:42.971176 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application with Lock( Aug 23 22:17:42.971176 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:17:42.971176 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:17:42.971176 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:17:42.971176 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:17:42.971176 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:17:42.971176 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:17:42.971176 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:17:42.971176 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:17:42.971176 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:17:42.971176 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:17:42.971176 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:17:42.971176 dv-cinder-850321-4-smb devstack@keystone.service[81752]: ERROR keystone.server.flask.application Aug 23 22:17:42.971176 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 657/1304] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Aug 23 22:17:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:17:42.976619 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67920d-6696-4fde-8b49-b635c5dbfc31 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:43.058412 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:43.085701 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67920d-6696-4fde-8b49-b635c5dbfc31 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:43.122548 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77496873-460c-4fab-8046-a71f01baea33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:43.123165 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77496873-460c-4fab-8046-a71f01baea33 None admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:43.123449 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77496873-460c-4fab-8046-a71f01baea33 None admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:43.123722 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77496873-460c-4fab-8046-a71f01baea33 None admin] PATH_INFO: `/v3/services` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:43.124357 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77496873-460c-4fab-8046-a71f01baea33 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:17:43.124695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77496873-460c-4fab-8046-a71f01baea33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:43.126110 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77496873-460c-4fab-8046-a71f01baea33 None admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:43.132614 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 648/1305] 10.222.0.77 () {56 vars in 1116 bytes} [Tue Aug 23 22:17:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:17:43.138343 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820fecb8-ee35-4cd2-8a71-d30d266a3bf0 None admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:43.245035 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820fecb8-ee35-4cd2-8a71-d30d266a3bf0 None admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:43.279705 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff9c66-aa69-48b1-8f6f-c5ef23fe3a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:43.280310 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff9c66-aa69-48b1-8f6f-c5ef23fe3a6d None admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:43.280584 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff9c66-aa69-48b1-8f6f-c5ef23fe3a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:43.280861 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff9c66-aa69-48b1-8f6f-c5ef23fe3a6d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:43.282072 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff9c66-aa69-48b1-8f6f-c5ef23fe3a6d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:43.283443 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff9c66-aa69-48b1-8f6f-c5ef23fe3a6d None admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:43.305392 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 658/1306] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:17:43 2022] POST /identity/v3/endpoints => generated 331 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:17:53.129290 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=30 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:53.301018 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:18:53.580113 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944c8d8-5adf-43c6-9aca-907e15aa9682 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:53.581220 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944c8d8-5adf-43c6-9aca-907e15aa9682 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:53.581743 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944c8d8-5adf-43c6-9aca-907e15aa9682 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:53.587498 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 649/1307] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:18:53 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:18:53.590005 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703d362-3150-49dc-85e0-f52117424b12 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:53.590485 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703d362-3150-49dc-85e0-f52117424b12 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:53.590967 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703d362-3150-49dc-85e0-f52117424b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:53.840717 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-3703d362-3150-49dc-85e0-f52117424b12 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:18:53.842202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-3703d362-3150-49dc-85e0-f52117424b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:54.022961 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 659/1308] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:18:54.334549 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ebd69-1819-4cd1-a446-7173e8121ae3 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:54.334916 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ebd69-1819-4cd1-a446-7173e8121ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:54.335202 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ebd69-1819-4cd1-a446-7173e8121ae3 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:54.336742 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 650/1309] 10.222.0.77 () {54 vars in 965 bytes} [Tue Aug 23 22:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:18:54.343809 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d37ea-437e-4e74-b8d4-6451a3dbdc4f None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:54.344581 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d37ea-437e-4e74-b8d4-6451a3dbdc4f None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:54.344581 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d37ea-437e-4e74-b8d4-6451a3dbdc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:54.441383 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-e15d37ea-437e-4e74-b8d4-6451a3dbdc4f None None] MFA Rules not processed for user `84ea6fbc3de84b7db9e62b9ee6055c52`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:18:54.442640 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-e15d37ea-437e-4e74-b8d4-6451a3dbdc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:54.470685 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:18:54.543995 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 660/1310] 10.222.0.77 () {58 vars in 1062 bytes} [Tue Aug 23 22:18:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:18:54.554345 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ebd69-1819-4cd1-a446-7173e8121ae3 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:18:54.556692 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-de9ebd69-1819-4cd1-a446-7173e8121ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:54.694942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ebd69-1819-4cd1-a446-7173e8121ae3 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:18:54.803062 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2576b8d-7402-48a2-919b-8c485682da6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:18:54.804055 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2576b8d-7402-48a2-919b-8c485682da6f service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:54.804557 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2576b8d-7402-48a2-919b-8c485682da6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:54.805033 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2576b8d-7402-48a2-919b-8c485682da6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:54.807595 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-b2576b8d-7402-48a2-919b-8c485682da6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:54.872220 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:18:54.941104 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2576b8d-7402-48a2-919b-8c485682da6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:18:54.942984 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2576b8d-7402-48a2-919b-8c485682da6f service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:18:54.966517 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 651/1311] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:18:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:18:57.762448 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f4c32-095e-42b8-ae01-b0d4b642559f None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:57.763097 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f4c32-095e-42b8-ae01-b0d4b642559f None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:57.763660 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f4c32-095e-42b8-ae01-b0d4b642559f None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:57.766464 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 661/1312] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:18:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:18:57.773682 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292a1e8-3720-4b10-bcdf-275435e69f6f None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:57.774205 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292a1e8-3720-4b10-bcdf-275435e69f6f None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:57.774324 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292a1e8-3720-4b10-bcdf-275435e69f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:57.885662 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-3292a1e8-3720-4b10-bcdf-275435e69f6f None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:18:57.886935 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-3292a1e8-3720-4b10-bcdf-275435e69f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:58.010996 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 652/1313] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:18:58.319034 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62afaa0-7655-4252-81bf-c82b430860c4 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:58.319314 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62afaa0-7655-4252-81bf-c82b430860c4 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:58.319619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62afaa0-7655-4252-81bf-c82b430860c4 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:58.320984 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 662/1314] 10.222.0.77 () {54 vars in 965 bytes} [Tue Aug 23 22:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:18:58.329946 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf655d-a8be-4c49-b4be-2f55e810d44c None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:58.330540 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf655d-a8be-4c49-b4be-2f55e810d44c None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:58.331144 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf655d-a8be-4c49-b4be-2f55e810d44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:58.352647 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:18:58.452006 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-0ccf655d-a8be-4c49-b4be-2f55e810d44c None None] MFA Rules not processed for user `84ea6fbc3de84b7db9e62b9ee6055c52`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:18:58.453552 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-0ccf655d-a8be-4c49-b4be-2f55e810d44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:58.562093 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 653/1315] 10.222.0.77 () {58 vars in 1062 bytes} [Tue Aug 23 22:18:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:18:58.573054 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62afaa0-7655-4252-81bf-c82b430860c4 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:18:58.576124 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-b62afaa0-7655-4252-81bf-c82b430860c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:58.736700 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62afaa0-7655-4252-81bf-c82b430860c4 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:18:58.859237 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:18:58.863851 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3fc7f-999a-4fd3-a03c-2228d0b4ef15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:18:58.864832 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3fc7f-999a-4fd3-a03c-2228d0b4ef15 service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:58.865394 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3fc7f-999a-4fd3-a03c-2228d0b4ef15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:58.865684 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3fc7f-999a-4fd3-a03c-2228d0b4ef15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:58.867469 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-2fd3fc7f-999a-4fd3-a03c-2228d0b4ef15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:59.038269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3fc7f-999a-4fd3-a03c-2228d0b4ef15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:18:59.039642 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3fc7f-999a-4fd3-a03c-2228d0b4ef15 service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:18:59.064685 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 663/1316] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:18:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:19:01.662841 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d446a-2d73-4918-a0ef-b69d8e694b4a None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:01.663408 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d446a-2d73-4918-a0ef-b69d8e694b4a None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:01.663408 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d446a-2d73-4918-a0ef-b69d8e694b4a None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:01.664704 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 654/1317] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:19:01.670843 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78771f2-4a13-4dd2-98c6-9c0c3094b053 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:01.671459 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78771f2-4a13-4dd2-98c6-9c0c3094b053 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:01.671459 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78771f2-4a13-4dd2-98c6-9c0c3094b053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:01.747242 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-f78771f2-4a13-4dd2-98c6-9c0c3094b053 None None] MFA Rules not processed for user `20a5fed4c1cc4e61a08385f0a1b65924`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:19:01.748491 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-f78771f2-4a13-4dd2-98c6-9c0c3094b053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:01.814643 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:01.861011 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 664/1318] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:19:01 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:19:02.149458 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d446a-2d73-4918-a0ef-b69d8e694b4a None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:19:02.151051 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-df9d446a-2d73-4918-a0ef-b69d8e694b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:02.262165 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d446a-2d73-4918-a0ef-b69d8e694b4a None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:19:02.265666 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:02.340621 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286a95b-4940-4bc0-b693-54d660dbfb2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:19:02.341230 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286a95b-4940-4bc0-b693-54d660dbfb2f service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:02.341546 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286a95b-4940-4bc0-b693-54d660dbfb2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:02.341826 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286a95b-4940-4bc0-b693-54d660dbfb2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:02.344187 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-a286a95b-4940-4bc0-b693-54d660dbfb2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:02.462206 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286a95b-4940-4bc0-b693-54d660dbfb2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:19:02.463712 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286a95b-4940-4bc0-b693-54d660dbfb2f service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:19:02.487650 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 655/1319] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:19:02 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:19:05.251638 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63c62b-327a-41bb-81a2-12bf7ce9d360 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:05.252184 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63c62b-327a-41bb-81a2-12bf7ce9d360 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:05.252184 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63c62b-327a-41bb-81a2-12bf7ce9d360 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:05.253620 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 665/1320] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:19:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:19:05.260327 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf128f9-29da-47dc-bdd9-4eb407e02ed0 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:05.260834 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf128f9-29da-47dc-bdd9-4eb407e02ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:05.260930 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf128f9-29da-47dc-bdd9-4eb407e02ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:05.306385 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:05.335113 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-dbf128f9-29da-47dc-bdd9-4eb407e02ed0 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:19:05.336351 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-dbf128f9-29da-47dc-bdd9-4eb407e02ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:05.440631 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 656/1321] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:19:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:19:05.732169 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63c62b-327a-41bb-81a2-12bf7ce9d360 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:19:05.734241 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-ce63c62b-327a-41bb-81a2-12bf7ce9d360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:05.848983 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63c62b-327a-41bb-81a2-12bf7ce9d360 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:19:05.929544 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc69092-da13-4e50-83fb-60d16272d1a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:19:05.930162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc69092-da13-4e50-83fb-60d16272d1a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:05.930697 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc69092-da13-4e50-83fb-60d16272d1a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:05.930967 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc69092-da13-4e50-83fb-60d16272d1a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:05.932627 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-efc69092-da13-4e50-83fb-60d16272d1a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:05.941605 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:06.051674 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc69092-da13-4e50-83fb-60d16272d1a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:19:06.053027 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc69092-da13-4e50-83fb-60d16272d1a3 service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:19:06.072660 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 666/1322] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:19:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:19:08.781887 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc842d-0309-45b5-b383-c2e60c97957f None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:08.782460 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc842d-0309-45b5-b383-c2e60c97957f None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:08.782646 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc842d-0309-45b5-b383-c2e60c97957f None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:08.784155 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 657/1323] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:19:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:19:08.790404 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda588f-8d89-467f-a4b0-88310bfaaad1 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:08.791066 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda588f-8d89-467f-a4b0-88310bfaaad1 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:08.791066 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda588f-8d89-467f-a4b0-88310bfaaad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:08.868108 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-8cda588f-8d89-467f-a4b0-88310bfaaad1 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:19:08.869444 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-8cda588f-8d89-467f-a4b0-88310bfaaad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:08.934606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:08.978078 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 667/1324] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:19:09.274414 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc842d-0309-45b5-b383-c2e60c97957f None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:19:09.276279 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-33fc842d-0309-45b5-b383-c2e60c97957f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:09.407841 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc842d-0309-45b5-b383-c2e60c97957f None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:19:09.422201 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:09.492941 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90235c3-16f6-47f1-a467-391978830bc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:19:09.493593 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90235c3-16f6-47f1-a467-391978830bc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:09.493878 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90235c3-16f6-47f1-a467-391978830bc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:09.494156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90235c3-16f6-47f1-a467-391978830bc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:09.495812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-c90235c3-16f6-47f1-a467-391978830bc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:09.618362 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90235c3-16f6-47f1-a467-391978830bc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:19:09.619747 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90235c3-16f6-47f1-a467-391978830bc2 service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:19:09.642523 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 658/1325] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:19:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:19:11.678520 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b186e-675a-4215-be9a-6ce6d1b86f3d None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:11.679051 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b186e-675a-4215-be9a-6ce6d1b86f3d None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:11.679051 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b186e-675a-4215-be9a-6ce6d1b86f3d None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:11.680866 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 668/1326] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:19:11.686406 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e61d7f-2eee-4517-93ef-f530680879f6 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:11.687542 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e61d7f-2eee-4517-93ef-f530680879f6 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:11.687739 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e61d7f-2eee-4517-93ef-f530680879f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:11.743863 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:11.765687 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-71e61d7f-2eee-4517-93ef-f530680879f6 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:19:11.766971 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-71e61d7f-2eee-4517-93ef-f530680879f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:11.879827 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 659/1327] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:19:12.163023 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b186e-675a-4215-be9a-6ce6d1b86f3d None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:19:12.164771 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-0f6b186e-675a-4215-be9a-6ce6d1b86f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:12.286185 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b186e-675a-4215-be9a-6ce6d1b86f3d None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:19:12.368958 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5bc48-1ec5-4359-b629-9e6fa6a2b6cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:19:12.369517 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5bc48-1ec5-4359-b629-9e6fa6a2b6cf service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:12.369800 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5bc48-1ec5-4359-b629-9e6fa6a2b6cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:12.370069 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5bc48-1ec5-4359-b629-9e6fa6a2b6cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:12.371774 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-ffe5bc48-1ec5-4359-b629-9e6fa6a2b6cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:12.398477 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:12.505303 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5bc48-1ec5-4359-b629-9e6fa6a2b6cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:19:12.506764 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5bc48-1ec5-4359-b629-9e6fa6a2b6cf service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:19:12.526260 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 669/1328] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:19:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:19:14.556030 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb345a4-ae80-4e59-8fe7-9717ab619a77 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:14.556857 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb345a4-ae80-4e59-8fe7-9717ab619a77 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:14.556857 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb345a4-ae80-4e59-8fe7-9717ab619a77 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:14.558645 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 660/1329] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:19:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:19:14.566441 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee1e9a-b9c9-4d26-83e1-16b94907eb6b None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:14.567296 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee1e9a-b9c9-4d26-83e1-16b94907eb6b None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:14.567296 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee1e9a-b9c9-4d26-83e1-16b94907eb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:14.644346 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-47ee1e9a-b9c9-4d26-83e1-16b94907eb6b None None] MFA Rules not processed for user `20a5fed4c1cc4e61a08385f0a1b65924`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:19:14.645825 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-47ee1e9a-b9c9-4d26-83e1-16b94907eb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:14.721862 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:14.763078 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 670/1330] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:19:14 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:19:15.064114 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb345a4-ae80-4e59-8fe7-9717ab619a77 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:19:15.065691 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-5eb345a4-ae80-4e59-8fe7-9717ab619a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:15.205729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb345a4-ae80-4e59-8fe7-9717ab619a77 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:19:15.233234 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:15.308143 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1099c-59ff-4a5e-95d5-445d8e5ff1ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:19:15.308775 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1099c-59ff-4a5e-95d5-445d8e5ff1ec service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:15.309083 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1099c-59ff-4a5e-95d5-445d8e5ff1ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:15.309353 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1099c-59ff-4a5e-95d5-445d8e5ff1ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:15.311068 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-35d1099c-59ff-4a5e-95d5-445d8e5ff1ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:15.448043 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1099c-59ff-4a5e-95d5-445d8e5ff1ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:19:15.449622 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1099c-59ff-4a5e-95d5-445d8e5ff1ec service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:19:15.472548 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 661/1331] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:19:15 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:19:17.774872 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2b88c-9256-48ba-96cd-e9275b85f3bc None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:17.775714 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2b88c-9256-48ba-96cd-e9275b85f3bc None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:17.775714 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2b88c-9256-48ba-96cd-e9275b85f3bc None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:17.777125 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 671/1332] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:19:17.783757 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c2940-0ca6-49a0-aba5-eb3a02bb902f None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:17.784308 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c2940-0ca6-49a0-aba5-eb3a02bb902f None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:17.784452 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c2940-0ca6-49a0-aba5-eb3a02bb902f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:17.865586 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:17.868775 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-6f2c2940-0ca6-49a0-aba5-eb3a02bb902f None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:19:17.870739 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-6f2c2940-0ca6-49a0-aba5-eb3a02bb902f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:18.041258 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 662/1333] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:19:18.339154 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2b88c-9256-48ba-96cd-e9275b85f3bc None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:19:18.341649 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-56c2b88c-9256-48ba-96cd-e9275b85f3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:18.485145 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2b88c-9256-48ba-96cd-e9275b85f3bc None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:19:18.614112 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3413e-d622-4a94-a9f6-a60f424d4a37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:19:18.615080 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3413e-d622-4a94-a9f6-a60f424d4a37 service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:18.615595 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3413e-d622-4a94-a9f6-a60f424d4a37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:18.616094 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3413e-d622-4a94-a9f6-a60f424d4a37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:18.619366 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-d3f3413e-d622-4a94-a9f6-a60f424d4a37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:18.675323 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:18.798736 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3413e-d622-4a94-a9f6-a60f424d4a37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:19:18.800198 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3413e-d622-4a94-a9f6-a60f424d4a37 service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:19:18.820128 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 672/1334] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:19:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:19:20.926044 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c4518-998b-4256-9e7b-3066a2bfe123 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:20.926633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c4518-998b-4256-9e7b-3066a2bfe123 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:20.926633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c4518-998b-4256-9e7b-3066a2bfe123 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:20.927943 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 663/1335] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:19:20.934095 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b567217-8246-4924-a99b-ed8f4c869e3a None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:20.934646 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b567217-8246-4924-a99b-ed8f4c869e3a None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:20.934646 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b567217-8246-4924-a99b-ed8f4c869e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:21.027025 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-4b567217-8246-4924-a99b-ed8f4c869e3a None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:19:21.028212 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-4b567217-8246-4924-a99b-ed8f4c869e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:21.128425 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:21.154570 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 673/1336] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:19:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:19:21.446449 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c4518-998b-4256-9e7b-3066a2bfe123 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:19:21.448002 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-700c4518-998b-4256-9e7b-3066a2bfe123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:21.563391 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c4518-998b-4256-9e7b-3066a2bfe123 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:19:21.593956 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:21.649624 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ea2ba-0ab6-43ac-a483-4fffcf222d2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:19:21.650138 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ea2ba-0ab6-43ac-a483-4fffcf222d2a service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:21.650423 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ea2ba-0ab6-43ac-a483-4fffcf222d2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:21.650695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ea2ba-0ab6-43ac-a483-4fffcf222d2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:21.652326 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-630ea2ba-0ab6-43ac-a483-4fffcf222d2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:21.776403 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630ea2ba-0ab6-43ac-a483-4fffcf222d2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:19:21.778129 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630ea2ba-0ab6-43ac-a483-4fffcf222d2a service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:19:21.798928 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 664/1337] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:19:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:19:24.331609 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d56b0c-da6a-4889-91f6-d699ec3cbfad None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:24.332201 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d56b0c-da6a-4889-91f6-d699ec3cbfad None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:24.332201 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d56b0c-da6a-4889-91f6-d699ec3cbfad None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:24.333590 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 674/1338] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:19:24.339064 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15b0f6-2a9f-4747-a604-0233ac788cc6 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:24.339562 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15b0f6-2a9f-4747-a604-0233ac788cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:24.339675 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15b0f6-2a9f-4747-a604-0233ac788cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:24.420715 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-3d15b0f6-2a9f-4747-a604-0233ac788cc6 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:19:24.422668 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-3d15b0f6-2a9f-4747-a604-0233ac788cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:24.432421 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:24.538623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 665/1339] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:19:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:19:24.824241 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d56b0c-da6a-4889-91f6-d699ec3cbfad None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:19:24.825856 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-d2d56b0c-da6a-4889-91f6-d699ec3cbfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:24.940137 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d56b0c-da6a-4889-91f6-d699ec3cbfad None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:19:25.020092 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceaa9df-1419-47af-bd87-60066611e631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:19:25.020620 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceaa9df-1419-47af-bd87-60066611e631 service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:25.020900 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceaa9df-1419-47af-bd87-60066611e631 service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:25.021173 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceaa9df-1419-47af-bd87-60066611e631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:25.022845 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-8ceaa9df-1419-47af-bd87-60066611e631 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:25.061255 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:25.142638 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceaa9df-1419-47af-bd87-60066611e631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:19:25.144312 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceaa9df-1419-47af-bd87-60066611e631 service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:19:25.164119 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 675/1340] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:19:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:19:29.411507 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731da4a-8ebe-4875-bcee-9465a524301b None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:29.412051 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731da4a-8ebe-4875-bcee-9465a524301b None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:29.412051 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731da4a-8ebe-4875-bcee-9465a524301b None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:29.413450 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 666/1341] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:19:29.420193 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc6a19-7184-4868-beaa-121ab47337c6 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:29.420743 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc6a19-7184-4868-beaa-121ab47337c6 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:29.420743 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc6a19-7184-4868-beaa-121ab47337c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:29.500641 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-22fc6a19-7184-4868-beaa-121ab47337c6 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:19:29.502174 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-22fc6a19-7184-4868-beaa-121ab47337c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:29.601999 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:29.617087 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 676/1342] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:19:29.902169 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731da4a-8ebe-4875-bcee-9465a524301b None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:19:29.903854 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-0731da4a-8ebe-4875-bcee-9465a524301b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:30.021945 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731da4a-8ebe-4875-bcee-9465a524301b None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:19:30.066912 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:30.110998 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d29628-ff20-468a-a986-6c939c7215f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:19:30.111620 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d29628-ff20-468a-a986-6c939c7215f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:30.111907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d29628-ff20-468a-a986-6c939c7215f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:30.112181 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d29628-ff20-468a-a986-6c939c7215f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:30.113867 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-c6d29628-ff20-468a-a986-6c939c7215f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:30.243208 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d29628-ff20-468a-a986-6c939c7215f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:19:30.244878 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d29628-ff20-468a-a986-6c939c7215f3 service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:19:30.267117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 667/1343] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:19:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:19:33.002164 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9a2f4-4892-4f34-bc58-470b06fa9276 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:33.002707 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9a2f4-4892-4f34-bc58-470b06fa9276 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:33.002707 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9a2f4-4892-4f34-bc58-470b06fa9276 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:33.004052 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 677/1344] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:19:33.009703 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3770a8-0976-46a7-b38d-c115a49632c3 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:33.010227 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3770a8-0976-46a7-b38d-c115a49632c3 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:33.010227 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3770a8-0976-46a7-b38d-c115a49632c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:33.091166 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-bb3770a8-0976-46a7-b38d-c115a49632c3 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:19:33.092388 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-bb3770a8-0976-46a7-b38d-c115a49632c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:33.113300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:33.208259 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 668/1345] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:19:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:19:33.496097 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9a2f4-4892-4f34-bc58-470b06fa9276 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:19:33.498367 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-37c9a2f4-4892-4f34-bc58-470b06fa9276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:33.635227 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9a2f4-4892-4f34-bc58-470b06fa9276 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:19:33.727506 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a67607-a53a-4d70-bc00-5440632ba2ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:19:33.728579 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a67607-a53a-4d70-bc00-5440632ba2ca service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:33.729104 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a67607-a53a-4d70-bc00-5440632ba2ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:33.729634 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a67607-a53a-4d70-bc00-5440632ba2ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:33.732704 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-46a67607-a53a-4d70-bc00-5440632ba2ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:33.817434 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:33.918338 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a67607-a53a-4d70-bc00-5440632ba2ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:19:33.919695 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a67607-a53a-4d70-bc00-5440632ba2ca service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:19:33.940385 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 678/1346] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:19:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:19:38.153890 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84783791-fd8e-4266-8dc1-e01df415ce83 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:38.154642 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84783791-fd8e-4266-8dc1-e01df415ce83 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:38.154642 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84783791-fd8e-4266-8dc1-e01df415ce83 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:38.157008 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 669/1347] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:19:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:19:38.166136 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3768b-50f4-4379-a358-5bb8860ebdab None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:38.167428 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3768b-50f4-4379-a358-5bb8860ebdab None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:38.169176 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3768b-50f4-4379-a358-5bb8860ebdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:38.268353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-bde3768b-50f4-4379-a358-5bb8860ebdab None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:19:38.269675 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-bde3768b-50f4-4379-a358-5bb8860ebdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:38.390762 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:38.395765 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 679/1348] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:19:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:19:38.696617 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84783791-fd8e-4266-8dc1-e01df415ce83 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:19:38.698316 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-84783791-fd8e-4266-8dc1-e01df415ce83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:38.836951 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84783791-fd8e-4266-8dc1-e01df415ce83 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:19:38.887543 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:38.918787 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ce55e-d281-4271-9506-eacbc251c633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:19:38.919392 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ce55e-d281-4271-9506-eacbc251c633 service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:38.919715 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ce55e-d281-4271-9506-eacbc251c633 service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:38.919943 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ce55e-d281-4271-9506-eacbc251c633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:38.921823 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-0e0ce55e-d281-4271-9506-eacbc251c633 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:39.047802 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ce55e-d281-4271-9506-eacbc251c633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:19:39.049231 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ce55e-d281-4271-9506-eacbc251c633 service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:19:39.068006 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 670/1349] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:19:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:19:44.384196 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2f2c5-11cc-4b8c-a954-e8d4fb94b6a3 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:44.384746 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2f2c5-11cc-4b8c-a954-e8d4fb94b6a3 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:44.384746 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2f2c5-11cc-4b8c-a954-e8d4fb94b6a3 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:44.388938 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 680/1350] 10.222.0.77 () {54 vars in 921 bytes} [Tue Aug 23 22:19:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:19:44.395443 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71708167-206b-4233-a773-bd7397438a54 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:44.395978 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71708167-206b-4233-a773-bd7397438a54 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:44.396222 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71708167-206b-4233-a773-bd7397438a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:44.527035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-71708167-206b-4233-a773-bd7397438a54 None None] MFA Rules not processed for user `2000b80e34ae45d2a8b658cd394419f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:19:44.528331 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-71708167-206b-4233-a773-bd7397438a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:44.557981 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:44.713525 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 671/1351] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Aug 23 22:19:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:19:49.982358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752b553-945a-4344-9d43-987f43feafa3 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:49.982999 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752b553-945a-4344-9d43-987f43feafa3 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:49.983981 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752b553-945a-4344-9d43-987f43feafa3 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:49.987202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 681/1352] 10.222.0.77 () {54 vars in 921 bytes} [Tue Aug 23 22:19:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:19:49.995354 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d4ea2-8533-4e11-9ca9-ad7ea9b61b0a None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:49.996620 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d4ea2-8533-4e11-9ca9-ad7ea9b61b0a None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:49.997162 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d4ea2-8533-4e11-9ca9-ad7ea9b61b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:50.103003 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-714d4ea2-8533-4e11-9ca9-ad7ea9b61b0a None None] MFA Rules not processed for user `2000b80e34ae45d2a8b658cd394419f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:19:50.105195 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-714d4ea2-8533-4e11-9ca9-ad7ea9b61b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:50.200457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:50.269493 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 672/1353] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Aug 23 22:19:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:19:51.591448 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cda2f-f064-4c6f-b8e7-eb9cf54a1e92 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:51.591981 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cda2f-f064-4c6f-b8e7-eb9cf54a1e92 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:51.592442 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cda2f-f064-4c6f-b8e7-eb9cf54a1e92 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:51.595670 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 682/1354] 10.222.0.77 () {54 vars in 921 bytes} [Tue Aug 23 22:19:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:19:51.604728 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8ea1e-246d-4874-9799-3666cc791680 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:51.605296 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8ea1e-246d-4874-9799-3666cc791680 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:51.605732 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8ea1e-246d-4874-9799-3666cc791680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:51.739215 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-98c8ea1e-246d-4874-9799-3666cc791680 None None] MFA Rules not processed for user `2000b80e34ae45d2a8b658cd394419f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:19:51.741003 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-98c8ea1e-246d-4874-9799-3666cc791680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:51.873585 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 673/1355] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Aug 23 22:19:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:19:55.442239 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76aeb7-215d-4f52-921d-c8f2e75e72e4 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:55.442814 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76aeb7-215d-4f52-921d-c8f2e75e72e4 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:55.442814 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76aeb7-215d-4f52-921d-c8f2e75e72e4 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:55.444167 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 683/1356] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:19:55.450409 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead0d57-f0c4-4944-8de7-8c54a48165af None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:55.450989 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead0d57-f0c4-4944-8de7-8c54a48165af None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:55.450989 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead0d57-f0c4-4944-8de7-8c54a48165af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:55.492902 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:55.534874 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-9ead0d57-f0c4-4944-8de7-8c54a48165af None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:19:55.536140 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-9ead0d57-f0c4-4944-8de7-8c54a48165af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:55.717419 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 674/1357] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:19:56.110758 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594f4c9-305b-4146-b626-6469daca94bf None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:56.111241 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594f4c9-305b-4146-b626-6469daca94bf None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:56.113184 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594f4c9-305b-4146-b626-6469daca94bf None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:56.116419 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 684/1358] 10.222.0.77 () {54 vars in 962 bytes} [Tue Aug 23 22:19:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:19:56.127445 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ca1cf-3f15-4b11-a267-5a2eaf6b5d13 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:56.128451 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ca1cf-3f15-4b11-a267-5a2eaf6b5d13 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:56.129222 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ca1cf-3f15-4b11-a267-5a2eaf6b5d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:56.249704 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-cb6ca1cf-3f15-4b11-a267-5a2eaf6b5d13 None None] MFA Rules not processed for user `1a0af5bf009b48a8915c7320b16d08dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:19:56.251289 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-cb6ca1cf-3f15-4b11-a267-5a2eaf6b5d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:56.336934 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:56.422085 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 675/1359] 10.222.0.77 () {58 vars in 1059 bytes} [Tue Aug 23 22:19:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:19:56.431164 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594f4c9-305b-4146-b626-6469daca94bf None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:19:56.432867 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-5594f4c9-305b-4146-b626-6469daca94bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:56.598552 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594f4c9-305b-4146-b626-6469daca94bf None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:19:56.680145 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:56.732891 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff9178-6ec5-47b6-8c27-029472ca32c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:19:56.734360 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff9178-6ec5-47b6-8c27-029472ca32c6 service nova] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:56.734855 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff9178-6ec5-47b6-8c27-029472ca32c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:56.740620 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff9178-6ec5-47b6-8c27-029472ca32c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:56.740620 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-75ff9178-6ec5-47b6-8c27-029472ca32c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:56.863704 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff9178-6ec5-47b6-8c27-029472ca32c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:19:56.865404 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff9178-6ec5-47b6-8c27-029472ca32c6 service nova] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:19:56.888343 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 685/1360] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:19:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:19:59.205573 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9a46a-15f3-4de1-a2c1-90dd55f44bd1 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:59.206152 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9a46a-15f3-4de1-a2c1-90dd55f44bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:59.206152 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9a46a-15f3-4de1-a2c1-90dd55f44bd1 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:59.211933 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 676/1361] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:19:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:19:59.213449 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1c5ce-fbc1-4890-bf1b-54206d91eb5c None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:59.213987 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1c5ce-fbc1-4890-bf1b-54206d91eb5c None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:59.213987 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1c5ce-fbc1-4890-bf1b-54206d91eb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:59.317856 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-f8d1c5ce-fbc1-4890-bf1b-54206d91eb5c None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:19:59.319120 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-f8d1c5ce-fbc1-4890-bf1b-54206d91eb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:59.364824 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:59.468465 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 686/1362] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:19:59.797095 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9a46a-15f3-4de1-a2c1-90dd55f44bd1 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:19:59.799537 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-6fe9a46a-15f3-4de1-a2c1-90dd55f44bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:59.980517 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9a46a-15f3-4de1-a2c1-90dd55f44bd1 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:19:59.994852 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:00.141670 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e168709-cdaf-4992-a67f-a0124c221d59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:20:00.142293 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e168709-cdaf-4992-a67f-a0124c221d59 service nova] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:00.142571 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e168709-cdaf-4992-a67f-a0124c221d59 service nova] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:00.142841 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e168709-cdaf-4992-a67f-a0124c221d59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:00.144729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-6e168709-cdaf-4992-a67f-a0124c221d59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:00.253086 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e168709-cdaf-4992-a67f-a0124c221d59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:20:00.255466 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e168709-cdaf-4992-a67f-a0124c221d59 service nova] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:20:00.278866 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 677/1363] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:19:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:20:02.625490 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c1b52-264c-4701-9aa8-8285851b02c6 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:02.626090 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c1b52-264c-4701-9aa8-8285851b02c6 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:02.626090 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c1b52-264c-4701-9aa8-8285851b02c6 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:02.630998 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 687/1364] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:20:02.633738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea513ed-2057-4dd6-8687-8188ab9a1567 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:02.634569 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea513ed-2057-4dd6-8687-8188ab9a1567 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:02.635113 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea513ed-2057-4dd6-8687-8188ab9a1567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:02.652837 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:02.720176 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-7ea513ed-2057-4dd6-8687-8188ab9a1567 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:20:02.721490 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-7ea513ed-2057-4dd6-8687-8188ab9a1567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:02.843668 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 678/1365] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:20:03.166264 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4292c8f-7cfd-47c6-9acb-04c38c2567ab None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:03.166542 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4292c8f-7cfd-47c6-9acb-04c38c2567ab None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:03.167063 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4292c8f-7cfd-47c6-9acb-04c38c2567ab None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:03.168590 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 688/1366] 10.222.0.77 () {54 vars in 962 bytes} [Tue Aug 23 22:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:20:03.175942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763647d8-5cae-489b-be5b-49bf45d596ca None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:03.176335 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763647d8-5cae-489b-be5b-49bf45d596ca None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:03.176575 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763647d8-5cae-489b-be5b-49bf45d596ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:03.274723 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-763647d8-5cae-489b-be5b-49bf45d596ca None None] MFA Rules not processed for user `1a0af5bf009b48a8915c7320b16d08dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:20:03.276822 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-763647d8-5cae-489b-be5b-49bf45d596ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:03.345413 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:03.496660 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 679/1367] 10.222.0.77 () {58 vars in 1059 bytes} [Tue Aug 23 22:20:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:20:03.505603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4292c8f-7cfd-47c6-9acb-04c38c2567ab None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:20:03.507402 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-d4292c8f-7cfd-47c6-9acb-04c38c2567ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:03.751131 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4292c8f-7cfd-47c6-9acb-04c38c2567ab None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:20:03.790581 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:03.922223 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67e8fa-ecca-44f7-8b9d-872ec8151423 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:20:03.922980 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67e8fa-ecca-44f7-8b9d-872ec8151423 service nova] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:03.923325 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67e8fa-ecca-44f7-8b9d-872ec8151423 service nova] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:03.923695 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67e8fa-ecca-44f7-8b9d-872ec8151423 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:03.925528 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-3a67e8fa-ecca-44f7-8b9d-872ec8151423 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:04.030571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67e8fa-ecca-44f7-8b9d-872ec8151423 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:20:04.032149 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67e8fa-ecca-44f7-8b9d-872ec8151423 service nova] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:20:04.052696 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 689/1368] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:20:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:20:04.423008 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e1f52-617e-4f91-a6c6-aca99516b21d None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:04.423720 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e1f52-617e-4f91-a6c6-aca99516b21d None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:04.423720 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e1f52-617e-4f91-a6c6-aca99516b21d None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:04.425123 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 680/1369] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:20:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:20:04.430956 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a5614-059b-49cc-89b5-1c133de83cf6 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:04.431311 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a5614-059b-49cc-89b5-1c133de83cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:04.431557 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a5614-059b-49cc-89b5-1c133de83cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:04.466459 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:04.509836 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-9e8a5614-059b-49cc-89b5-1c133de83cf6 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:20:04.511076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-9e8a5614-059b-49cc-89b5-1c133de83cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:04.623377 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 690/1370] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:20:05.224527 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3499c77-579d-461e-82e4-6ad4573e52c3 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:05.224831 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3499c77-579d-461e-82e4-6ad4573e52c3 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:05.225146 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3499c77-579d-461e-82e4-6ad4573e52c3 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:05.226519 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 681/1371] 10.222.0.77 () {54 vars in 964 bytes} [Tue Aug 23 22:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:20:05.231868 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017dcb83-29d5-4733-b76f-fc8233b00423 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:05.232376 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017dcb83-29d5-4733-b76f-fc8233b00423 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:05.232542 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017dcb83-29d5-4733-b76f-fc8233b00423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:05.317832 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-017dcb83-29d5-4733-b76f-fc8233b00423 None None] MFA Rules not processed for user `99f6180d62a2415ca4bb7ad55fe33c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:20:05.319132 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-017dcb83-29d5-4733-b76f-fc8233b00423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:05.370771 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:05.417579 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 691/1372] 10.222.0.77 () {58 vars in 1061 bytes} [Tue Aug 23 22:20:05 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:20:05.420556 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3499c77-579d-461e-82e4-6ad4573e52c3 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:20:05.423102 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-d3499c77-579d-461e-82e4-6ad4573e52c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:05.543014 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3499c77-579d-461e-82e4-6ad4573e52c3 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:20:05.590447 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:05.638232 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844a7f8-4ef9-43b4-8480-fc37526d9d3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:20:05.638858 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844a7f8-4ef9-43b4-8480-fc37526d9d3e service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:05.639264 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844a7f8-4ef9-43b4-8480-fc37526d9d3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:05.639547 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844a7f8-4ef9-43b4-8480-fc37526d9d3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:05.641442 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-b844a7f8-4ef9-43b4-8480-fc37526d9d3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:05.798448 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b844a7f8-4ef9-43b4-8480-fc37526d9d3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:20:05.799921 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b844a7f8-4ef9-43b4-8480-fc37526d9d3e service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:20:05.839330 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 682/1373] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:20:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:20:06.116582 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7073dd-83e6-41e8-bece-ec728bc0b5df None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:06.117072 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7073dd-83e6-41e8-bece-ec728bc0b5df None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:06.117356 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7073dd-83e6-41e8-bece-ec728bc0b5df None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:06.119027 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 692/1374] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:20:06.126068 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfaccb-f538-4c5a-8a5a-84eef5107b8b None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:06.126597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfaccb-f538-4c5a-8a5a-84eef5107b8b None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:06.127151 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfaccb-f538-4c5a-8a5a-84eef5107b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:06.244925 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-48cfaccb-f538-4c5a-8a5a-84eef5107b8b None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:20:06.246177 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-48cfaccb-f538-4c5a-8a5a-84eef5107b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:06.267611 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:06.349239 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 683/1375] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:20:06.654006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7073dd-83e6-41e8-bece-ec728bc0b5df None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:20:06.656039 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-ab7073dd-83e6-41e8-bece-ec728bc0b5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:06.823578 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7073dd-83e6-41e8-bece-ec728bc0b5df None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:20:06.879906 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:06.945912 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee8603-4f3d-450c-8258-b81b4ba310be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:20:06.946527 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee8603-4f3d-450c-8258-b81b4ba310be service nova] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:06.946804 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee8603-4f3d-450c-8258-b81b4ba310be service nova] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:06.947077 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee8603-4f3d-450c-8258-b81b4ba310be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:06.948680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-1cee8603-4f3d-450c-8258-b81b4ba310be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:07.042285 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee8603-4f3d-450c-8258-b81b4ba310be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:20:07.043890 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee8603-4f3d-450c-8258-b81b4ba310be service nova] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:20:07.064460 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 693/1376] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:20:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:20:09.076071 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b11a3-5b93-452c-b22f-245af6f19489 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:09.076580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b11a3-5b93-452c-b22f-245af6f19489 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:09.076580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b11a3-5b93-452c-b22f-245af6f19489 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:09.078556 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 684/1377] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:20:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:20:09.084606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e417bd-4630-4c17-8478-20dc14b8e270 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:09.085328 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e417bd-4630-4c17-8478-20dc14b8e270 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:09.085328 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e417bd-4630-4c17-8478-20dc14b8e270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:09.157842 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-42e417bd-4630-4c17-8478-20dc14b8e270 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:20:09.158978 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-42e417bd-4630-4c17-8478-20dc14b8e270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:09.166448 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:09.269231 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 694/1378] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:20:09.591299 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b11a3-5b93-452c-b22f-245af6f19489 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:20:09.593346 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-457b11a3-5b93-452c-b22f-245af6f19489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:09.790638 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b11a3-5b93-452c-b22f-245af6f19489 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:20:09.795250 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:09.922054 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc6c0f-99b1-45d7-bec0-84b98df657ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:20:09.922756 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc6c0f-99b1-45d7-bec0-84b98df657ab service nova] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:09.923041 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc6c0f-99b1-45d7-bec0-84b98df657ab service nova] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:09.923319 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc6c0f-99b1-45d7-bec0-84b98df657ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:09.924965 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-94dc6c0f-99b1-45d7-bec0-84b98df657ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:10.032334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc6c0f-99b1-45d7-bec0-84b98df657ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:20:10.033875 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc6c0f-99b1-45d7-bec0-84b98df657ab service nova] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:20:10.068601 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 685/1379] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:20:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:20:12.114080 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2daa0-b069-4397-8916-ff164ad361e4 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:12.114805 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2daa0-b069-4397-8916-ff164ad361e4 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:12.114805 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2daa0-b069-4397-8916-ff164ad361e4 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:12.116040 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 695/1380] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:20:12.121599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092266e-23d9-47e4-b1fb-70d81efd9876 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:12.122229 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092266e-23d9-47e4-b1fb-70d81efd9876 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:12.122229 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092266e-23d9-47e4-b1fb-70d81efd9876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:12.135351 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:12.200884 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-d092266e-23d9-47e4-b1fb-70d81efd9876 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:20:12.202882 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-d092266e-23d9-47e4-b1fb-70d81efd9876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:12.327748 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 686/1381] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:20:12.622292 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2daa0-b069-4397-8916-ff164ad361e4 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:20:12.624565 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-49f2daa0-b069-4397-8916-ff164ad361e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:12.813138 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:12.827280 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2daa0-b069-4397-8916-ff164ad361e4 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:20:12.982438 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52142702-4253-4539-b84c-dae6b577e5c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:20:12.983113 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52142702-4253-4539-b84c-dae6b577e5c1 service nova] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:12.983499 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52142702-4253-4539-b84c-dae6b577e5c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:12.983903 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52142702-4253-4539-b84c-dae6b577e5c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:12.985701 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-52142702-4253-4539-b84c-dae6b577e5c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:13.095021 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52142702-4253-4539-b84c-dae6b577e5c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:20:13.096704 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52142702-4253-4539-b84c-dae6b577e5c1 service nova] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:20:13.109249 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:13.118662 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 696/1382] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:20:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:20:15.206949 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cc57a-2a72-405f-8593-19a05e5fd758 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:15.207964 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cc57a-2a72-405f-8593-19a05e5fd758 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:15.207964 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cc57a-2a72-405f-8593-19a05e5fd758 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:15.208987 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 687/1383] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:20:15.214730 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ccd689-3073-4806-b407-0163d731649a None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:15.215596 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ccd689-3073-4806-b407-0163d731649a None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:15.215934 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ccd689-3073-4806-b407-0163d731649a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:15.298262 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-d3ccd689-3073-4806-b407-0163d731649a None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:20:15.299922 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-d3ccd689-3073-4806-b407-0163d731649a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:15.419844 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 697/1384] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:20:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:20:15.710708 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1cc57a-2a72-405f-8593-19a05e5fd758 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:20:15.712274 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-fa1cc57a-2a72-405f-8593-19a05e5fd758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:15.821870 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:15.908496 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1cc57a-2a72-405f-8593-19a05e5fd758 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:20:16.048134 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3ff3d-884e-40b9-b03f-b1b9eb651305 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:20:16.048731 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3ff3d-884e-40b9-b03f-b1b9eb651305 service nova] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:16.049033 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3ff3d-884e-40b9-b03f-b1b9eb651305 service nova] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:16.049327 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3ff3d-884e-40b9-b03f-b1b9eb651305 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:16.051156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-ddd3ff3d-884e-40b9-b03f-b1b9eb651305 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:16.119232 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:16.183192 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3ff3d-884e-40b9-b03f-b1b9eb651305 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:20:16.185283 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3ff3d-884e-40b9-b03f-b1b9eb651305 service nova] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:20:16.209215 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 688/1385] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:20:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:20:18.437577 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2ac94-b1e8-4b19-ba21-25e27587a438 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:18.438162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2ac94-b1e8-4b19-ba21-25e27587a438 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:18.438573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2ac94-b1e8-4b19-ba21-25e27587a438 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:18.441141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 698/1386] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:20:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:20:18.447441 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe60b4-eee1-493b-b495-e177f58babfc None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:18.447947 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe60b4-eee1-493b-b495-e177f58babfc None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:18.448045 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe60b4-eee1-493b-b495-e177f58babfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:18.536680 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-66fe60b4-eee1-493b-b495-e177f58babfc None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:20:18.538042 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-66fe60b4-eee1-493b-b495-e177f58babfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:18.662471 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 689/1387] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:20:18.963351 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2ac94-b1e8-4b19-ba21-25e27587a438 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:20:18.965210 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-27c2ac94-b1e8-4b19-ba21-25e27587a438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:19.064256 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:19.146930 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2ac94-b1e8-4b19-ba21-25e27587a438 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:20:19.299188 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738bd60-82d9-4f0b-b761-8f944ace2e2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:20:19.300251 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738bd60-82d9-4f0b-b761-8f944ace2e2a service nova] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:19.300753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738bd60-82d9-4f0b-b761-8f944ace2e2a service nova] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:19.301248 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738bd60-82d9-4f0b-b761-8f944ace2e2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:19.304299 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-d738bd60-82d9-4f0b-b761-8f944ace2e2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:19.356699 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:19.417802 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d738bd60-82d9-4f0b-b761-8f944ace2e2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:20:19.419524 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d738bd60-82d9-4f0b-b761-8f944ace2e2a service nova] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:20:19.445863 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 699/1388] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:20:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:20:21.315509 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b85629-0e5a-47b2-879f-8679d798c4cc None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:21.316129 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b85629-0e5a-47b2-879f-8679d798c4cc None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:21.316129 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b85629-0e5a-47b2-879f-8679d798c4cc None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:21.317603 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 690/1389] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:20:21.323314 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a7b9d-4eab-4182-a3a4-ee48f7cc15e7 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:21.323866 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a7b9d-4eab-4182-a3a4-ee48f7cc15e7 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:21.323866 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a7b9d-4eab-4182-a3a4-ee48f7cc15e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:21.400253 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-0c0a7b9d-4eab-4182-a3a4-ee48f7cc15e7 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:20:21.401540 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-0c0a7b9d-4eab-4182-a3a4-ee48f7cc15e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:21.511124 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 700/1390] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:20:21.519084 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a1522-29d7-46b1-887e-3a117355ac1d None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:21.519371 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a1522-29d7-46b1-887e-3a117355ac1d None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:21.519651 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a1522-29d7-46b1-887e-3a117355ac1d None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:21.521018 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 691/1391] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:20:21.526700 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ae74c-0b34-490d-9685-5c8ab5a13f9f None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:21.527071 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ae74c-0b34-490d-9685-5c8ab5a13f9f None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:21.527495 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ae74c-0b34-490d-9685-5c8ab5a13f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:21.544758 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:21.602087 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-502ae74c-0b34-490d-9685-5c8ab5a13f9f None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:20:21.603251 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-502ae74c-0b34-490d-9685-5c8ab5a13f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:21.708675 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 701/1392] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:20:21.816676 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37cfe24-d26f-46fd-b415-725b6283ea2e None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:21.816959 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37cfe24-d26f-46fd-b415-725b6283ea2e None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:21.817236 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37cfe24-d26f-46fd-b415-725b6283ea2e None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:21.818793 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 692/1393] 10.222.0.77 () {54 vars in 967 bytes} [Tue Aug 23 22:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:20:21.823846 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e49f7-7d0d-49b8-b36b-d6c5ef7530ae None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:21.824128 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e49f7-7d0d-49b8-b36b-d6c5ef7530ae None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:21.824406 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e49f7-7d0d-49b8-b36b-d6c5ef7530ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:21.908694 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-ea9e49f7-7d0d-49b8-b36b-d6c5ef7530ae None None] MFA Rules not processed for user `855cbc7a992d4c6697632d2d4d74abfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:20:21.910103 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-ea9e49f7-7d0d-49b8-b36b-d6c5ef7530ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:21.946970 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:21.997039 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 702/1394] 10.222.0.77 () {58 vars in 1064 bytes} [Tue Aug 23 22:20:21 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:20:22.005042 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37cfe24-d26f-46fd-b415-725b6283ea2e None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:20:22.005819 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e49f7-7d0d-49b8-b36b-d6c5ef7530ae None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:20:22.006968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-b37cfe24-d26f-46fd-b415-725b6283ea2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:22.015057 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e49f7-7d0d-49b8-b36b-d6c5ef7530ae None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:20:22.042324 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:22.098559 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1b55d-bcba-4186-8d12-15b4f7d849fb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '855cbc7a992d4c6697632d2d4d74abfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:20:22.099184 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1b55d-bcba-4186-8d12-15b4f7d849fb service glance] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:22.099473 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1b55d-bcba-4186-8d12-15b4f7d849fb service glance] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:22.099746 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1b55d-bcba-4186-8d12-15b4f7d849fb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:22.101484 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-b7d1b55d-bcba-4186-8d12-15b4f7d849fb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:22.196540 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37cfe24-d26f-46fd-b415-725b6283ea2e None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:20:22.223358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:22.228100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1b55d-bcba-4186-8d12-15b4f7d849fb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:20:22.229635 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1b55d-bcba-4186-8d12-15b4f7d849fb service glance] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:20:22.251417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 703/1395] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:20:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:20:22.312542 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:22.326233 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bab60-341d-4566-9410-01216d2fabc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:20:22.327077 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bab60-341d-4566-9410-01216d2fabc8 service nova] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:22.327247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bab60-341d-4566-9410-01216d2fabc8 service nova] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:22.327411 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bab60-341d-4566-9410-01216d2fabc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:22.329236 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-149bab60-341d-4566-9410-01216d2fabc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:22.433609 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149bab60-341d-4566-9410-01216d2fabc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:20:22.435205 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149bab60-341d-4566-9410-01216d2fabc8 service nova] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:20:22.456061 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 693/1396] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:20:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:20:23.054111 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af41902-616b-4dc6-adc2-214ad116a87b None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:23.054953 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af41902-616b-4dc6-adc2-214ad116a87b None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:23.054953 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af41902-616b-4dc6-adc2-214ad116a87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:23.127788 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-2af41902-616b-4dc6-adc2-214ad116a87b None None] MFA Rules not processed for user `02e415eb75984daa97ee79fc0146f318`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:20:23.129099 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-2af41902-616b-4dc6-adc2-214ad116a87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:23.236999 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 704/1397] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Aug 23 22:20:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:20:23.284015 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9006c-d9d5-4ad8-8332-d1e31a24c7f0 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:23.284310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9006c-d9d5-4ad8-8332-d1e31a24c7f0 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:23.284587 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9006c-d9d5-4ad8-8332-d1e31a24c7f0 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:23.286051 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 694/1398] 10.222.0.77 () {54 vars in 943 bytes} [Tue Aug 23 22:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:20:23.293349 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e551bd4-c47c-41d5-8bf1-4803c14d0fb0 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:23.293664 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e551bd4-c47c-41d5-8bf1-4803c14d0fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:23.294007 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e551bd4-c47c-41d5-8bf1-4803c14d0fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:23.382651 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-0e551bd4-c47c-41d5-8bf1-4803c14d0fb0 None None] MFA Rules not processed for user `abda1f23a18c4c808483cd6b53952975`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:20:23.383945 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-0e551bd4-c47c-41d5-8bf1-4803c14d0fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:23.407086 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:23.511918 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 705/1399] 10.222.0.77 () {58 vars in 1040 bytes} [Tue Aug 23 22:20:23 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:20:23.521413 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9006c-d9d5-4ad8-8332-d1e31a24c7f0 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:20:23.522970 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-8bb9006c-d9d5-4ad8-8332-d1e31a24c7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:23.647739 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:23.677619 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9006c-d9d5-4ad8-8332-d1e31a24c7f0 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:20:23.793446 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1208f1-f961-4243-b586-d490ec3cf8cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abda1f23a18c4c808483cd6b53952975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:20:23.794075 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1208f1-f961-4243-b586-d490ec3cf8cc service swift] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:23.794359 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1208f1-f961-4243-b586-d490ec3cf8cc service swift] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:23.794630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1208f1-f961-4243-b586-d490ec3cf8cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:23.796926 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-2a1208f1-f961-4243-b586-d490ec3cf8cc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:23.887488 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1208f1-f961-4243-b586-d490ec3cf8cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:20:23.889602 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1208f1-f961-4243-b586-d490ec3cf8cc service swift] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:20:23.898502 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 695/1400] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Aug 23 22:20:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 22:20:24.483410 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c4cbc-c85b-4ab0-9ed7-cf5bc6fd0ae2 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:24.484283 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c4cbc-c85b-4ab0-9ed7-cf5bc6fd0ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:24.484283 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c4cbc-c85b-4ab0-9ed7-cf5bc6fd0ae2 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:24.485926 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 706/1401] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:20:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:20:24.491937 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189362d-c8e3-438f-9a92-cd846d3e9a4d None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:24.492231 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189362d-c8e3-438f-9a92-cd846d3e9a4d None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:24.492507 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189362d-c8e3-438f-9a92-cd846d3e9a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:24.508547 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:24.572492 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-6189362d-c8e3-438f-9a92-cd846d3e9a4d None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:20:24.573896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-6189362d-c8e3-438f-9a92-cd846d3e9a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:24.694919 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 696/1402] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:20:24.998057 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c4cbc-c85b-4ab0-9ed7-cf5bc6fd0ae2 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:20:25.001217 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-870c4cbc-c85b-4ab0-9ed7-cf5bc6fd0ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:25.232117 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:25.247066 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c4cbc-c85b-4ab0-9ed7-cf5bc6fd0ae2 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:20:25.381794 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e5979-056a-488b-ad24-d8f6c0307bbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:20:25.381794 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e5979-056a-488b-ad24-d8f6c0307bbd service nova] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:25.381794 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e5979-056a-488b-ad24-d8f6c0307bbd service nova] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:25.381794 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e5979-056a-488b-ad24-d8f6c0307bbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:25.383024 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-ef3e5979-056a-488b-ad24-d8f6c0307bbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:25.506350 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e5979-056a-488b-ad24-d8f6c0307bbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:20:25.508832 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e5979-056a-488b-ad24-d8f6c0307bbd service nova] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:20:25.519775 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:25.532790 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 707/1403] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:20:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:20:27.576001 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726f20e-3f18-44ab-a3a4-45865810bab2 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:27.576583 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726f20e-3f18-44ab-a3a4-45865810bab2 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:27.576583 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726f20e-3f18-44ab-a3a4-45865810bab2 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:27.578616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 697/1404] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:20:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:20:27.584046 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff4b98-2553-45d6-8340-f45cd2fc46ba None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:27.584788 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff4b98-2553-45d6-8340-f45cd2fc46ba None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:27.584788 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff4b98-2553-45d6-8340-f45cd2fc46ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:27.660838 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-49ff4b98-2553-45d6-8340-f45cd2fc46ba None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:20:27.662143 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-49ff4b98-2553-45d6-8340-f45cd2fc46ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:27.780730 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 708/1405] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:20:28.080902 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726f20e-3f18-44ab-a3a4-45865810bab2 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:20:28.082476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-4726f20e-3f18-44ab-a3a4-45865810bab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:28.205335 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:28.277235 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726f20e-3f18-44ab-a3a4-45865810bab2 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:20:28.413121 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b148d1-d521-4120-bb6a-c506089d44d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:20:28.413688 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b148d1-d521-4120-bb6a-c506089d44d6 service nova] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:28.413965 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b148d1-d521-4120-bb6a-c506089d44d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:28.414240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b148d1-d521-4120-bb6a-c506089d44d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:28.415870 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-f0b148d1-d521-4120-bb6a-c506089d44d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:28.485467 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:28.533726 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b148d1-d521-4120-bb6a-c506089d44d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:20:28.535507 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b148d1-d521-4120-bb6a-c506089d44d6 service nova] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:20:28.557589 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 698/1406] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:20:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:20:30.618086 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1af7ba-c05e-44a5-9aa1-96a9d5ace296 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:30.618707 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1af7ba-c05e-44a5-9aa1-96a9d5ace296 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:30.618707 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1af7ba-c05e-44a5-9aa1-96a9d5ace296 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:30.619966 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 709/1407] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:20:30.625795 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badb6ea-3638-4961-9afe-036cb3b5f57e None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:30.626313 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badb6ea-3638-4961-9afe-036cb3b5f57e None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:30.626510 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badb6ea-3638-4961-9afe-036cb3b5f57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:30.714514 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-4badb6ea-3638-4961-9afe-036cb3b5f57e None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:20:30.715757 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-4badb6ea-3638-4961-9afe-036cb3b5f57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:30.853629 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 699/1408] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:20:31.159027 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1af7ba-c05e-44a5-9aa1-96a9d5ace296 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:20:31.160554 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-ad1af7ba-c05e-44a5-9aa1-96a9d5ace296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:31.259862 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:31.342074 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1af7ba-c05e-44a5-9aa1-96a9d5ace296 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:20:31.484413 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db06bee-18d8-4637-9cc6-0bb4fe13e639 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:20:31.485045 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db06bee-18d8-4637-9cc6-0bb4fe13e639 service nova] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:31.485325 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db06bee-18d8-4637-9cc6-0bb4fe13e639 service nova] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:31.485633 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db06bee-18d8-4637-9cc6-0bb4fe13e639 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:31.487400 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-7db06bee-18d8-4637-9cc6-0bb4fe13e639 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:31.533252 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:31.610221 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db06bee-18d8-4637-9cc6-0bb4fe13e639 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:20:31.612024 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db06bee-18d8-4637-9cc6-0bb4fe13e639 service nova] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:20:31.643185 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 710/1409] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:20:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:20:40.851905 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=87 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:41.635302 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=30 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:47.168302 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e67c93-ab95-4fb9-a495-99af531ef773 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:47.168893 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e67c93-ab95-4fb9-a495-99af531ef773 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:47.168893 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e67c93-ab95-4fb9-a495-99af531ef773 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:47.170673 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 700/1410] 10.222.0.77 () {54 vars in 918 bytes} [Tue Aug 23 22:20:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:20:47.178764 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264b67c-b17c-4a85-9a7c-c6e66ec4d482 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:47.179312 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264b67c-b17c-4a85-9a7c-c6e66ec4d482 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:47.179428 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264b67c-b17c-4a85-9a7c-c6e66ec4d482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:47.268250 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-8264b67c-b17c-4a85-9a7c-c6e66ec4d482 None None] MFA Rules not processed for user `2000b80e34ae45d2a8b658cd394419f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:20:47.269567 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-8264b67c-b17c-4a85-9a7c-c6e66ec4d482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:47.384517 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 711/1411] 10.222.0.77 () {58 vars in 1015 bytes} [Tue Aug 23 22:20:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:20:47.400186 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb32c9f-da46-4b6d-9db6-e9ad6f43c110 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:47.400552 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb32c9f-da46-4b6d-9db6-e9ad6f43c110 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:47.400831 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb32c9f-da46-4b6d-9db6-e9ad6f43c110 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:47.402295 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 701/1412] 10.222.0.77 () {54 vars in 918 bytes} [Tue Aug 23 22:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:20:47.409189 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1077db-73d8-4fa5-9283-33a389ef90a6 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:47.409628 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1077db-73d8-4fa5-9283-33a389ef90a6 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:47.409784 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1077db-73d8-4fa5-9283-33a389ef90a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:47.484812 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:47.488268 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-7b1077db-73d8-4fa5-9283-33a389ef90a6 None None] MFA Rules not processed for user `1a0af5bf009b48a8915c7320b16d08dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:20:47.489918 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-7b1077db-73d8-4fa5-9283-33a389ef90a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:47.610818 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 712/1413] 10.222.0.77 () {58 vars in 1015 bytes} [Tue Aug 23 22:20:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:20:50.257747 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34dc94c-5615-413d-9d1c-cf11191e9dc1 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:50.258318 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34dc94c-5615-413d-9d1c-cf11191e9dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:50.258318 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34dc94c-5615-413d-9d1c-cf11191e9dc1 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:50.259805 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:20:50.265886 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22c9e4-5d80-409e-b44e-e248661f6927 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:50.266654 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22c9e4-5d80-409e-b44e-e248661f6927 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:50.266654 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22c9e4-5d80-409e-b44e-e248661f6927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:50.339139 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-cc22c9e4-5d80-409e-b44e-e248661f6927 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:20:50.340376 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-cc22c9e4-5d80-409e-b44e-e248661f6927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:50.399965 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:50.447447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:20:50.745495 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34dc94c-5615-413d-9d1c-cf11191e9dc1 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:20:50.747127 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-d34dc94c-5615-413d-9d1c-cf11191e9dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:50.912254 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34dc94c-5615-413d-9d1c-cf11191e9dc1 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:20:50.994485 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:51.040093 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca51aaf-267d-4f63-94ef-0ddea60e8767 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:20:51.040701 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca51aaf-267d-4f63-94ef-0ddea60e8767 service nova] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:51.040978 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca51aaf-267d-4f63-94ef-0ddea60e8767 service nova] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:51.041253 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca51aaf-267d-4f63-94ef-0ddea60e8767 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:51.042902 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-bca51aaf-267d-4f63-94ef-0ddea60e8767 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:51.166924 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca51aaf-267d-4f63-94ef-0ddea60e8767 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:20:51.168528 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca51aaf-267d-4f63-94ef-0ddea60e8767 service nova] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:20:51.189291 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 703/1416] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:20:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:20:52.100866 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4802e5-69ad-431f-bd12-d3bf9be7ca94 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:52.101459 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4802e5-69ad-431f-bd12-d3bf9be7ca94 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:52.101459 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4802e5-69ad-431f-bd12-d3bf9be7ca94 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:52.102681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:20:52.107921 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff49d2f-48c6-4828-b5cf-294ac3c5657c None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:52.108426 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff49d2f-48c6-4828-b5cf-294ac3c5657c None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:52.108539 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff49d2f-48c6-4828-b5cf-294ac3c5657c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:52.191256 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-cff49d2f-48c6-4828-b5cf-294ac3c5657c None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:20:52.192490 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-cff49d2f-48c6-4828-b5cf-294ac3c5657c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:52.221682 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:52.295595 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:20:52.454350 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4802e5-69ad-431f-bd12-d3bf9be7ca94 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:20:52.455909 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-6e4802e5-69ad-431f-bd12-d3bf9be7ca94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:52.611806 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4802e5-69ad-431f-bd12-d3bf9be7ca94 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:20:52.652444 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:52.728613 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d60c4f-695d-4521-a6fb-6c8ea487d68f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:20:52.729224 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d60c4f-695d-4521-a6fb-6c8ea487d68f service nova] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:52.729538 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d60c4f-695d-4521-a6fb-6c8ea487d68f service nova] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:52.729815 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d60c4f-695d-4521-a6fb-6c8ea487d68f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:52.731442 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-59d60c4f-695d-4521-a6fb-6c8ea487d68f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:52.828106 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d60c4f-695d-4521-a6fb-6c8ea487d68f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:20:52.829747 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d60c4f-695d-4521-a6fb-6c8ea487d68f service nova] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:20:52.847831 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 715/1419] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:20:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:20:53.741660 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8e819-f3f2-4c34-bd09-44659fdc26a4 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:53.742159 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8e819-f3f2-4c34-bd09-44659fdc26a4 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:53.742268 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8e819-f3f2-4c34-bd09-44659fdc26a4 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:53.743578 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:20:53.748849 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c806e0-5721-40b3-897d-12402c30ce4a None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:53.749323 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c806e0-5721-40b3-897d-12402c30ce4a None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:53.749556 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c806e0-5721-40b3-897d-12402c30ce4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:53.807736 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:53.829848 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-66c806e0-5721-40b3-897d-12402c30ce4a None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:20:53.831079 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-66c806e0-5721-40b3-897d-12402c30ce4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:53.931117 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:20:54.083160 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8e819-f3f2-4c34-bd09-44659fdc26a4 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:20:54.084614 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-27d8e819-f3f2-4c34-bd09-44659fdc26a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:54.233316 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8e819-f3f2-4c34-bd09-44659fdc26a4 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:20:54.245493 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:54.350897 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e564e8-51b7-4cbb-a7d3-0abb92337d55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:20:54.351428 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e564e8-51b7-4cbb-a7d3-0abb92337d55 service nova] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:54.351720 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e564e8-51b7-4cbb-a7d3-0abb92337d55 service nova] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:54.351996 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e564e8-51b7-4cbb-a7d3-0abb92337d55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:54.353653 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-f6e564e8-51b7-4cbb-a7d3-0abb92337d55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:54.446795 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e564e8-51b7-4cbb-a7d3-0abb92337d55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:20:54.448400 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e564e8-51b7-4cbb-a7d3-0abb92337d55 service nova] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:20:54.467099 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 706/1422] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:20:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:20:55.368503 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2d413-c5c2-4e6b-bf28-ca1d4d31bd65 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:55.369085 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2d413-c5c2-4e6b-bf28-ca1d4d31bd65 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:55.369446 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2d413-c5c2-4e6b-bf28-ca1d4d31bd65 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:55.371941 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:20:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:20:55.378399 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c3583-d721-4bb8-96f8-809048db47ef None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:55.378918 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c3583-d721-4bb8-96f8-809048db47ef None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:55.378918 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c3583-d721-4bb8-96f8-809048db47ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:55.399368 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:55.462327 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-1d1c3583-d721-4bb8-96f8-809048db47ef None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:20:55.463568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-1d1c3583-d721-4bb8-96f8-809048db47ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:55.567567 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:20:55.726062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2d413-c5c2-4e6b-bf28-ca1d4d31bd65 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:20:55.727623 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-8cb2d413-c5c2-4e6b-bf28-ca1d4d31bd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:55.850026 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:55.886877 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2d413-c5c2-4e6b-bf28-ca1d4d31bd65 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:20:56.003139 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e92345-bab3-452b-8e01-ba93a06e0cdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:20:56.003665 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e92345-bab3-452b-8e01-ba93a06e0cdd service nova] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:56.003945 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e92345-bab3-452b-8e01-ba93a06e0cdd service nova] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:56.004218 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e92345-bab3-452b-8e01-ba93a06e0cdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:56.005874 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-30e92345-bab3-452b-8e01-ba93a06e0cdd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:56.088889 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:56.103820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e92345-bab3-452b-8e01-ba93a06e0cdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:20:56.105494 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e92345-bab3-452b-8e01-ba93a06e0cdd service nova] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:20:56.124333 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 718/1425] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:20:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:20:56.994579 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c4090-831c-47c5-998d-1e9861bbe579 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:56.995142 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c4090-831c-47c5-998d-1e9861bbe579 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:56.995142 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c4090-831c-47c5-998d-1e9861bbe579 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:56.996393 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:20:57.001452 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e191345-0c81-41f1-8c5c-a6d9f608415b None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:57.001907 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e191345-0c81-41f1-8c5c-a6d9f608415b None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:57.002018 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e191345-0c81-41f1-8c5c-a6d9f608415b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:57.079828 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-0e191345-0c81-41f1-8c5c-a6d9f608415b None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:20:57.081054 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-0e191345-0c81-41f1-8c5c-a6d9f608415b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:57.182792 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:20:57.343384 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c4090-831c-47c5-998d-1e9861bbe579 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:20:57.344837 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-6f7c4090-831c-47c5-998d-1e9861bbe579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:57.432397 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:57.496049 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c4090-831c-47c5-998d-1e9861bbe579 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:20:57.612715 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6220c6-9376-4e43-b99d-b4bb4432df7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:20:57.613299 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6220c6-9376-4e43-b99d-b4bb4432df7d service nova] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:57.613638 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6220c6-9376-4e43-b99d-b4bb4432df7d service nova] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:57.613926 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6220c6-9376-4e43-b99d-b4bb4432df7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:57.615595 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-5b6220c6-9376-4e43-b99d-b4bb4432df7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:57.664997 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:57.706628 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6220c6-9376-4e43-b99d-b4bb4432df7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:20:57.708225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6220c6-9376-4e43-b99d-b4bb4432df7d service nova] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:20:57.726707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 709/1428] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:20:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:20:58.542629 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968855d-cf81-4be3-beaa-8ccfe967b9f5 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:58.543220 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968855d-cf81-4be3-beaa-8ccfe967b9f5 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:58.543220 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968855d-cf81-4be3-beaa-8ccfe967b9f5 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:58.544546 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:20:58.550153 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb37f5-ea1a-4314-a4c6-2a51f44c1895 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:58.550625 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb37f5-ea1a-4314-a4c6-2a51f44c1895 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:58.550729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb37f5-ea1a-4314-a4c6-2a51f44c1895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:58.634791 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-ebeb37f5-ea1a-4314-a4c6-2a51f44c1895 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:20:58.636020 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-ebeb37f5-ea1a-4314-a4c6-2a51f44c1895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:58.734902 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:20:58.890279 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968855d-cf81-4be3-beaa-8ccfe967b9f5 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:20:58.891771 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-c968855d-cf81-4be3-beaa-8ccfe967b9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:58.942929 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:59.042772 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968855d-cf81-4be3-beaa-8ccfe967b9f5 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:20:59.156436 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9529c-ad9b-4e17-b767-aa3ce812a2c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:20:59.156953 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9529c-ad9b-4e17-b767-aa3ce812a2c4 service nova] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:59.157225 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9529c-ad9b-4e17-b767-aa3ce812a2c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:59.157519 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9529c-ad9b-4e17-b767-aa3ce812a2c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:59.159120 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-8fd9529c-ad9b-4e17-b767-aa3ce812a2c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:59.166058 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:59.251778 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd9529c-ad9b-4e17-b767-aa3ce812a2c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:20:59.253442 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd9529c-ad9b-4e17-b767-aa3ce812a2c4 service nova] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:20:59.273608 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 721/1431] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:20:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:21:00.103424 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7b5fb-9062-4fe0-84ab-4c99c1b7a6c0 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:00.104050 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7b5fb-9062-4fe0-84ab-4c99c1b7a6c0 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:00.104050 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7b5fb-9062-4fe0-84ab-4c99c1b7a6c0 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:00.105283 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:21:00.110954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f724cc4-d3ad-4593-b67e-b6a3b4df1919 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:00.111439 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f724cc4-d3ad-4593-b67e-b6a3b4df1919 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:00.111554 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f724cc4-d3ad-4593-b67e-b6a3b4df1919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:00.189770 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-8f724cc4-d3ad-4593-b67e-b6a3b4df1919 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:21:00.191014 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-8f724cc4-d3ad-4593-b67e-b6a3b4df1919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:00.262343 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:00.296505 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:21:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:21:00.448890 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7b5fb-9062-4fe0-84ab-4c99c1b7a6c0 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:21:00.450520 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-91d7b5fb-9062-4fe0-84ab-4c99c1b7a6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:00.469487 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:00.603135 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7b5fb-9062-4fe0-84ab-4c99c1b7a6c0 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:21:00.690867 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:00.718215 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32817bd-b261-43aa-92b8-c3228814df04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:21:00.718734 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32817bd-b261-43aa-92b8-c3228814df04 service nova] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:00.719012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32817bd-b261-43aa-92b8-c3228814df04 service nova] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:00.719281 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32817bd-b261-43aa-92b8-c3228814df04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:00.720892 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-d32817bd-b261-43aa-92b8-c3228814df04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:00.814777 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32817bd-b261-43aa-92b8-c3228814df04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:21:00.816384 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32817bd-b261-43aa-92b8-c3228814df04 service nova] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:21:00.840551 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 712/1434] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:21:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:21:01.657639 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d816e53-6d20-4c46-ab37-1a5a830fbd89 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:01.658205 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d816e53-6d20-4c46-ab37-1a5a830fbd89 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:01.658205 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d816e53-6d20-4c46-ab37-1a5a830fbd89 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:01.659544 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:21:01.664736 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e528d-1c12-42f8-97db-82fe54274058 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:01.665158 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e528d-1c12-42f8-97db-82fe54274058 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:01.665296 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e528d-1c12-42f8-97db-82fe54274058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:01.745218 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-602e528d-1c12-42f8-97db-82fe54274058 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:21:01.746515 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-602e528d-1c12-42f8-97db-82fe54274058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:01.789346 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:01.845971 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:21:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:21:01.997452 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d816e53-6d20-4c46-ab37-1a5a830fbd89 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:21:01.999246 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-5d816e53-6d20-4c46-ab37-1a5a830fbd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:02.157576 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d816e53-6d20-4c46-ab37-1a5a830fbd89 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:21:02.212528 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:02.273360 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64175c50-d93c-4e55-87fd-914d1e821b5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:21:02.273912 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64175c50-d93c-4e55-87fd-914d1e821b5f service nova] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:02.274220 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64175c50-d93c-4e55-87fd-914d1e821b5f service nova] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:02.274459 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64175c50-d93c-4e55-87fd-914d1e821b5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:02.276069 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-64175c50-d93c-4e55-87fd-914d1e821b5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:02.367688 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64175c50-d93c-4e55-87fd-914d1e821b5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:21:02.369309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64175c50-d93c-4e55-87fd-914d1e821b5f service nova] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:21:02.388146 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 724/1437] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:21:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:21:03.207259 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8912c-dc09-4651-ac15-b948f95dcf29 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:03.207856 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8912c-dc09-4651-ac15-b948f95dcf29 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:03.207856 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8912c-dc09-4651-ac15-b948f95dcf29 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:03.209147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:21:03.214280 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b2bdd-3fe7-4f25-82ce-810a17959fbd None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:03.215077 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b2bdd-3fe7-4f25-82ce-810a17959fbd None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:03.215519 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b2bdd-3fe7-4f25-82ce-810a17959fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:03.293753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-061b2bdd-3fe7-4f25-82ce-810a17959fbd None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:21:03.295124 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-061b2bdd-3fe7-4f25-82ce-810a17959fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:03.297194 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:03.402139 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:21:03.550944 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8912c-dc09-4651-ac15-b948f95dcf29 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:21:03.552380 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-b5d8912c-dc09-4651-ac15-b948f95dcf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:03.716386 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8912c-dc09-4651-ac15-b948f95dcf29 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:21:03.745765 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:03.841124 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799233f-fb6d-4b8d-8884-a1a133ebbe59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:21:03.841795 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799233f-fb6d-4b8d-8884-a1a133ebbe59 service nova] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:03.842085 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799233f-fb6d-4b8d-8884-a1a133ebbe59 service nova] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:03.842360 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799233f-fb6d-4b8d-8884-a1a133ebbe59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:03.843981 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-8799233f-fb6d-4b8d-8884-a1a133ebbe59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:03.934706 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799233f-fb6d-4b8d-8884-a1a133ebbe59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:21:03.937305 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799233f-fb6d-4b8d-8884-a1a133ebbe59 service nova] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:21:03.955945 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 715/1440] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:21:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:21:05.801091 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beba428-2457-460a-b458-ffb05e824cae None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:05.801679 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beba428-2457-460a-b458-ffb05e824cae None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:05.801679 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beba428-2457-460a-b458-ffb05e824cae None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:05.803408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:21:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:21:05.809671 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa917f-d772-4766-af95-1c0df92ee78f None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:05.811036 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa917f-d772-4766-af95-1c0df92ee78f None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:05.811036 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa917f-d772-4766-af95-1c0df92ee78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:05.852241 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:05.879142 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-27fa917f-d772-4766-af95-1c0df92ee78f None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:21:05.880355 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-27fa917f-d772-4766-af95-1c0df92ee78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:05.978670 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:21:06.271648 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beba428-2457-460a-b458-ffb05e824cae None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:21:06.273221 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-3beba428-2457-460a-b458-ffb05e824cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:06.376951 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beba428-2457-460a-b458-ffb05e824cae None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:21:06.410185 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:06.454082 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962bef07-4613-404a-8ada-fdff90946f6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:21:06.454688 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bef07-4613-404a-8ada-fdff90946f6f service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:06.454969 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bef07-4613-404a-8ada-fdff90946f6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:06.455240 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bef07-4613-404a-8ada-fdff90946f6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:06.456864 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-962bef07-4613-404a-8ada-fdff90946f6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:06.567981 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962bef07-4613-404a-8ada-fdff90946f6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:21:06.569464 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962bef07-4613-404a-8ada-fdff90946f6f service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:21:06.588034 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 727/1443] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:21:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:21:08.681385 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e5221-df19-4e08-85ff-aece7bd39b5d None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:08.681960 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e5221-df19-4e08-85ff-aece7bd39b5d None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:08.681960 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e5221-df19-4e08-85ff-aece7bd39b5d None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:08.683312 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:21:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:21:08.688775 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b70b6-48c3-4d8d-a80e-48361a226cdb None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:08.689236 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b70b6-48c3-4d8d-a80e-48361a226cdb None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:08.689341 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b70b6-48c3-4d8d-a80e-48361a226cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:08.761382 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-958b70b6-48c3-4d8d-a80e-48361a226cdb None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:21:08.762648 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-958b70b6-48c3-4d8d-a80e-48361a226cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:08.776372 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:08.866066 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:21:09.149136 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e5221-df19-4e08-85ff-aece7bd39b5d None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:21:09.151000 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-318e5221-df19-4e08-85ff-aece7bd39b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:09.256971 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e5221-df19-4e08-85ff-aece7bd39b5d None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:21:09.270912 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:09.335094 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a20cb-8503-4645-b19e-fc15c39f6a1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:21:09.335702 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a20cb-8503-4645-b19e-fc15c39f6a1d service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:09.335983 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a20cb-8503-4645-b19e-fc15c39f6a1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:09.336262 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a20cb-8503-4645-b19e-fc15c39f6a1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:09.337976 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-316a20cb-8503-4645-b19e-fc15c39f6a1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:09.454017 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a20cb-8503-4645-b19e-fc15c39f6a1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:21:09.455474 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a20cb-8503-4645-b19e-fc15c39f6a1d service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:21:09.474772 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 718/1446] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:21:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:21:11.776250 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6d2b9-9fe2-42b1-88c1-860bf9520aa2 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:11.776804 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6d2b9-9fe2-42b1-88c1-860bf9520aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:11.776804 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6d2b9-9fe2-42b1-88c1-860bf9520aa2 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:11.778176 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:21:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:21:11.783808 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5aa8d7-6c51-423d-9657-293f3b2362dd None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:11.784275 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5aa8d7-6c51-423d-9657-293f3b2362dd None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:11.784390 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5aa8d7-6c51-423d-9657-293f3b2362dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:11.834605 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:11.852472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-5e5aa8d7-6c51-423d-9657-293f3b2362dd None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:21:11.853713 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-5e5aa8d7-6c51-423d-9657-293f3b2362dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:11.950419 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:21:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:21:12.239148 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6d2b9-9fe2-42b1-88c1-860bf9520aa2 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:21:12.240725 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-69d6d2b9-9fe2-42b1-88c1-860bf9520aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:12.344816 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6d2b9-9fe2-42b1-88c1-860bf9520aa2 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:21:12.384337 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:12.421075 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c1ea3-6ba1-4da7-a546-c5b697699b1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:21:12.421706 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c1ea3-6ba1-4da7-a546-c5b697699b1d service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:12.421987 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c1ea3-6ba1-4da7-a546-c5b697699b1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:12.422263 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c1ea3-6ba1-4da7-a546-c5b697699b1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:12.423883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-a99c1ea3-6ba1-4da7-a546-c5b697699b1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:12.534851 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c1ea3-6ba1-4da7-a546-c5b697699b1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:21:12.536216 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c1ea3-6ba1-4da7-a546-c5b697699b1d service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:21:12.555831 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 730/1449] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:21:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:21:14.602492 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b262aa-3ea2-467a-8aac-18d5092fd678 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:14.603067 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b262aa-3ea2-467a-8aac-18d5092fd678 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:14.603067 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b262aa-3ea2-467a-8aac-18d5092fd678 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:14.604377 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:21:14.610703 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1d049-1563-4868-8ba3-199d28e2887d None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:14.611184 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1d049-1563-4868-8ba3-199d28e2887d None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:14.611290 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1d049-1563-4868-8ba3-199d28e2887d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:14.679491 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-5ed1d049-1563-4868-8ba3-199d28e2887d None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:21:14.680967 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-5ed1d049-1563-4868-8ba3-199d28e2887d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:14.702080 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:14.782774 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:21:15.065170 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b262aa-3ea2-467a-8aac-18d5092fd678 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:21:15.066757 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-42b262aa-3ea2-467a-8aac-18d5092fd678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:15.173407 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b262aa-3ea2-467a-8aac-18d5092fd678 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:21:15.193667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:15.249825 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4f646-a7af-4682-83c8-d941c48db6a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:21:15.250439 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4f646-a7af-4682-83c8-d941c48db6a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:15.250719 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4f646-a7af-4682-83c8-d941c48db6a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:15.250990 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4f646-a7af-4682-83c8-d941c48db6a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:15.252608 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-9bc4f646-a7af-4682-83c8-d941c48db6a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:15.362366 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4f646-a7af-4682-83c8-d941c48db6a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:21:15.363733 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4f646-a7af-4682-83c8-d941c48db6a9 service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:21:15.382933 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 721/1452] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:21:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:21:17.378760 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2a4fa-dce4-4a35-ab08-254ffd4a6a21 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:17.379428 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2a4fa-dce4-4a35-ab08-254ffd4a6a21 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:17.379428 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2a4fa-dce4-4a35-ab08-254ffd4a6a21 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:17.380672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:21:17.386905 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1987db-4502-485c-b28f-5d0457f85441 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:17.387386 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1987db-4502-485c-b28f-5d0457f85441 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:17.387492 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1987db-4502-485c-b28f-5d0457f85441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:17.455559 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:17.458680 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-6d1987db-4502-485c-b28f-5d0457f85441 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:21:17.460434 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-6d1987db-4502-485c-b28f-5d0457f85441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:17.562078 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:21:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:21:17.843629 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2a4fa-dce4-4a35-ab08-254ffd4a6a21 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:21:17.845190 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-1cd2a4fa-dce4-4a35-ab08-254ffd4a6a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:17.951185 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2a4fa-dce4-4a35-ab08-254ffd4a6a21 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:21:17.999928 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:18.025286 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538e7a0-6def-4919-b01f-de4203af3781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:21:18.025966 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538e7a0-6def-4919-b01f-de4203af3781 service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:18.026445 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538e7a0-6def-4919-b01f-de4203af3781 service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:18.026892 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538e7a0-6def-4919-b01f-de4203af3781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:18.028558 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-f538e7a0-6def-4919-b01f-de4203af3781 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:18.142083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538e7a0-6def-4919-b01f-de4203af3781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:21:18.143410 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538e7a0-6def-4919-b01f-de4203af3781 service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:21:18.162402 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 733/1455] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:21:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:21:20.235112 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc3091-1973-4e61-8142-24227751d7b8 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:20.235692 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc3091-1973-4e61-8142-24227751d7b8 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:20.235692 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc3091-1973-4e61-8142-24227751d7b8 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:20.237034 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:21:20.242943 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c7397-13be-4c35-a593-069087cfc354 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:20.243523 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c7397-13be-4c35-a593-069087cfc354 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:20.243523 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c7397-13be-4c35-a593-069087cfc354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:20.319623 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-d32c7397-13be-4c35-a593-069087cfc354 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:21:20.321195 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-d32c7397-13be-4c35-a593-069087cfc354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:20.352685 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:20.423339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:21:20.715158 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc3091-1973-4e61-8142-24227751d7b8 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:21:20.717511 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-d7fc3091-1973-4e61-8142-24227751d7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:20.834184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc3091-1973-4e61-8142-24227751d7b8 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:21:20.865260 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:20.911334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1108d-18ba-466f-9892-bb5ea3eb234d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:21:20.912033 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1108d-18ba-466f-9892-bb5ea3eb234d service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:20.912311 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1108d-18ba-466f-9892-bb5ea3eb234d service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:20.912587 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1108d-18ba-466f-9892-bb5ea3eb234d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:20.914230 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-52c1108d-18ba-466f-9892-bb5ea3eb234d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:21.025870 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c1108d-18ba-466f-9892-bb5ea3eb234d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:21:21.027332 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c1108d-18ba-466f-9892-bb5ea3eb234d service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:21:21.046881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 724/1458] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:21:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:21:23.037973 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d19021-72e8-46e6-bc91-3eb33740de5e None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:23.038513 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d19021-72e8-46e6-bc91-3eb33740de5e None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:23.038513 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d19021-72e8-46e6-bc91-3eb33740de5e None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:23.039864 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:21:23.049577 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697aefcc-2218-43f3-bf2a-f2d24180e982 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:23.050105 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697aefcc-2218-43f3-bf2a-f2d24180e982 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:23.050230 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697aefcc-2218-43f3-bf2a-f2d24180e982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:23.121832 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-697aefcc-2218-43f3-bf2a-f2d24180e982 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:21:23.123127 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-697aefcc-2218-43f3-bf2a-f2d24180e982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:23.131623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:23.224762 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:21:23.511128 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d19021-72e8-46e6-bc91-3eb33740de5e None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:21:23.512745 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-90d19021-72e8-46e6-bc91-3eb33740de5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:23.617339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d19021-72e8-46e6-bc91-3eb33740de5e None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:21:23.675303 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:23.696514 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd1f89-4f51-461f-af19-0fe5bdd82acb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:21:23.697133 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd1f89-4f51-461f-af19-0fe5bdd82acb service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:23.697452 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd1f89-4f51-461f-af19-0fe5bdd82acb service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:23.697731 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd1f89-4f51-461f-af19-0fe5bdd82acb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:23.699355 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-b7fd1f89-4f51-461f-af19-0fe5bdd82acb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:23.813980 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd1f89-4f51-461f-af19-0fe5bdd82acb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:21:23.815419 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd1f89-4f51-461f-af19-0fe5bdd82acb service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:21:23.833419 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 736/1461] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:21:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:21:25.967367 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeffdf3-2443-4fa3-929c-32d11fc20936 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:25.967970 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeffdf3-2443-4fa3-929c-32d11fc20936 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:25.967970 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeffdf3-2443-4fa3-929c-32d11fc20936 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:25.969316 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:21:25.975200 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dab88-c042-4e4f-b8cf-edb9c8671f49 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:25.975753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dab88-c042-4e4f-b8cf-edb9c8671f49 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:25.975753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dab88-c042-4e4f-b8cf-edb9c8671f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:26.167192 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-616dab88-c042-4e4f-b8cf-edb9c8671f49 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:21:26.168364 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-616dab88-c042-4e4f-b8cf-edb9c8671f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:26.212061 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:26.274413 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:21:26.574885 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeffdf3-2443-4fa3-929c-32d11fc20936 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:21:26.577815 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-ffeffdf3-2443-4fa3-929c-32d11fc20936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:26.685681 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeffdf3-2443-4fa3-929c-32d11fc20936 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:21:26.725034 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:26.783776 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05680ac-3c6a-4c8d-b22b-f77bb58ce124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:21:26.784794 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05680ac-3c6a-4c8d-b22b-f77bb58ce124 service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:26.785259 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05680ac-3c6a-4c8d-b22b-f77bb58ce124 service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:26.785744 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05680ac-3c6a-4c8d-b22b-f77bb58ce124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:26.788010 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-c05680ac-3c6a-4c8d-b22b-f77bb58ce124 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:26.934443 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05680ac-3c6a-4c8d-b22b-f77bb58ce124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:21:26.936946 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05680ac-3c6a-4c8d-b22b-f77bb58ce124 service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:21:26.957721 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 727/1464] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:21:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:21:29.192096 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033afc1-a82d-4ff0-a581-d8e9acb65a07 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:29.192684 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033afc1-a82d-4ff0-a581-d8e9acb65a07 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:29.192684 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033afc1-a82d-4ff0-a581-d8e9acb65a07 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:29.194091 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:21:29.200163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38dbb27-20ba-4bb7-b325-e61b7f7f372a None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:29.200762 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38dbb27-20ba-4bb7-b325-e61b7f7f372a None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:29.200931 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38dbb27-20ba-4bb7-b325-e61b7f7f372a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:29.295561 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-e38dbb27-20ba-4bb7-b325-e61b7f7f372a None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:21:29.296838 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-e38dbb27-20ba-4bb7-b325-e61b7f7f372a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:29.322551 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:29.425351 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:21:29.743211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033afc1-a82d-4ff0-a581-d8e9acb65a07 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:21:29.745483 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-4033afc1-a82d-4ff0-a581-d8e9acb65a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:29.876958 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033afc1-a82d-4ff0-a581-d8e9acb65a07 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:21:29.948387 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:29.956865 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8eacc-3f64-4480-8257-acdd438d1980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:21:29.957507 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8eacc-3f64-4480-8257-acdd438d1980 service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:29.957789 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8eacc-3f64-4480-8257-acdd438d1980 service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:29.958057 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8eacc-3f64-4480-8257-acdd438d1980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:29.959762 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-2fe8eacc-3f64-4480-8257-acdd438d1980 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:30.086052 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8eacc-3f64-4480-8257-acdd438d1980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:21:30.087408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8eacc-3f64-4480-8257-acdd438d1980 service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:21:30.107774 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 739/1467] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:21:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:21:32.081088 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cd710-2b9e-48b0-ae98-abb5dcf1054f None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:32.081666 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cd710-2b9e-48b0-ae98-abb5dcf1054f None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:32.081666 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cd710-2b9e-48b0-ae98-abb5dcf1054f None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:32.082935 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:21:32.088616 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f1a25-f2a1-47fb-aff4-e4523163fc44 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:32.089077 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f1a25-f2a1-47fb-aff4-e4523163fc44 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:32.089183 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f1a25-f2a1-47fb-aff4-e4523163fc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:32.155335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-e43f1a25-f2a1-47fb-aff4-e4523163fc44 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:21:32.156460 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-e43f1a25-f2a1-47fb-aff4-e4523163fc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:32.206858 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:32.256081 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:21:32.541393 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cd710-2b9e-48b0-ae98-abb5dcf1054f None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:21:32.543003 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-914cd710-2b9e-48b0-ae98-abb5dcf1054f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:32.651436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cd710-2b9e-48b0-ae98-abb5dcf1054f None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:21:32.701300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:32.728534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743d5f7-172a-44b1-81f8-64267c3b777e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:21:32.729156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743d5f7-172a-44b1-81f8-64267c3b777e service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:32.729468 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743d5f7-172a-44b1-81f8-64267c3b777e service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:32.729747 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743d5f7-172a-44b1-81f8-64267c3b777e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:32.732007 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-6743d5f7-172a-44b1-81f8-64267c3b777e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:32.846454 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6743d5f7-172a-44b1-81f8-64267c3b777e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:21:32.847819 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6743d5f7-172a-44b1-81f8-64267c3b777e service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:21:32.866516 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 730/1470] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:21:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:21:42.254317 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=22 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:42.864110 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=66 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:52.954793 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7474ec-ae98-4124-a087-16c0e55b4687 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:52.955400 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7474ec-ae98-4124-a087-16c0e55b4687 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:52.955400 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7474ec-ae98-4124-a087-16c0e55b4687 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:52.956720 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 741/1471] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:21:52.962184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a566d4-a9d4-4741-9993-3007cdcc34bb None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:52.962607 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a566d4-a9d4-4741-9993-3007cdcc34bb None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:52.962742 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a566d4-a9d4-4741-9993-3007cdcc34bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:53.033112 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-b5a566d4-a9d4-4741-9993-3007cdcc34bb None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:21:53.033333 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-b5a566d4-a9d4-4741-9993-3007cdcc34bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:53.135676 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 731/1472] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:21:53.433290 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5360a-0103-48a7-b0eb-24f9497b38d1 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:53.433612 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5360a-0103-48a7-b0eb-24f9497b38d1 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:53.433929 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5360a-0103-48a7-b0eb-24f9497b38d1 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:53.436012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 742/1473] 10.222.0.77 () {54 vars in 967 bytes} [Tue Aug 23 22:21:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:21:53.441143 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51350e-3337-44c3-8a5d-14102bce872c None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:53.441471 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51350e-3337-44c3-8a5d-14102bce872c None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:53.441753 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51350e-3337-44c3-8a5d-14102bce872c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:53.521510 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-ee51350e-3337-44c3-8a5d-14102bce872c None None] MFA Rules not processed for user `855cbc7a992d4c6697632d2d4d74abfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:21:53.522739 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-ee51350e-3337-44c3-8a5d-14102bce872c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:53.545118 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:53.602937 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 732/1474] 10.222.0.77 () {58 vars in 1064 bytes} [Tue Aug 23 22:21:53 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:21:53.611108 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5360a-0103-48a7-b0eb-24f9497b38d1 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:21:53.612659 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-abc5360a-0103-48a7-b0eb-24f9497b38d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:53.732303 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5360a-0103-48a7-b0eb-24f9497b38d1 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:21:53.815654 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4a6bb-c568-4b98-b963-c5d020f0ce52 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '855cbc7a992d4c6697632d2d4d74abfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:21:53.816265 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4a6bb-c568-4b98-b963-c5d020f0ce52 service glance] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:53.816547 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4a6bb-c568-4b98-b963-c5d020f0ce52 service glance] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:53.816820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4a6bb-c568-4b98-b963-c5d020f0ce52 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:53.818545 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-e8b4a6bb-c568-4b98-b963-c5d020f0ce52 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:53.876510 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:53.938024 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4a6bb-c568-4b98-b963-c5d020f0ce52 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:21:53.939499 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4a6bb-c568-4b98-b963-c5d020f0ce52 service glance] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:21:53.960712 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 743/1475] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:21:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:21:56.019227 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c2d8c-7c01-40b6-be59-6229bb2b5a4a None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:56.019766 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c2d8c-7c01-40b6-be59-6229bb2b5a4a None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:56.019766 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c2d8c-7c01-40b6-be59-6229bb2b5a4a None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:56.021028 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 733/1476] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:21:56.026741 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc6148-5ca4-4c4f-9190-8f3c0db01751 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:56.027230 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc6148-5ca4-4c4f-9190-8f3c0db01751 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:56.027350 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc6148-5ca4-4c4f-9190-8f3c0db01751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:56.102487 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-57cc6148-5ca4-4c4f-9190-8f3c0db01751 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:21:56.103750 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-57cc6148-5ca4-4c4f-9190-8f3c0db01751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:56.207435 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 744/1477] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:21:56.484854 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c2d8c-7c01-40b6-be59-6229bb2b5a4a None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:21:56.486462 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-0a3c2d8c-7c01-40b6-be59-6229bb2b5a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:56.616880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c2d8c-7c01-40b6-be59-6229bb2b5a4a None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:21:56.668685 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:56.718601 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f11cfe-e2b9-434b-bf85-63f0208622ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:21:56.719232 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f11cfe-e2b9-434b-bf85-63f0208622ba admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:56.719497 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f11cfe-e2b9-434b-bf85-63f0208622ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:56.719764 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f11cfe-e2b9-434b-bf85-63f0208622ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:56.720398 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f11cfe-e2b9-434b-bf85-63f0208622ba admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:21:56.722209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: WARNING py.warnings [None req-89f11cfe-e2b9-434b-bf85-63f0208622ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:21:56.722209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: warnings.warn(msg) Aug 23 22:21:56.722209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: Aug 23 22:21:56.723346 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f11cfe-e2b9-434b-bf85-63f0208622ba admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:21:56.744191 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 734/1478] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Aug 23 22:21:56 2022] GET /identity/v3/projects => generated 2553 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:21:58.720695 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e54fa-9823-4af2-80a0-be498038bea3 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:58.721306 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e54fa-9823-4af2-80a0-be498038bea3 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:58.721306 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e54fa-9823-4af2-80a0-be498038bea3 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:58.722637 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 745/1479] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:21:58.727966 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c67d5-ff73-44b3-80f2-6b8b5150a486 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:58.728424 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c67d5-ff73-44b3-80f2-6b8b5150a486 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:58.728531 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c67d5-ff73-44b3-80f2-6b8b5150a486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:58.796771 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-f26c67d5-ff73-44b3-80f2-6b8b5150a486 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:21:58.798036 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-f26c67d5-ff73-44b3-80f2-6b8b5150a486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:58.895741 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 735/1480] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:21:59.190184 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e54fa-9823-4af2-80a0-be498038bea3 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:21:59.191793 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-311e54fa-9823-4af2-80a0-be498038bea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:59.201766 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:59.344173 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e54fa-9823-4af2-80a0-be498038bea3 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:21:59.429243 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:59.463606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e95a9-eec1-4092-86bd-59ae34af27d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:21:59.464218 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e95a9-eec1-4092-86bd-59ae34af27d8 service nova] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:59.464496 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e95a9-eec1-4092-86bd-59ae34af27d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:59.464768 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e95a9-eec1-4092-86bd-59ae34af27d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:59.467450 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-424e95a9-eec1-4092-86bd-59ae34af27d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:59.560883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e95a9-eec1-4092-86bd-59ae34af27d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:21:59.562511 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e95a9-eec1-4092-86bd-59ae34af27d8 service nova] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:21:59.581720 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 746/1481] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:21:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:22:01.704733 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2a0c8-ff83-44c0-a17a-d5aea05c1601 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:22:01.705292 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2a0c8-ff83-44c0-a17a-d5aea05c1601 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:22:01.705292 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2a0c8-ff83-44c0-a17a-d5aea05c1601 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:22:01.706687 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 736/1482] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:22:01.712137 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee95c4-12e8-4c97-88cc-8a4a7cda8df8 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:22:01.712565 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee95c4-12e8-4c97-88cc-8a4a7cda8df8 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:22:01.712684 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee95c4-12e8-4c97-88cc-8a4a7cda8df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:22:01.783674 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-bdee95c4-12e8-4c97-88cc-8a4a7cda8df8 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:22:01.784891 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-bdee95c4-12e8-4c97-88cc-8a4a7cda8df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:22:01.833373 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:22:01.884801 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 747/1483] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:22:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:22:02.179599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2a0c8-ff83-44c0-a17a-d5aea05c1601 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:22:02.181425 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-39b2a0c8-ff83-44c0-a17a-d5aea05c1601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:22:02.206031 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:22:02.289063 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2a0c8-ff83-44c0-a17a-d5aea05c1601 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:22:02.365005 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ce407-5512-4b4f-bc1d-d839ed9acbbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:22:02.365649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ce407-5512-4b4f-bc1d-d839ed9acbbe service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:22:02.365938 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ce407-5512-4b4f-bc1d-d839ed9acbbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:22:02.366216 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ce407-5512-4b4f-bc1d-d839ed9acbbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:22:02.367853 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-852ce407-5512-4b4f-bc1d-d839ed9acbbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:22:02.444853 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:22:02.482395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ce407-5512-4b4f-bc1d-d839ed9acbbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:22:02.483875 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ce407-5512-4b4f-bc1d-d839ed9acbbe service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:22:02.506732 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 737/1484] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:22:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:22:04.499115 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98f2c3-3041-4b05-964d-84f96c827c0d None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:22:04.499971 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98f2c3-3041-4b05-964d-84f96c827c0d None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:22:04.499971 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98f2c3-3041-4b05-964d-84f96c827c0d None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:22:04.501107 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 748/1485] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:22:04.506794 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5afe8f-ffd1-45ed-bd46-3adbd4d250ee None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:22:04.507257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5afe8f-ffd1-45ed-bd46-3adbd4d250ee None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:22:04.507368 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5afe8f-ffd1-45ed-bd46-3adbd4d250ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:22:04.574370 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-ea5afe8f-ffd1-45ed-bd46-3adbd4d250ee None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:22:04.575693 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-ea5afe8f-ffd1-45ed-bd46-3adbd4d250ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:22:04.673188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 738/1486] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:22:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:22:04.961248 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98f2c3-3041-4b05-964d-84f96c827c0d None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:22:04.962799 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-fd98f2c3-3041-4b05-964d-84f96c827c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:22:05.069532 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98f2c3-3041-4b05-964d-84f96c827c0d None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:22:05.142591 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:22:05.144275 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c26a7-3a11-40e8-8e30-53f19b35d9b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:22:05.144989 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c26a7-3a11-40e8-8e30-53f19b35d9b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:22:05.145305 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c26a7-3a11-40e8-8e30-53f19b35d9b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:22:05.145621 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c26a7-3a11-40e8-8e30-53f19b35d9b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:22:05.147831 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-c02c26a7-3a11-40e8-8e30-53f19b35d9b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:22:05.260948 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c26a7-3a11-40e8-8e30-53f19b35d9b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:22:05.263453 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c26a7-3a11-40e8-8e30-53f19b35d9b4 service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:22:05.283218 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 749/1487] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:22:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:22:07.404974 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e00ee-827f-4a11-8c68-12a3e057f6dc None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:22:07.405706 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e00ee-827f-4a11-8c68-12a3e057f6dc None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:22:07.405706 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e00ee-827f-4a11-8c68-12a3e057f6dc None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:22:07.406916 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 739/1488] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:22:07.412565 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0835820-843e-4a49-833f-66c3e82b11eb None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:22:07.413028 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0835820-843e-4a49-833f-66c3e82b11eb None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:22:07.413158 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0835820-843e-4a49-833f-66c3e82b11eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:22:07.482967 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-e0835820-843e-4a49-833f-66c3e82b11eb None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:22:07.484188 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-e0835820-843e-4a49-833f-66c3e82b11eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:22:07.539337 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:22:07.590151 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 750/1489] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:22:07.896384 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e00ee-827f-4a11-8c68-12a3e057f6dc None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:22:07.897993 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-0e5e00ee-827f-4a11-8c68-12a3e057f6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:22:07.935887 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:22:08.004191 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e00ee-827f-4a11-8c68-12a3e057f6dc None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:22:08.079369 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904fde29-dce8-40c5-8735-206e50ba68e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:22:08.079982 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fde29-dce8-40c5-8735-206e50ba68e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:22:08.080264 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fde29-dce8-40c5-8735-206e50ba68e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:22:08.080542 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fde29-dce8-40c5-8735-206e50ba68e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:22:08.082231 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-904fde29-dce8-40c5-8735-206e50ba68e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:22:08.166388 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:22:08.205240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904fde29-dce8-40c5-8735-206e50ba68e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:22:08.206730 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904fde29-dce8-40c5-8735-206e50ba68e8 service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:22:08.233124 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 740/1490] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:22:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:22:10.372428 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34e967-e9e5-4443-88dc-0fdabd6f2a67 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:22:10.373036 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34e967-e9e5-4443-88dc-0fdabd6f2a67 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:22:10.373036 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34e967-e9e5-4443-88dc-0fdabd6f2a67 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:22:10.374362 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 751/1491] 10.222.0.77 () {54 vars in 927 bytes} [Tue Aug 23 22:22:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:22:10.380124 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecf4b7-5615-45b8-bd76-bdaff6bdb206 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:22:10.380716 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecf4b7-5615-45b8-bd76-bdaff6bdb206 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:22:10.380716 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecf4b7-5615-45b8-bd76-bdaff6bdb206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:22:10.449841 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-a7ecf4b7-5615-45b8-bd76-bdaff6bdb206 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:22:10.451075 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-a7ecf4b7-5615-45b8-bd76-bdaff6bdb206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:22:10.555341 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 741/1492] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Aug 23 22:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:22:10.846949 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34e967-e9e5-4443-88dc-0fdabd6f2a67 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:22:10.848503 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-dc34e967-e9e5-4443-88dc-0fdabd6f2a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:22:10.960377 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34e967-e9e5-4443-88dc-0fdabd6f2a67 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:22:11.045330 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4fa5f3-f35a-47b7-9b05-f650ea670a19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:22:11.045890 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4fa5f3-f35a-47b7-9b05-f650ea670a19 service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:22:11.046173 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4fa5f3-f35a-47b7-9b05-f650ea670a19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:22:11.046440 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4fa5f3-f35a-47b7-9b05-f650ea670a19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:22:11.048098 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-5a4fa5f3-f35a-47b7-9b05-f650ea670a19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:22:11.059501 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:22:11.169648 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4fa5f3-f35a-47b7-9b05-f650ea670a19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:22:11.171113 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4fa5f3-f35a-47b7-9b05-f650ea670a19 service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:22:11.190271 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 752/1493] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:22:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:22:20.553323 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=82 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:22:21.187955 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=50 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:24.918678 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de42739-04f6-4428-96fd-989c3fe4f2a9 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:24.919521 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de42739-04f6-4428-96fd-989c3fe4f2a9 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:24.919521 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de42739-04f6-4428-96fd-989c3fe4f2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:25.015661 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-1de42739-04f6-4428-96fd-989c3fe4f2a9 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:25.017093 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-1de42739-04f6-4428-96fd-989c3fe4f2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:25.135071 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 742/1494] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:23:25.143820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfc93d-4e16-4a04-a8b2-2ca850fb80bf None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:25.144921 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfc93d-4e16-4a04-a8b2-2ca850fb80bf None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:25.144921 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfc93d-4e16-4a04-a8b2-2ca850fb80bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:25.233186 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-badfc93d-4e16-4a04-a8b2-2ca850fb80bf None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:25.234470 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-badfc93d-4e16-4a04-a8b2-2ca850fb80bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:25.358632 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 753/1495] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:25.363510 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de42739-04f6-4428-96fd-989c3fe4f2a9 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:25.364822 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-1de42739-04f6-4428-96fd-989c3fe4f2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:25.382243 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de42739-04f6-4428-96fd-989c3fe4f2a9 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:25.452324 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:25.490595 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ccd5fb-ae5d-46e9-9689-166d91fa2ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:25.491222 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccd5fb-ae5d-46e9-9689-166d91fa2ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:25.491506 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccd5fb-ae5d-46e9-9689-166d91fa2ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:25.491780 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccd5fb-ae5d-46e9-9689-166d91fa2ea5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:25.492438 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ccd5fb-ae5d-46e9-9689-166d91fa2ea5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:23:25.492740 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ccd5fb-ae5d-46e9-9689-166d91fa2ea5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:25.493814 dv-cinder-850321-4-smb devstack@keystone.service[81751]: WARNING py.warnings [None req-e0ccd5fb-ae5d-46e9-9689-166d91fa2ea5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:23:25.493814 dv-cinder-850321-4-smb devstack@keystone.service[81751]: warnings.warn(msg) Aug 23 22:23:25.493814 dv-cinder-850321-4-smb devstack@keystone.service[81751]: Aug 23 22:23:25.494763 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ccd5fb-ae5d-46e9-9689-166d91fa2ea5 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:25.507955 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 743/1496] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:23:25.517188 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badfc93d-4e16-4a04-a8b2-2ca850fb80bf None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:25.527977 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badfc93d-4e16-4a04-a8b2-2ca850fb80bf None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:25.619361 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:25.661777 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1a6c4-2c83-41c5-9df2-e49cdda6cf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:25.662403 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1a6c4-2c83-41c5-9df2-e49cdda6cf7b admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:25.662689 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1a6c4-2c83-41c5-9df2-e49cdda6cf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:25.662953 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1a6c4-2c83-41c5-9df2-e49cdda6cf7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:25.663597 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c1a6c4-2c83-41c5-9df2-e49cdda6cf7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:25.665404 dv-cinder-850321-4-smb devstack@keystone.service[81752]: WARNING py.warnings [None req-d2c1a6c4-2c83-41c5-9df2-e49cdda6cf7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:23:25.665404 dv-cinder-850321-4-smb devstack@keystone.service[81752]: warnings.warn(msg) Aug 23 22:23:25.665404 dv-cinder-850321-4-smb devstack@keystone.service[81752]: Aug 23 22:23:25.666606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c1a6c4-2c83-41c5-9df2-e49cdda6cf7b admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:25.738050 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 754/1497] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:23:25 2022] POST /identity/v3/projects => generated 377 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:23:25.742910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ccd5fb-ae5d-46e9-9689-166d91fa2ea5 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:25.744581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-e0ccd5fb-ae5d-46e9-9689-166d91fa2ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:25.783890 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ccd5fb-ae5d-46e9-9689-166d91fa2ea5 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:25.896989 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a20eed-cdc4-4725-9518-5fbadad45432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:25.897560 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a20eed-cdc4-4725-9518-5fbadad45432 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:25.897986 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a20eed-cdc4-4725-9518-5fbadad45432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:25.898105 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a20eed-cdc4-4725-9518-5fbadad45432 admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:25.898709 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a20eed-cdc4-4725-9518-5fbadad45432 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:25.899736 dv-cinder-850321-4-smb devstack@keystone.service[81751]: WARNING py.warnings [None req-39a20eed-cdc4-4725-9518-5fbadad45432 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:23:25.899736 dv-cinder-850321-4-smb devstack@keystone.service[81751]: warnings.warn(msg) Aug 23 22:23:25.899736 dv-cinder-850321-4-smb devstack@keystone.service[81751]: Aug 23 22:23:25.900951 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a20eed-cdc4-4725-9518-5fbadad45432 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:25.951519 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 744/1498] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:23:25 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:23:25.956064 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1a6c4-2c83-41c5-9df2-e49cdda6cf7b admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:25.957644 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-d2c1a6c4-2c83-41c5-9df2-e49cdda6cf7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:26.027106 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1a6c4-2c83-41c5-9df2-e49cdda6cf7b admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:26.128967 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:26.143812 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66993778-9b61-4f0c-ab4f-8c8ab3808973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:26.144441 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66993778-9b61-4f0c-ab4f-8c8ab3808973 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:26.145030 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66993778-9b61-4f0c-ab4f-8c8ab3808973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:26.145030 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66993778-9b61-4f0c-ab4f-8c8ab3808973 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:26.145613 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66993778-9b61-4f0c-ab4f-8c8ab3808973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:26.146629 dv-cinder-850321-4-smb devstack@keystone.service[81752]: WARNING py.warnings [None req-66993778-9b61-4f0c-ab4f-8c8ab3808973 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:23:26.146629 dv-cinder-850321-4-smb devstack@keystone.service[81752]: warnings.warn(msg) Aug 23 22:23:26.146629 dv-cinder-850321-4-smb devstack@keystone.service[81752]: Aug 23 22:23:26.147596 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66993778-9b61-4f0c-ab4f-8c8ab3808973 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:26.161552 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 755/1499] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:23:26.165954 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a20eed-cdc4-4725-9518-5fbadad45432 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:26.168039 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-39a20eed-cdc4-4725-9518-5fbadad45432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:26.180998 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a20eed-cdc4-4725-9518-5fbadad45432 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:26.208602 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:26.301733 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db31dd0-7c1f-4735-98bc-3fbe6becd089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:26.302363 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db31dd0-7c1f-4735-98bc-3fbe6becd089 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:26.302626 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db31dd0-7c1f-4735-98bc-3fbe6becd089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:26.302892 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db31dd0-7c1f-4735-98bc-3fbe6becd089 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:26.303539 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db31dd0-7c1f-4735-98bc-3fbe6becd089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:26.304817 dv-cinder-850321-4-smb devstack@keystone.service[81751]: WARNING py.warnings [None req-2db31dd0-7c1f-4735-98bc-3fbe6becd089 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:23:26.304817 dv-cinder-850321-4-smb devstack@keystone.service[81751]: warnings.warn(msg) Aug 23 22:23:26.304817 dv-cinder-850321-4-smb devstack@keystone.service[81751]: Aug 23 22:23:26.305731 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db31dd0-7c1f-4735-98bc-3fbe6becd089 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:26.318878 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 745/1500] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:23:26.323278 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66993778-9b61-4f0c-ab4f-8c8ab3808973 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:26.326295 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-66993778-9b61-4f0c-ab4f-8c8ab3808973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:26.363877 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66993778-9b61-4f0c-ab4f-8c8ab3808973 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:26.472353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77b854-dad9-4fdb-9e0a-41e864864964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:26.473027 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77b854-dad9-4fdb-9e0a-41e864864964 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:26.473313 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77b854-dad9-4fdb-9e0a-41e864864964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:26.473618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77b854-dad9-4fdb-9e0a-41e864864964 admin admin] PATH_INFO: `/v3/projects/b47df264866f49aa85501d9b0dc79fa9/users/ff3ac086d4864436b8bd4171edd3e1f1/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:26.502571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77b854-dad9-4fdb-9e0a-41e864864964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b47df264866f49aa85501d9b0dc79fa9, user_id=ff3ac086d4864436b8bd4171edd3e1f1, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:26.503792 dv-cinder-850321-4-smb devstack@keystone.service[81752]: WARNING py.warnings [None req-ef77b854-dad9-4fdb-9e0a-41e864864964 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:23:26.503792 dv-cinder-850321-4-smb devstack@keystone.service[81752]: warnings.warn(msg) Aug 23 22:23:26.503792 dv-cinder-850321-4-smb devstack@keystone.service[81752]: Aug 23 22:23:26.506484 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77b854-dad9-4fdb-9e0a-41e864864964 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:26.540794 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 756/1501] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:23:26 2022] PUT /identity/v3/projects/b47df264866f49aa85501d9b0dc79fa9/users/ff3ac086d4864436b8bd4171edd3e1f1/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:23:26.555134 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b838e6f-ab69-4781-926d-e01095b224be None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:26.555518 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b838e6f-ab69-4781-926d-e01095b224be None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:26.555895 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b838e6f-ab69-4781-926d-e01095b224be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:26.630301 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-4b838e6f-ab69-4781-926d-e01095b224be None None] MFA Rules not processed for user `ff3ac086d4864436b8bd4171edd3e1f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:26.632164 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-4b838e6f-ab69-4781-926d-e01095b224be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:26.751413 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 746/1502] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:23:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:23:26.765941 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af522294-e1b4-49fb-886a-3fc29dfd875c None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:26.766311 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af522294-e1b4-49fb-886a-3fc29dfd875c None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:26.766627 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af522294-e1b4-49fb-886a-3fc29dfd875c None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:26.768057 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 757/1503] 10.222.0.77 () {54 vars in 964 bytes} [Tue Aug 23 22:23:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:23:26.774598 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215b85e-ecd2-41ca-bfb9-6981a2498eea None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:26.775030 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215b85e-ecd2-41ca-bfb9-6981a2498eea None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:26.775484 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215b85e-ecd2-41ca-bfb9-6981a2498eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:26.814405 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:26.866705 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-a215b85e-ecd2-41ca-bfb9-6981a2498eea None None] MFA Rules not processed for user `99f6180d62a2415ca4bb7ad55fe33c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:26.867944 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-a215b85e-ecd2-41ca-bfb9-6981a2498eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:26.957872 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 747/1504] 10.222.0.77 () {58 vars in 1061 bytes} [Tue Aug 23 22:23:26 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:26.967261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af522294-e1b4-49fb-886a-3fc29dfd875c None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:26.968925 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-af522294-e1b4-49fb-886a-3fc29dfd875c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:27.025845 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:27.105381 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af522294-e1b4-49fb-886a-3fc29dfd875c None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:27.222948 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae9d63-e64d-4fad-af4d-bf71f213da9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:27.224001 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae9d63-e64d-4fad-af4d-bf71f213da9b service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:27.224001 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae9d63-e64d-4fad-af4d-bf71f213da9b service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:27.224275 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae9d63-e64d-4fad-af4d-bf71f213da9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:27.226316 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-1eae9d63-e64d-4fad-af4d-bf71f213da9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:27.362320 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae9d63-e64d-4fad-af4d-bf71f213da9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:27.363916 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae9d63-e64d-4fad-af4d-bf71f213da9b service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:27.368069 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:27.387484 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 758/1505] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:23:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:23:27.439729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15c4f4-4cbe-4f12-87d7-5b60d33e1492 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:27.439994 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15c4f4-4cbe-4f12-87d7-5b60d33e1492 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:27.440284 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15c4f4-4cbe-4f12-87d7-5b60d33e1492 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:27.441772 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 748/1506] 10.222.0.77 () {52 vars in 830 bytes} [Tue Aug 23 22:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:23:27.446437 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae9d63-e64d-4fad-af4d-bf71f213da9b service cinder] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:27.447725 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-1eae9d63-e64d-4fad-af4d-bf71f213da9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:27.571362 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae9d63-e64d-4fad-af4d-bf71f213da9b service cinder] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:27.687519 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c0eb5-b32e-4e22-92ee-ebb5977ef7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:27.688196 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c0eb5-b32e-4e22-92ee-ebb5977ef7f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:27.688584 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c0eb5-b32e-4e22-92ee-ebb5977ef7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:27.688714 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c0eb5-b32e-4e22-92ee-ebb5977ef7f7 admin admin] PATH_INFO: `/v3/users/ff3ac086d4864436b8bd4171edd3e1f1` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:27.705499 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c0eb5-b32e-4e22-92ee-ebb5977ef7f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff3ac086d4864436b8bd4171edd3e1f1)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:27.706558 dv-cinder-850321-4-smb devstack@keystone.service[81752]: WARNING py.warnings [None req-ea3c0eb5-b32e-4e22-92ee-ebb5977ef7f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:23:27.706558 dv-cinder-850321-4-smb devstack@keystone.service[81752]: warnings.warn(msg) Aug 23 22:23:27.706558 dv-cinder-850321-4-smb devstack@keystone.service[81752]: Aug 23 22:23:27.707814 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c0eb5-b32e-4e22-92ee-ebb5977ef7f7 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:27.719878 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:27.795465 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-ea3c0eb5-b32e-4e22-92ee-ebb5977ef7f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff3ac086d4864436b8bd4171edd3e1f1'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:27.796193 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-ea3c0eb5-b32e-4e22-92ee-ebb5977ef7f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff3ac086d4864436b8bd4171edd3e1f1'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:27.808454 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-ea3c0eb5-b32e-4e22-92ee-ebb5977ef7f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff3ac086d4864436b8bd4171edd3e1f1'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:27.833698 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-ea3c0eb5-b32e-4e22-92ee-ebb5977ef7f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff3ac086d4864436b8bd4171edd3e1f1'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:27.877040 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-ea3c0eb5-b32e-4e22-92ee-ebb5977ef7f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff3ac086d4864436b8bd4171edd3e1f1'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:27.888797 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 759/1507] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:23:27 2022] DELETE /identity/v3/users/ff3ac086d4864436b8bd4171edd3e1f1 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:23:27.895755 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395c277-b0b2-4528-864f-70caa8c82175 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:27.896249 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395c277-b0b2-4528-864f-70caa8c82175 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:27.896734 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395c277-b0b2-4528-864f-70caa8c82175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:27.996139 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-4395c277-b0b2-4528-864f-70caa8c82175 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:27.997850 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-4395c277-b0b2-4528-864f-70caa8c82175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:28.090010 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:28.107771 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 749/1508] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:28.118604 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c0eb5-b32e-4e22-92ee-ebb5977ef7f7 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:28.120428 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-ea3c0eb5-b32e-4e22-92ee-ebb5977ef7f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:28.306097 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c0eb5-b32e-4e22-92ee-ebb5977ef7f7 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:28.387324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:28.419051 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc138f-c1e2-44cc-8a9b-f35e94552011 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:28.419760 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc138f-c1e2-44cc-8a9b-f35e94552011 service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:28.420091 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc138f-c1e2-44cc-8a9b-f35e94552011 service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:28.420475 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc138f-c1e2-44cc-8a9b-f35e94552011 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:28.422456 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-08cc138f-c1e2-44cc-8a9b-f35e94552011 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:28.590427 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc138f-c1e2-44cc-8a9b-f35e94552011 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:28.591934 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc138f-c1e2-44cc-8a9b-f35e94552011 service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:28.625401 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 760/1509] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:23:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:23:29.116841 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395c277-b0b2-4528-864f-70caa8c82175 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:29.119137 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-4395c277-b0b2-4528-864f-70caa8c82175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:29.142995 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395c277-b0b2-4528-864f-70caa8c82175 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:29.294786 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa663f7-17b4-409b-92bb-3febcdd53d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:29.295902 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa663f7-17b4-409b-92bb-3febcdd53d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:29.296374 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa663f7-17b4-409b-92bb-3febcdd53d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:29.296886 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa663f7-17b4-409b-92bb-3febcdd53d29 admin admin] PATH_INFO: `/v3/projects/b47df264866f49aa85501d9b0dc79fa9` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:29.316530 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa663f7-17b4-409b-92bb-3febcdd53d29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b47df264866f49aa85501d9b0dc79fa9)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:29.318437 dv-cinder-850321-4-smb devstack@keystone.service[81751]: WARNING py.warnings [None req-eaa663f7-17b4-409b-92bb-3febcdd53d29 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:23:29.318437 dv-cinder-850321-4-smb devstack@keystone.service[81751]: warnings.warn(msg) Aug 23 22:23:29.318437 dv-cinder-850321-4-smb devstack@keystone.service[81751]: Aug 23 22:23:29.320758 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa663f7-17b4-409b-92bb-3febcdd53d29 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:29.419942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-eaa663f7-17b4-409b-92bb-3febcdd53d29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b47df264866f49aa85501d9b0dc79fa9', 'request_id': 'req-eaa663f7-17b4-409b-92bb-3febcdd53d29'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:29.446336 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-eaa663f7-17b4-409b-92bb-3febcdd53d29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b47df264866f49aa85501d9b0dc79fa9', 'request_id': 'req-eaa663f7-17b4-409b-92bb-3febcdd53d29'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:29.462850 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-eaa663f7-17b4-409b-92bb-3febcdd53d29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b47df264866f49aa85501d9b0dc79fa9', 'request_id': 'req-eaa663f7-17b4-409b-92bb-3febcdd53d29'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:29.509844 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-eaa663f7-17b4-409b-92bb-3febcdd53d29 admin admin] The token cache is being invalidate because project b47df264866f49aa85501d9b0dc79fa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:23:29.510347 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-eaa663f7-17b4-409b-92bb-3febcdd53d29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:29.511980 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-eaa663f7-17b4-409b-92bb-3febcdd53d29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:29.514396 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 750/1510] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:23:29 2022] DELETE /identity/v3/projects/b47df264866f49aa85501d9b0dc79fa9 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:23:38.622750 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=62 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:39.504877 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:17.471837 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfa700-1196-4b8c-bd52-6ee225e98d35 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:17.472615 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfa700-1196-4b8c-bd52-6ee225e98d35 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:17.472853 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfa700-1196-4b8c-bd52-6ee225e98d35 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:17.475780 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 761/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:25:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:25:17.484409 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a74a8-acd9-4c95-90eb-0b2ca1a8f855 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:17.485106 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a74a8-acd9-4c95-90eb-0b2ca1a8f855 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:17.485440 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a74a8-acd9-4c95-90eb-0b2ca1a8f855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:17.655309 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-2c8a74a8-acd9-4c95-90eb-0b2ca1a8f855 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:17.657682 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-2c8a74a8-acd9-4c95-90eb-0b2ca1a8f855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:18.049304 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653620ea-7cf0-4f2a-a06a-78c43a9505af None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:18.049992 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653620ea-7cf0-4f2a-a06a-78c43a9505af None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:18.050460 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653620ea-7cf0-4f2a-a06a-78c43a9505af None None] PATH_INFO: `/v3` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:18.053491 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 762/1512] 10.222.0.84 () {54 vars in 925 bytes} [Tue Aug 23 22:25:18 2022] GET /identity/v3 => generated 255 bytes in 6 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:25:18.061443 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadf4cb-fe88-4729-a6ca-338392827101 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:18.061909 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadf4cb-fe88-4729-a6ca-338392827101 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:18.062355 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadf4cb-fe88-4729-a6ca-338392827101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:18.087729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 751/1513] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 605 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:25:18.191548 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-5fadf4cb-fe88-4729-a6ca-338392827101 None None] MFA Rules not processed for user `2000b80e34ae45d2a8b658cd394419f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:18.193917 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-5fadf4cb-fe88-4729-a6ca-338392827101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:18.372649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a74a8-acd9-4c95-90eb-0b2ca1a8f855 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:18.375686 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-2c8a74a8-acd9-4c95-90eb-0b2ca1a8f855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:18.396285 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 763/1514] 10.222.0.84 () {58 vars in 1015 bytes} [Tue Aug 23 22:25:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:25:18.475428 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:18.520806 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a74a8-acd9-4c95-90eb-0b2ca1a8f855 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:18.528745 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a59886-c72b-46a7-8260-39f161be9abd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:18.529620 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a59886-c72b-46a7-8260-39f161be9abd service nova] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:18.530008 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a59886-c72b-46a7-8260-39f161be9abd service nova] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:18.530377 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a59886-c72b-46a7-8260-39f161be9abd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:18.542365 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a59886-c72b-46a7-8260-39f161be9abd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:18.545657 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a59886-c72b-46a7-8260-39f161be9abd service nova] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:18.566411 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 752/1515] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:25:20.186544 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3645df8-814d-4c22-a5c5-6420f862c86d None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:20.187510 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3645df8-814d-4c22-a5c5-6420f862c86d None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:20.187680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3645df8-814d-4c22-a5c5-6420f862c86d None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:20.190385 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 764/1516] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:25:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:25:20.200462 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b7d97-c889-48ca-afea-b1df93b3290b None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:20.201270 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b7d97-c889-48ca-afea-b1df93b3290b None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:20.201566 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b7d97-c889-48ca-afea-b1df93b3290b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:20.238137 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-931b7d97-c889-48ca-afea-b1df93b3290b None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:20.240247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-931b7d97-c889-48ca-afea-b1df93b3290b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:20.258818 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 753/1517] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:25:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:20.563459 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3645df8-814d-4c22-a5c5-6420f862c86d None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:20.592380 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3645df8-814d-4c22-a5c5-6420f862c86d None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:20.604190 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207bd3a-91a4-4697-9152-6b435d4758c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:20.605250 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207bd3a-91a4-4697-9152-6b435d4758c7 service nova] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:20.605921 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207bd3a-91a4-4697-9152-6b435d4758c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:20.606412 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207bd3a-91a4-4697-9152-6b435d4758c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:20.624730 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207bd3a-91a4-4697-9152-6b435d4758c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:20.628091 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207bd3a-91a4-4697-9152-6b435d4758c7 service nova] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:20.649151 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 765/1518] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:28.117649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad63884-e603-4af4-96d7-aed70305381e None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:28.118619 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad63884-e603-4af4-96d7-aed70305381e None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:28.118798 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad63884-e603-4af4-96d7-aed70305381e None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:28.121140 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 754/1519] 10.222.0.77 () {54 vars in 961 bytes} [Tue Aug 23 22:25:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:25:28.130648 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d88f4-02b5-4726-ac16-9ef77bcb7161 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:28.131435 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d88f4-02b5-4726-ac16-9ef77bcb7161 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:28.132115 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d88f4-02b5-4726-ac16-9ef77bcb7161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:28.170086 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-454d88f4-02b5-4726-ac16-9ef77bcb7161 None None] MFA Rules not processed for user `2000b80e34ae45d2a8b658cd394419f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:28.172342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-454d88f4-02b5-4726-ac16-9ef77bcb7161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:28.188999 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 766/1520] 10.222.0.77 () {58 vars in 1058 bytes} [Tue Aug 23 22:25:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:28.200662 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad63884-e603-4af4-96d7-aed70305381e None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:28.220766 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad63884-e603-4af4-96d7-aed70305381e None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:28.227876 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5794f1f-8442-4ea8-860c-9ac428857d2a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2000b80e34ae45d2a8b658cd394419f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:28.228591 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5794f1f-8442-4ea8-860c-9ac428857d2a service placement] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:28.228926 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5794f1f-8442-4ea8-860c-9ac428857d2a service placement] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:28.229302 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5794f1f-8442-4ea8-860c-9ac428857d2a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:28.239892 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5794f1f-8442-4ea8-860c-9ac428857d2a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:28.242414 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5794f1f-8442-4ea8-860c-9ac428857d2a service placement] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:28.255579 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 755/1521] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:25:32.211824 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2501fc1-e7e9-4774-b537-14c203d62c27 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:32.212779 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2501fc1-e7e9-4774-b537-14c203d62c27 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:32.212779 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2501fc1-e7e9-4774-b537-14c203d62c27 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:32.213831 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:25:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:25:32.219430 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0f68e-dd90-453f-bbbd-dbccf40292f7 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:32.220030 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0f68e-dd90-453f-bbbd-dbccf40292f7 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:32.220030 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0f68e-dd90-453f-bbbd-dbccf40292f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:32.240124 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-e3d0f68e-dd90-453f-bbbd-dbccf40292f7 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:32.241970 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-e3d0f68e-dd90-453f-bbbd-dbccf40292f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:32.251143 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:32.416833 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2501fc1-e7e9-4774-b537-14c203d62c27 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:32.434217 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2501fc1-e7e9-4774-b537-14c203d62c27 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:32.442253 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43141faf-024c-4c17-99ea-964d778d5519 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:32.443288 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43141faf-024c-4c17-99ea-964d778d5519 service nova] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:32.443550 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43141faf-024c-4c17-99ea-964d778d5519 service nova] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:32.444332 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43141faf-024c-4c17-99ea-964d778d5519 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:32.455458 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43141faf-024c-4c17-99ea-964d778d5519 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:32.457231 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43141faf-024c-4c17-99ea-964d778d5519 service nova] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:32.470820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 768/1524] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:25:33.593252 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2c1ca-f703-4c8c-b442-ab831d5c8b7b None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:33.594188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2c1ca-f703-4c8c-b442-ab831d5c8b7b None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:33.594188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2c1ca-f703-4c8c-b442-ab831d5c8b7b None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:33.595737 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:25:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:25:33.602940 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311206d1-49fc-4e3c-b3e6-e785bdbc6e6a None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:33.603607 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311206d1-49fc-4e3c-b3e6-e785bdbc6e6a None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:33.603838 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311206d1-49fc-4e3c-b3e6-e785bdbc6e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:33.630251 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-311206d1-49fc-4e3c-b3e6-e785bdbc6e6a None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:33.632670 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-311206d1-49fc-4e3c-b3e6-e785bdbc6e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:33.643916 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:33.861964 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2c1ca-f703-4c8c-b442-ab831d5c8b7b None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:33.881966 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2c1ca-f703-4c8c-b442-ab831d5c8b7b None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:33.890002 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcd945-2de3-45a3-a18d-433ffe48fb89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:33.890661 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcd945-2de3-45a3-a18d-433ffe48fb89 service nova] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:33.890944 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcd945-2de3-45a3-a18d-433ffe48fb89 service nova] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:33.891253 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcd945-2de3-45a3-a18d-433ffe48fb89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:33.905211 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcd945-2de3-45a3-a18d-433ffe48fb89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:33.908431 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcd945-2de3-45a3-a18d-433ffe48fb89 service nova] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:33.934061 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 758/1527] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:25:38.320662 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bad9e-facd-4af8-886b-9974ac9e9f50 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:38.321312 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bad9e-facd-4af8-886b-9974ac9e9f50 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:38.321637 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bad9e-facd-4af8-886b-9974ac9e9f50 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:38.324307 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:25:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:25:38.335622 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2135fb2-8c58-4779-883b-9bb5c159c41c None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:38.336300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2135fb2-8c58-4779-883b-9bb5c159c41c None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:38.336813 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2135fb2-8c58-4779-883b-9bb5c159c41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:38.374843 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-d2135fb2-8c58-4779-883b-9bb5c159c41c None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:38.377091 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-d2135fb2-8c58-4779-883b-9bb5c159c41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:38.392873 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:38.761225 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bad9e-facd-4af8-886b-9974ac9e9f50 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:38.764168 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-bf6bad9e-facd-4af8-886b-9974ac9e9f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:38.772955 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=74 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:38.872644 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bad9e-facd-4af8-886b-9974ac9e9f50 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:38.877959 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c1c2f-8068-43df-b226-578d635c5a0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:38.879141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c1c2f-8068-43df-b226-578d635c5a0f service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:38.879666 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c1c2f-8068-43df-b226-578d635c5a0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:38.880168 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c1c2f-8068-43df-b226-578d635c5a0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:38.896168 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0c1c2f-8068-43df-b226-578d635c5a0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:38.899162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0c1c2f-8068-43df-b226-578d635c5a0f service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:38.911822 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 771/1530] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:41.130321 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c12b65-fdb8-4415-bb4d-ef957f939bea None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:41.130900 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c12b65-fdb8-4415-bb4d-ef957f939bea None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:41.130900 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c12b65-fdb8-4415-bb4d-ef957f939bea None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:41.132268 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:25:41.139047 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e35dc1-798a-40e0-8f30-2c9afae83da2 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:41.139658 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e35dc1-798a-40e0-8f30-2c9afae83da2 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:41.139782 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e35dc1-798a-40e0-8f30-2c9afae83da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:41.168013 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-55e35dc1-798a-40e0-8f30-2c9afae83da2 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:41.169651 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-55e35dc1-798a-40e0-8f30-2c9afae83da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:41.181144 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:25:41.561738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c12b65-fdb8-4415-bb4d-ef957f939bea None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:41.564407 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-b0c12b65-fdb8-4415-bb4d-ef957f939bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:41.583685 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c12b65-fdb8-4415-bb4d-ef957f939bea None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:41.590044 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd985e2-0be2-40fa-a9cc-7e155bde2b50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:41.591132 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd985e2-0be2-40fa-a9cc-7e155bde2b50 service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:41.591618 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd985e2-0be2-40fa-a9cc-7e155bde2b50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:41.592103 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd985e2-0be2-40fa-a9cc-7e155bde2b50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:41.612479 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd985e2-0be2-40fa-a9cc-7e155bde2b50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:41.617052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd985e2-0be2-40fa-a9cc-7e155bde2b50 service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:41.630871 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 761/1533] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:25:46.474196 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004b3a3-255f-48d7-9621-634d0340e976 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:46.475405 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004b3a3-255f-48d7-9621-634d0340e976 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:46.475405 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004b3a3-255f-48d7-9621-634d0340e976 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:46.476965 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:25:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:25:46.484518 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84b935-c5a3-49be-9f55-3f9f75d29767 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:46.485484 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84b935-c5a3-49be-9f55-3f9f75d29767 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:46.485682 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84b935-c5a3-49be-9f55-3f9f75d29767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:46.521771 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-4b84b935-c5a3-49be-9f55-3f9f75d29767 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:46.523707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-4b84b935-c5a3-49be-9f55-3f9f75d29767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:46.535929 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:47.213609 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004b3a3-255f-48d7-9621-634d0340e976 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:47.215376 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-5004b3a3-255f-48d7-9621-634d0340e976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:47.343029 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004b3a3-255f-48d7-9621-634d0340e976 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:47.347528 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b834897-9778-4931-a249-ff8014ceb95c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:47.348340 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b834897-9778-4931-a249-ff8014ceb95c service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:47.348673 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b834897-9778-4931-a249-ff8014ceb95c service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:47.349012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b834897-9778-4931-a249-ff8014ceb95c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:47.361110 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b834897-9778-4931-a249-ff8014ceb95c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:47.363018 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b834897-9778-4931-a249-ff8014ceb95c service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:47.376849 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 774/1536] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:49.939327 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f94ac-d1bd-4ec7-b921-65b25a5fbd11 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:49.940204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f94ac-d1bd-4ec7-b921-65b25a5fbd11 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:49.940368 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f94ac-d1bd-4ec7-b921-65b25a5fbd11 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:49.942777 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:25:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:25:49.953152 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ea8ac-2b94-4d35-b84c-03f903996256 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:49.953745 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ea8ac-2b94-4d35-b84c-03f903996256 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:49.954171 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ea8ac-2b94-4d35-b84c-03f903996256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:49.984635 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-df2ea8ac-2b94-4d35-b84c-03f903996256 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:49.986837 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-df2ea8ac-2b94-4d35-b84c-03f903996256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:50.001322 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:50.657134 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f94ac-d1bd-4ec7-b921-65b25a5fbd11 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:50.659437 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-4b4f94ac-d1bd-4ec7-b921-65b25a5fbd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:50.669517 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=46 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:50.676845 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f94ac-d1bd-4ec7-b921-65b25a5fbd11 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:50.681229 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9785d-5c0d-4c20-8042-dc008fb1b289 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:50.681901 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9785d-5c0d-4c20-8042-dc008fb1b289 service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:50.682183 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9785d-5c0d-4c20-8042-dc008fb1b289 service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:50.682457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9785d-5c0d-4c20-8042-dc008fb1b289 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:50.693902 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9785d-5c0d-4c20-8042-dc008fb1b289 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:50.695463 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9785d-5c0d-4c20-8042-dc008fb1b289 service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:50.706587 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 764/1539] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:25:59.976972 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=75 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:00.701542 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=5 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:33.249809 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fe4aa-db57-4496-978f-5f048ada819d None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:33.251777 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fe4aa-db57-4496-978f-5f048ada819d None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:33.251777 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fe4aa-db57-4496-978f-5f048ada819d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:33.279399 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-171fe4aa-db57-4496-978f-5f048ada819d None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:33.280973 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-171fe4aa-db57-4496-978f-5f048ada819d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:33.295248 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 776/1540] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:27:33.306256 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15d039-d0f2-4e2b-b9d9-36fb697c1e8a None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:33.307550 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15d039-d0f2-4e2b-b9d9-36fb697c1e8a None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:33.308091 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15d039-d0f2-4e2b-b9d9-36fb697c1e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:33.347072 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-eb15d039-d0f2-4e2b-b9d9-36fb697c1e8a None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:33.349392 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-eb15d039-d0f2-4e2b-b9d9-36fb697c1e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:33.359690 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 765/1541] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:33.366857 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fe4aa-db57-4496-978f-5f048ada819d None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:33.390537 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fe4aa-db57-4496-978f-5f048ada819d None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:33.405327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67481279-403e-427d-8f67-f34870b560ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:33.433605 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67481279-403e-427d-8f67-f34870b560ed admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:33.434104 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67481279-403e-427d-8f67-f34870b560ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:33.434584 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67481279-403e-427d-8f67-f34870b560ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:33.436029 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67481279-403e-427d-8f67-f34870b560ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:27:33.436587 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67481279-403e-427d-8f67-f34870b560ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:33.438575 dv-cinder-850321-4-smb devstack@keystone.service[81752]: WARNING py.warnings [None req-67481279-403e-427d-8f67-f34870b560ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:27:33.438575 dv-cinder-850321-4-smb devstack@keystone.service[81752]: warnings.warn(msg) Aug 23 22:27:33.438575 dv-cinder-850321-4-smb devstack@keystone.service[81752]: Aug 23 22:27:33.440364 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67481279-403e-427d-8f67-f34870b560ed admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:33.476014 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 777/1542] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:27:33.485761 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15d039-d0f2-4e2b-b9d9-36fb697c1e8a None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:33.514739 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15d039-d0f2-4e2b-b9d9-36fb697c1e8a None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:33.532040 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d419b-043f-4d02-84bd-029ffda4c9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:33.533817 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d419b-043f-4d02-84bd-029ffda4c9e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:33.534562 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d419b-043f-4d02-84bd-029ffda4c9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:33.534944 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d419b-043f-4d02-84bd-029ffda4c9e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:33.535789 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d419b-043f-4d02-84bd-029ffda4c9e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:33.537027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: WARNING py.warnings [None req-bb4d419b-043f-4d02-84bd-029ffda4c9e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:27:33.537027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: warnings.warn(msg) Aug 23 22:27:33.537027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: Aug 23 22:27:33.538774 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d419b-043f-4d02-84bd-029ffda4c9e5 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:33.613254 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 766/1543] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:27:33 2022] POST /identity/v3/projects => generated 403 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:27:33.618156 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67481279-403e-427d-8f67-f34870b560ed admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:33.634470 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67481279-403e-427d-8f67-f34870b560ed admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:33.745419 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b62268-6dcb-4b86-bfbc-4ef2453325dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:33.746208 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b62268-6dcb-4b86-bfbc-4ef2453325dc admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:33.746490 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b62268-6dcb-4b86-bfbc-4ef2453325dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:33.746793 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b62268-6dcb-4b86-bfbc-4ef2453325dc admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:33.747773 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b62268-6dcb-4b86-bfbc-4ef2453325dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:33.753226 dv-cinder-850321-4-smb devstack@keystone.service[81752]: WARNING py.warnings [None req-22b62268-6dcb-4b86-bfbc-4ef2453325dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:27:33.753226 dv-cinder-850321-4-smb devstack@keystone.service[81752]: warnings.warn(msg) Aug 23 22:27:33.753226 dv-cinder-850321-4-smb devstack@keystone.service[81752]: Aug 23 22:27:33.756027 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b62268-6dcb-4b86-bfbc-4ef2453325dc admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:33.789191 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ba971-3bf4-4343-9838-f5dd8342965e None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:33.790189 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ba971-3bf4-4343-9838-f5dd8342965e None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:33.791065 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ba971-3bf4-4343-9838-f5dd8342965e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:33.801413 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 778/1544] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:27:33 2022] POST /identity/v3/users => generated 302 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:27:33.804940 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b62268-6dcb-4b86-bfbc-4ef2453325dc admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:33.829408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b62268-6dcb-4b86-bfbc-4ef2453325dc admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:33.833695 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0181c3-3de7-4230-a8c8-39438debf9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:33.834408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0181c3-3de7-4230-a8c8-39438debf9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:33.834685 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0181c3-3de7-4230-a8c8-39438debf9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:33.835058 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0181c3-3de7-4230-a8c8-39438debf9b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:33.836353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0181c3-3de7-4230-a8c8-39438debf9b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:33.837635 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0181c3-3de7-4230-a8c8-39438debf9b6 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:33.851512 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-818ba971-3bf4-4343-9838-f5dd8342965e None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:33.854719 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-818ba971-3bf4-4343-9838-f5dd8342965e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:33.866875 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 779/1545] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:27:33.872983 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0181c3-3de7-4230-a8c8-39438debf9b6 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:33.900856 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 767/1546] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:33.910680 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1b9fe-96a7-4922-a6f5-0b081f2fae78 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:33.910958 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1b9fe-96a7-4922-a6f5-0b081f2fae78 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:33.911303 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1b9fe-96a7-4922-a6f5-0b081f2fae78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:33.918218 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0181c3-3de7-4230-a8c8-39438debf9b6 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:33.940506 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249928dc-38b4-4948-982b-f2f5efd61f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:33.941240 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249928dc-38b4-4948-982b-f2f5efd61f30 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:33.941554 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249928dc-38b4-4948-982b-f2f5efd61f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:33.941825 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249928dc-38b4-4948-982b-f2f5efd61f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:33.942491 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249928dc-38b4-4948-982b-f2f5efd61f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:33.944197 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249928dc-38b4-4948-982b-f2f5efd61f30 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:33.982106 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 780/1547] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:27:33.983270 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-30e1b9fe-96a7-4922-a6f5-0b081f2fae78 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:33.984619 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-30e1b9fe-96a7-4922-a6f5-0b081f2fae78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:33.993147 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249928dc-38b4-4948-982b-f2f5efd61f30 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:34.014174 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249928dc-38b4-4948-982b-f2f5efd61f30 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:34.020189 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 768/1548] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:34.025034 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1b9fe-96a7-4922-a6f5-0b081f2fae78 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:34.027539 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f663902-83c1-453e-a216-afc49cc7cd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:34.028250 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f663902-83c1-453e-a216-afc49cc7cd30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:34.028564 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f663902-83c1-453e-a216-afc49cc7cd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:34.028768 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f663902-83c1-453e-a216-afc49cc7cd30 admin admin] PATH_INFO: `/v3/projects/7fa8a6c6849a47458b2964353436c095/users/a6754d2c64054aac95ce60b7844bd46f/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:34.051864 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1b9fe-96a7-4922-a6f5-0b081f2fae78 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:34.059044 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f663902-83c1-453e-a216-afc49cc7cd30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fa8a6c6849a47458b2964353436c095, user_id=a6754d2c64054aac95ce60b7844bd46f, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:34.061827 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f663902-83c1-453e-a216-afc49cc7cd30 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:34.083862 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b30d55-8d4a-48cb-9aed-f93d59ffccef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:34.084677 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b30d55-8d4a-48cb-9aed-f93d59ffccef admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:34.085006 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b30d55-8d4a-48cb-9aed-f93d59ffccef admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:34.085327 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b30d55-8d4a-48cb-9aed-f93d59ffccef admin admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:34.086102 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b30d55-8d4a-48cb-9aed-f93d59ffccef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:27:34.086537 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b30d55-8d4a-48cb-9aed-f93d59ffccef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:34.088395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b30d55-8d4a-48cb-9aed-f93d59ffccef admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:34.094247 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 781/1549] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:27:33 2022] PUT /identity/v3/projects/7fa8a6c6849a47458b2964353436c095/users/a6754d2c64054aac95ce60b7844bd46f/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:27:34.134612 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 769/1550] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:27:34.150224 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e34bef-9a24-413a-878c-f03846eb4f21 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:34.150566 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e34bef-9a24-413a-878c-f03846eb4f21 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:34.150768 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e34bef-9a24-413a-878c-f03846eb4f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:34.155978 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b30d55-8d4a-48cb-9aed-f93d59ffccef admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:34.188741 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b30d55-8d4a-48cb-9aed-f93d59ffccef admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:34.238862 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-06e34bef-9a24-413a-878c-f03846eb4f21 None None] MFA Rules not processed for user `a6754d2c64054aac95ce60b7844bd46f`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:34.240162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-06e34bef-9a24-413a-878c-f03846eb4f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:34.408586 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 782/1551] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:34 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 23 22:27:34.414300 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59960f-f909-4307-93ea-a22bdc2b5d66 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:34.415104 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59960f-f909-4307-93ea-a22bdc2b5d66 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:34.415682 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59960f-f909-4307-93ea-a22bdc2b5d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:34.433071 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4688322-41d6-4fa1-b092-c52d06dbbfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:34.434583 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4688322-41d6-4fa1-b092-c52d06dbbfc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:34.435052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4688322-41d6-4fa1-b092-c52d06dbbfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:34.435499 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4688322-41d6-4fa1-b092-c52d06dbbfc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:34.436610 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4688322-41d6-4fa1-b092-c52d06dbbfc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:34.440922 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4688322-41d6-4fa1-b092-c52d06dbbfc4 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:34.475664 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-ec59960f-f909-4307-93ea-a22bdc2b5d66 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:34.477996 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-ec59960f-f909-4307-93ea-a22bdc2b5d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:34.505545 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 783/1552] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:34.508992 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8bade-4dd1-42bb-bf00-e0be9f19d1d3 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:34.509857 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8bade-4dd1-42bb-bf00-e0be9f19d1d3 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:34.510420 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8bade-4dd1-42bb-bf00-e0be9f19d1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:34.534718 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 770/1553] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:27:34 2022] POST /identity/v3/projects => generated 365 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:27:34.536227 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4688322-41d6-4fa1-b092-c52d06dbbfc4 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:34.542557 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:34.553860 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-b7b8bade-4dd1-42bb-bf00-e0be9f19d1d3 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:34.557532 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-b7b8bade-4dd1-42bb-bf00-e0be9f19d1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:34.660866 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4688322-41d6-4fa1-b092-c52d06dbbfc4 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:34.666726 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea1f58-b64c-41c1-8ba8-245a0f87ad65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:34.667803 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea1f58-b64c-41c1-8ba8-245a0f87ad65 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:34.668273 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea1f58-b64c-41c1-8ba8-245a0f87ad65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:34.668697 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea1f58-b64c-41c1-8ba8-245a0f87ad65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:34.669633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea1f58-b64c-41c1-8ba8-245a0f87ad65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:34.672029 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea1f58-b64c-41c1-8ba8-245a0f87ad65 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:34.680825 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 784/1554] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:34.683208 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755641f0-1288-4d19-8196-16ebcbd7b452 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:34.683848 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755641f0-1288-4d19-8196-16ebcbd7b452 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:34.684351 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755641f0-1288-4d19-8196-16ebcbd7b452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:34.719515 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-755641f0-1288-4d19-8196-16ebcbd7b452 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:34.722283 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-755641f0-1288-4d19-8196-16ebcbd7b452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:34.731218 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 771/1555] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:27:34 2022] POST /identity/v3/projects => generated 405 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:27:34.731218 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d79c43-01aa-4b3c-963e-7ca51b5832a8 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:34.731218 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d79c43-01aa-4b3c-963e-7ca51b5832a8 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:34.731218 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d79c43-01aa-4b3c-963e-7ca51b5832a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:34.762598 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:34.774584 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-c8d79c43-01aa-4b3c-963e-7ca51b5832a8 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:34.776089 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-c8d79c43-01aa-4b3c-963e-7ca51b5832a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:34.835543 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 785/1556] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:34.838038 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f5f30-ce30-4f52-bada-d09512b5f0c5 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:34.838421 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f5f30-ce30-4f52-bada-d09512b5f0c5 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:34.838913 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f5f30-ce30-4f52-bada-d09512b5f0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:34.859817 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 772/1557] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:34.861940 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d79c43-01aa-4b3c-963e-7ca51b5832a8 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:34.873325 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-f45f5f30-ce30-4f52-bada-d09512b5f0c5 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:34.875037 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-f45f5f30-ce30-4f52-bada-d09512b5f0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:34.875326 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d79c43-01aa-4b3c-963e-7ca51b5832a8 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:34.883894 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8be169-88bd-4f75-97d2-21b95eed69fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:34.884942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8be169-88bd-4f75-97d2-21b95eed69fe admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:34.885477 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 786/1558] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:34.885635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8be169-88bd-4f75-97d2-21b95eed69fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:34.886098 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8be169-88bd-4f75-97d2-21b95eed69fe admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:34.886795 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1eb32-3024-4914-bcd5-aa360d19e969 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:34.887084 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1eb32-3024-4914-bcd5-aa360d19e969 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:34.887281 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8be169-88bd-4f75-97d2-21b95eed69fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:34.887388 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1eb32-3024-4914-bcd5-aa360d19e969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:34.891150 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8be169-88bd-4f75-97d2-21b95eed69fe admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:34.913600 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-06c1eb32-3024-4914-bcd5-aa360d19e969 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:34.915905 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-06c1eb32-3024-4914-bcd5-aa360d19e969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:34.925470 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 773/1559] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:27:34 2022] POST /identity/v3/users => generated 283 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:27:34.926891 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576885d-1775-4d5b-bef9-39dc3466e78b None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:34.927186 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576885d-1775-4d5b-bef9-39dc3466e78b None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:34.927466 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576885d-1775-4d5b-bef9-39dc3466e78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:34.933426 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 787/1560] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:34.935841 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c09536-da52-403b-b322-2064473ee635 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:34.936365 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c09536-da52-403b-b322-2064473ee635 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:34.936838 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c09536-da52-403b-b322-2064473ee635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:34.953345 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-5576885d-1775-4d5b-bef9-39dc3466e78b None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:34.954658 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-5576885d-1775-4d5b-bef9-39dc3466e78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:34.963717 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 774/1561] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:34.964689 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576885d-1775-4d5b-bef9-39dc3466e78b None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:34.973317 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-a6c09536-da52-403b-b322-2064473ee635 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:34.975584 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-a6c09536-da52-403b-b322-2064473ee635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:34.980588 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576885d-1775-4d5b-bef9-39dc3466e78b None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:34.987168 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db79d0-1a9d-419e-a57e-6c00895f2379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:34.987821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db79d0-1a9d-419e-a57e-6c00895f2379 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:34.988112 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db79d0-1a9d-419e-a57e-6c00895f2379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:34.988391 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db79d0-1a9d-419e-a57e-6c00895f2379 admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:34.989044 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db79d0-1a9d-419e-a57e-6c00895f2379 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:34.991157 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db79d0-1a9d-419e-a57e-6c00895f2379 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:34.991387 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 788/1562] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:34.995223 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca2335-b475-4f12-95a6-03985a276384 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:34.995689 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca2335-b475-4f12-95a6-03985a276384 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:34.996192 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca2335-b475-4f12-95a6-03985a276384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:35.019139 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 775/1563] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:27:34 2022] POST /identity/v3/users => generated 309 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:27:35.020253 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db79d0-1a9d-419e-a57e-6c00895f2379 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:35.031752 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-baca2335-b475-4f12-95a6-03985a276384 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:35.032794 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db79d0-1a9d-419e-a57e-6c00895f2379 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:35.033570 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-baca2335-b475-4f12-95a6-03985a276384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:35.038597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1625693e-2009-4f4f-a41e-7976f8082dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:35.039416 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625693e-2009-4f4f-a41e-7976f8082dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:35.039698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625693e-2009-4f4f-a41e-7976f8082dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:35.040062 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625693e-2009-4f4f-a41e-7976f8082dd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:35.041167 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1625693e-2009-4f4f-a41e-7976f8082dd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:27:35.041725 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1625693e-2009-4f4f-a41e-7976f8082dd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:35.042592 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 789/1564] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:35.044850 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1625693e-2009-4f4f-a41e-7976f8082dd8 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:35.045353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d8f44-8f79-4f49-85eb-79a8def00a5f None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:35.045831 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d8f44-8f79-4f49-85eb-79a8def00a5f None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:35.046358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d8f44-8f79-4f49-85eb-79a8def00a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:35.068765 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 776/1565] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:27:35.072245 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1625693e-2009-4f4f-a41e-7976f8082dd8 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:35.081063 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-3a7d8f44-8f79-4f49-85eb-79a8def00a5f None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:35.082942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-3a7d8f44-8f79-4f49-85eb-79a8def00a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:35.089710 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1625693e-2009-4f4f-a41e-7976f8082dd8 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:35.094002 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 790/1566] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:35.096516 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdcff9-dd1d-43f3-bc74-0005cdb66d6e None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:35.096943 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdcff9-dd1d-43f3-bc74-0005cdb66d6e None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:35.097327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdcff9-dd1d-43f3-bc74-0005cdb66d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:35.099681 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcaa95b-556b-4a00-b0ac-424a0f81b72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:35.100608 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcaa95b-556b-4a00-b0ac-424a0f81b72e admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:35.101012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcaa95b-556b-4a00-b0ac-424a0f81b72e admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:35.101419 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcaa95b-556b-4a00-b0ac-424a0f81b72e admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:35.102560 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcaa95b-556b-4a00-b0ac-424a0f81b72e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:35.104264 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcaa95b-556b-4a00-b0ac-424a0f81b72e admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:35.119485 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 777/1567] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:27:35.121905 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fd71f-a69a-4e0f-9456-955f4b184f8c None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:35.123143 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fd71f-a69a-4e0f-9456-955f4b184f8c None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:35.123668 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fd71f-a69a-4e0f-9456-955f4b184f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:35.126553 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-3dbdcff9-dd1d-43f3-bc74-0005cdb66d6e None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:35.128078 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-3dbdcff9-dd1d-43f3-bc74-0005cdb66d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:35.148857 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 791/1568] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:35.149785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-987fd71f-a69a-4e0f-9456-955f4b184f8c None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:35.150945 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbdcff9-dd1d-43f3-bc74-0005cdb66d6e None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:35.151414 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-987fd71f-a69a-4e0f-9456-955f4b184f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:35.162689 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 778/1569] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:35.163938 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987fd71f-a69a-4e0f-9456-955f4b184f8c None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:35.171676 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbdcff9-dd1d-43f3-bc74-0005cdb66d6e None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:35.177829 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987fd71f-a69a-4e0f-9456-955f4b184f8c None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:35.178906 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a61da-d95c-4596-a6eb-d94fcd68d588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:35.179864 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a61da-d95c-4596-a6eb-d94fcd68d588 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:35.180151 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a61da-d95c-4596-a6eb-d94fcd68d588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:35.180580 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a61da-d95c-4596-a6eb-d94fcd68d588 admin admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:35.181635 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a61da-d95c-4596-a6eb-d94fcd68d588 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:27:35.182025 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a61da-d95c-4596-a6eb-d94fcd68d588 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:35.184093 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a61da-d95c-4596-a6eb-d94fcd68d588 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:35.184354 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b22ba7-ea30-40bc-b13b-062d14afeb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:35.184953 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b22ba7-ea30-40bc-b13b-062d14afeb2a admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:35.185237 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b22ba7-ea30-40bc-b13b-062d14afeb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:35.185561 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b22ba7-ea30-40bc-b13b-062d14afeb2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:35.186327 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b22ba7-ea30-40bc-b13b-062d14afeb2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:35.188121 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b22ba7-ea30-40bc-b13b-062d14afeb2a admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:35.202796 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 779/1570] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:27:35.203906 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b22ba7-ea30-40bc-b13b-062d14afeb2a admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:35.205731 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 792/1571] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:27:35.206767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a61da-d95c-4596-a6eb-d94fcd68d588 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:35.221677 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a61da-d95c-4596-a6eb-d94fcd68d588 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:35.227660 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1086716-bf00-4e6c-a218-a325126fcb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:35.228449 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1086716-bf00-4e6c-a218-a325126fcb30 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:35.228915 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1086716-bf00-4e6c-a218-a325126fcb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:35.229429 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1086716-bf00-4e6c-a218-a325126fcb30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:35.230344 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1086716-bf00-4e6c-a218-a325126fcb30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:35.232178 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b22ba7-ea30-40bc-b13b-062d14afeb2a admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:35.232555 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1086716-bf00-4e6c-a218-a325126fcb30 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:35.239700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c2285-2e96-4601-a673-e490a2cad62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:35.240503 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c2285-2e96-4601-a673-e490a2cad62c admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:35.240794 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c2285-2e96-4601-a673-e490a2cad62c admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:35.241074 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c2285-2e96-4601-a673-e490a2cad62c admin admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:35.241784 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c2285-2e96-4601-a673-e490a2cad62c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:27:35.242139 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c2285-2e96-4601-a673-e490a2cad62c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:35.243792 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c2285-2e96-4601-a673-e490a2cad62c admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:35.261510 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 780/1572] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:27:35.263251 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c2285-2e96-4601-a673-e490a2cad62c admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:35.280061 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c2285-2e96-4601-a673-e490a2cad62c admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:35.281534 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 793/1573] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:27:35 2022] POST /identity/v3/projects => generated 379 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:27:35.283960 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1086716-bf00-4e6c-a218-a325126fcb30 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:35.339458 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:35.398202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1086716-bf00-4e6c-a218-a325126fcb30 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:35.398846 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264733f-d9d2-4c81-a9cf-2f9e62f36f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:35.400009 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264733f-d9d2-4c81-a9cf-2f9e62f36f25 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:35.400514 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264733f-d9d2-4c81-a9cf-2f9e62f36f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:35.401020 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264733f-d9d2-4c81-a9cf-2f9e62f36f25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:35.402297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264733f-d9d2-4c81-a9cf-2f9e62f36f25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:27:35.403045 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264733f-d9d2-4c81-a9cf-2f9e62f36f25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:35.406377 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264733f-d9d2-4c81-a9cf-2f9e62f36f25 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:35.408321 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d21d4-6966-422a-b3d0-4ab25dd7159c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:35.409739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d21d4-6966-422a-b3d0-4ab25dd7159c admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:35.410611 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d21d4-6966-422a-b3d0-4ab25dd7159c admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:35.410798 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d21d4-6966-422a-b3d0-4ab25dd7159c admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:35.411999 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d21d4-6966-422a-b3d0-4ab25dd7159c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:35.415547 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d21d4-6966-422a-b3d0-4ab25dd7159c admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:35.441172 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 781/1574] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:27:35.441172 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264733f-d9d2-4c81-a9cf-2f9e62f36f25 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:35.441869 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 794/1575] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:27:35.442743 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d21d4-6966-422a-b3d0-4ab25dd7159c admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:35.451427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:35.460496 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264733f-d9d2-4c81-a9cf-2f9e62f36f25 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:35.463039 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d21d4-6966-422a-b3d0-4ab25dd7159c admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:35.469854 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5e3d5-a938-442d-b8bc-fd04661bcc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:35.471496 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5e3d5-a938-442d-b8bc-fd04661bcc74 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:35.472060 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5e3d5-a938-442d-b8bc-fd04661bcc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:35.472255 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc06f5f-27cb-47c9-9699-6358f639b3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:35.472468 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5e3d5-a938-442d-b8bc-fd04661bcc74 admin admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:35.473031 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5e3d5-a938-442d-b8bc-fd04661bcc74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:27:35.473301 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc06f5f-27cb-47c9-9699-6358f639b3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:35.473579 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5e3d5-a938-442d-b8bc-fd04661bcc74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:35.473870 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc06f5f-27cb-47c9-9699-6358f639b3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:35.474351 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc06f5f-27cb-47c9-9699-6358f639b3f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:35.475211 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5e3d5-a938-442d-b8bc-fd04661bcc74 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:35.475576 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc06f5f-27cb-47c9-9699-6358f639b3f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:27:35.476114 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc06f5f-27cb-47c9-9699-6358f639b3f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:35.479368 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc06f5f-27cb-47c9-9699-6358f639b3f8 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:35.491533 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 782/1576] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:27:35.492452 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5e3d5-a938-442d-b8bc-fd04661bcc74 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:35.506608 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 795/1577] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:27:35.507664 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc06f5f-27cb-47c9-9699-6358f639b3f8 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:35.510894 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5e3d5-a938-442d-b8bc-fd04661bcc74 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:35.520270 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504630f-1359-43e4-adca-e91f597f1f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:35.521293 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc06f5f-27cb-47c9-9699-6358f639b3f8 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:35.521561 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504630f-1359-43e4-adca-e91f597f1f7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:35.522090 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504630f-1359-43e4-adca-e91f597f1f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:35.522594 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504630f-1359-43e4-adca-e91f597f1f7b admin admin] PATH_INFO: `/v3/projects/879d579523934c009d0f0c4cc7db6e07/users/6bf940bd33f34018ab0d61ec3afcee9e/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:35.530373 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ae8a9-44bf-4b83-8b04-0f43981f4dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:35.531251 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ae8a9-44bf-4b83-8b04-0f43981f4dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:35.531567 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ae8a9-44bf-4b83-8b04-0f43981f4dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:35.531977 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ae8a9-44bf-4b83-8b04-0f43981f4dc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:35.533856 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ae8a9-44bf-4b83-8b04-0f43981f4dc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:35.536251 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ae8a9-44bf-4b83-8b04-0f43981f4dc0 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:35.552840 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504630f-1359-43e4-adca-e91f597f1f7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=879d579523934c009d0f0c4cc7db6e07, user_id=6bf940bd33f34018ab0d61ec3afcee9e, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:35.555042 dv-cinder-850321-4-smb devstack@keystone.service[81751]: WARNING py.warnings [None req-6504630f-1359-43e4-adca-e91f597f1f7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:27:35.555042 dv-cinder-850321-4-smb devstack@keystone.service[81751]: warnings.warn(msg) Aug 23 22:27:35.555042 dv-cinder-850321-4-smb devstack@keystone.service[81751]: Aug 23 22:27:35.559104 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504630f-1359-43e4-adca-e91f597f1f7b admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:35.585806 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 783/1578] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:27:35 2022] PUT /identity/v3/projects/879d579523934c009d0f0c4cc7db6e07/users/6bf940bd33f34018ab0d61ec3afcee9e/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:27:35.586214 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 796/1579] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:27:35 2022] POST /identity/v3/projects => generated 387 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:27:35.586701 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504630f-1359-43e4-adca-e91f597f1f7b admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:35.588804 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ae8a9-44bf-4b83-8b04-0f43981f4dc0 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:35.709526 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ae8a9-44bf-4b83-8b04-0f43981f4dc0 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:35.714849 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e5725-49fa-4232-9233-002ff33480a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:35.715570 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e5725-49fa-4232-9233-002ff33480a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:35.715859 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e5725-49fa-4232-9233-002ff33480a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:35.716139 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e5725-49fa-4232-9233-002ff33480a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:35.716912 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e5725-49fa-4232-9233-002ff33480a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:35.719558 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504630f-1359-43e4-adca-e91f597f1f7b admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:35.719921 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e5725-49fa-4232-9233-002ff33480a4 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:35.725504 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470dd08-df56-4062-9303-bc9c47951366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:35.726391 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470dd08-df56-4062-9303-bc9c47951366 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:35.727045 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470dd08-df56-4062-9303-bc9c47951366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:35.727379 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470dd08-df56-4062-9303-bc9c47951366 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:35.728184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470dd08-df56-4062-9303-bc9c47951366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:35.730350 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470dd08-df56-4062-9303-bc9c47951366 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:35.756726 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 797/1580] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:27:35 2022] POST /identity/v3/users => generated 290 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:27:35.758592 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e5725-49fa-4232-9233-002ff33480a4 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:35.776909 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e5725-49fa-4232-9233-002ff33480a4 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:35.780909 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 784/1581] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:27:35 2022] POST /identity/v3/projects => generated 383 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:27:35.781966 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470dd08-df56-4062-9303-bc9c47951366 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:35.788627 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48e8a6-a2df-4bcd-a056-34ff78c85773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:35.789810 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48e8a6-a2df-4bcd-a056-34ff78c85773 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:35.790302 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48e8a6-a2df-4bcd-a056-34ff78c85773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:35.790653 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48e8a6-a2df-4bcd-a056-34ff78c85773 admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:35.791379 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48e8a6-a2df-4bcd-a056-34ff78c85773 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:35.793720 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48e8a6-a2df-4bcd-a056-34ff78c85773 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:35.834366 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 798/1582] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:27:35 2022] POST /identity/v3/projects => generated 369 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:27:35.835631 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48e8a6-a2df-4bcd-a056-34ff78c85773 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:35.894667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470dd08-df56-4062-9303-bc9c47951366 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:35.954175 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48e8a6-a2df-4bcd-a056-34ff78c85773 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:35.963779 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75802709-a046-4126-9877-d1871ed9b47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:35.964866 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75802709-a046-4126-9877-d1871ed9b47e admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:35.965353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75802709-a046-4126-9877-d1871ed9b47e admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:35.965891 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75802709-a046-4126-9877-d1871ed9b47e admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:35.967137 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75802709-a046-4126-9877-d1871ed9b47e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:35.971152 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75802709-a046-4126-9877-d1871ed9b47e admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:35.982740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:36.021881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573f201-5e55-4d2b-9dc7-b17309abdca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:36.023165 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573f201-5e55-4d2b-9dc7-b17309abdca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:36.023697 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573f201-5e55-4d2b-9dc7-b17309abdca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:36.024279 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573f201-5e55-4d2b-9dc7-b17309abdca1 admin admin] PATH_INFO: `/v3/projects/8c575bf150244d2f94f08642497b559f/users/94743715df794202a31ee31187e1d41e/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:36.028744 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:36.039682 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 799/1583] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:27:35 2022] POST /identity/v3/projects => generated 377 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:27:36.039682 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75802709-a046-4126-9877-d1871ed9b47e admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:36.058259 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f573f201-5e55-4d2b-9dc7-b17309abdca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c575bf150244d2f94f08642497b559f, user_id=94743715df794202a31ee31187e1d41e, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:36.065315 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f573f201-5e55-4d2b-9dc7-b17309abdca1 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:36.090058 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 785/1584] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:27:35 2022] PUT /identity/v3/projects/8c575bf150244d2f94f08642497b559f/users/94743715df794202a31ee31187e1d41e/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:27:36.091738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573f201-5e55-4d2b-9dc7-b17309abdca1 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:36.188409 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75802709-a046-4126-9877-d1871ed9b47e admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:36.236576 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573f201-5e55-4d2b-9dc7-b17309abdca1 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:36.246269 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca17982-9427-4930-89fb-81cb562dd99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:36.248010 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca17982-9427-4930-89fb-81cb562dd99f admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:36.248420 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca17982-9427-4930-89fb-81cb562dd99f admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:36.249119 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca17982-9427-4930-89fb-81cb562dd99f admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:36.250407 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca17982-9427-4930-89fb-81cb562dd99f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:36.254738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca17982-9427-4930-89fb-81cb562dd99f admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:36.296744 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 786/1585] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:27:36 2022] POST /identity/v3/users => generated 294 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:27:36.299258 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca17982-9427-4930-89fb-81cb562dd99f admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:36.310364 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca17982-9427-4930-89fb-81cb562dd99f admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:36.312929 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313a67b-5b22-4b2f-86c0-e653444dd91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:36.314274 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313a67b-5b22-4b2f-86c0-e653444dd91b admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:36.314938 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313a67b-5b22-4b2f-86c0-e653444dd91b admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:36.315465 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313a67b-5b22-4b2f-86c0-e653444dd91b admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:36.316564 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad6b4c-d94e-4797-9e91-61b733964357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:36.316835 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313a67b-5b22-4b2f-86c0-e653444dd91b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:36.318425 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad6b4c-d94e-4797-9e91-61b733964357 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:36.318965 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad6b4c-d94e-4797-9e91-61b733964357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:36.319486 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad6b4c-d94e-4797-9e91-61b733964357 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:36.320815 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad6b4c-d94e-4797-9e91-61b733964357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:36.321659 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313a67b-5b22-4b2f-86c0-e653444dd91b admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:36.323997 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad6b4c-d94e-4797-9e91-61b733964357 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:36.344706 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 787/1586] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:27:36.351252 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad6b4c-d94e-4797-9e91-61b733964357 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:36.368290 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad6b4c-d94e-4797-9e91-61b733964357 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:36.371158 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 800/1587] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:27:36 2022] POST /identity/v3/projects => generated 393 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:27:36.377577 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313a67b-5b22-4b2f-86c0-e653444dd91b admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:36.483335 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4330c-2bbf-4481-9791-1c77a9e7ecd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:36.484736 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4330c-2bbf-4481-9791-1c77a9e7ecd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:36.485240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4330c-2bbf-4481-9791-1c77a9e7ecd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:36.485907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4330c-2bbf-4481-9791-1c77a9e7ecd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:36.487131 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4330c-2bbf-4481-9791-1c77a9e7ecd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:36.489255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4330c-2bbf-4481-9791-1c77a9e7ecd9 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:36.494020 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313a67b-5b22-4b2f-86c0-e653444dd91b admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:36.503303 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50e451-840e-4a2a-867f-cba6b39f6f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:36.504382 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50e451-840e-4a2a-867f-cba6b39f6f81 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:36.504811 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50e451-840e-4a2a-867f-cba6b39f6f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:36.505012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 788/1588] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:27:36.506129 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4330c-2bbf-4481-9791-1c77a9e7ecd9 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:36.510921 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50e451-840e-4a2a-867f-cba6b39f6f81 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:36.511282 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50e451-840e-4a2a-867f-cba6b39f6f81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:36.515117 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50e451-840e-4a2a-867f-cba6b39f6f81 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:36.524559 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4330c-2bbf-4481-9791-1c77a9e7ecd9 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:36.533773 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af290960-54e5-471b-b01d-0d22c6de46f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:36.534842 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af290960-54e5-471b-b01d-0d22c6de46f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:36.535345 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af290960-54e5-471b-b01d-0d22c6de46f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:36.535826 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af290960-54e5-471b-b01d-0d22c6de46f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:36.537055 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af290960-54e5-471b-b01d-0d22c6de46f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:36.541150 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af290960-54e5-471b-b01d-0d22c6de46f7 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:36.577443 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 801/1589] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:27:36 2022] POST /identity/v3/users => generated 292 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:27:36.578777 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50e451-840e-4a2a-867f-cba6b39f6f81 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:36.591406 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 789/1590] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:27:36 2022] POST /identity/v3/users => generated 285 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:27:36.593629 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f9c62-40bd-4b51-8b8f-9b9753cff46d None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:36.594088 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f9c62-40bd-4b51-8b8f-9b9753cff46d None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:36.594605 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f9c62-40bd-4b51-8b8f-9b9753cff46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:36.598791 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50e451-840e-4a2a-867f-cba6b39f6f81 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:36.604898 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b68d56-7b31-4e1b-915f-dea73785d996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:36.606846 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b68d56-7b31-4e1b-915f-dea73785d996 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:36.607253 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b68d56-7b31-4e1b-915f-dea73785d996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:36.607658 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b68d56-7b31-4e1b-915f-dea73785d996 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:36.608716 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b68d56-7b31-4e1b-915f-dea73785d996 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:36.612972 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b68d56-7b31-4e1b-915f-dea73785d996 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:36.624991 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:36.647006 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-605f9c62-40bd-4b51-8b8f-9b9753cff46d None None] MFA Rules not processed for user `94743715df794202a31ee31187e1d41e`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:36.649283 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-605f9c62-40bd-4b51-8b8f-9b9753cff46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:36.651125 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 802/1591] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:27:36 2022] POST /identity/v3/users => generated 289 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:27:36.652586 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b68d56-7b31-4e1b-915f-dea73785d996 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:36.670113 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b68d56-7b31-4e1b-915f-dea73785d996 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:36.679216 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec347129-4642-42e9-8c03-327761a524aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:36.680225 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec347129-4642-42e9-8c03-327761a524aa admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:36.680659 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec347129-4642-42e9-8c03-327761a524aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:36.681094 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec347129-4642-42e9-8c03-327761a524aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:36.681978 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec347129-4642-42e9-8c03-327761a524aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:36.684037 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec347129-4642-42e9-8c03-327761a524aa admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:36.698501 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 803/1592] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:27:36.699678 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec347129-4642-42e9-8c03-327761a524aa admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:36.713619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec347129-4642-42e9-8c03-327761a524aa admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:36.715269 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:36.721806 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc562ca-92f6-4475-9168-99ee898a2f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:36.722892 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc562ca-92f6-4475-9168-99ee898a2f78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:36.723520 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc562ca-92f6-4475-9168-99ee898a2f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:36.723733 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc562ca-92f6-4475-9168-99ee898a2f78 admin admin] PATH_INFO: `/v3/projects/879d579523934c009d0f0c4cc7db6e07/users/6bf940bd33f34018ab0d61ec3afcee9e/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:36.726966 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc562ca-92f6-4475-9168-99ee898a2f78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=879d579523934c009d0f0c4cc7db6e07, user_id=6bf940bd33f34018ab0d61ec3afcee9e, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:36.730520 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc562ca-92f6-4475-9168-99ee898a2f78 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:36.760153 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 804/1593] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:27:36 2022] PUT /identity/v3/projects/879d579523934c009d0f0c4cc7db6e07/users/6bf940bd33f34018ab0d61ec3afcee9e/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:27:36.761659 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc562ca-92f6-4475-9168-99ee898a2f78 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:36.802137 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 790/1594] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:36.804068 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f9c62-40bd-4b51-8b8f-9b9753cff46d None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:36.826275 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f9c62-40bd-4b51-8b8f-9b9753cff46d None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:36.897154 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc562ca-92f6-4475-9168-99ee898a2f78 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:36.906284 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccba7ab-e05f-4524-820b-74b260c4d675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:36.907924 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccba7ab-e05f-4524-820b-74b260c4d675 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:36.908512 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccba7ab-e05f-4524-820b-74b260c4d675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:36.909070 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccba7ab-e05f-4524-820b-74b260c4d675 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:36.910350 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccba7ab-e05f-4524-820b-74b260c4d675 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:36.914388 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccba7ab-e05f-4524-820b-74b260c4d675 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:36.943149 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978cd532-7631-415c-80e9-438faae11e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:36.944272 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cd532-7631-415c-80e9-438faae11e1d admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:36.944996 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cd532-7631-415c-80e9-438faae11e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:36.945526 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cd532-7631-415c-80e9-438faae11e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:36.946813 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978cd532-7631-415c-80e9-438faae11e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:36.949592 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978cd532-7631-415c-80e9-438faae11e1d admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:36.964920 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 805/1595] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:27:36 2022] POST /identity/v3/users => generated 297 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:27:36.966372 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccba7ab-e05f-4524-820b-74b260c4d675 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:36.979024 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 791/1596] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:27:36.984537 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978cd532-7631-415c-80e9-438faae11e1d admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:36.987740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccba7ab-e05f-4524-820b-74b260c4d675 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:36.995906 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626a298-c8e7-42d0-9cc0-8e31d9821d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:36.996777 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626a298-c8e7-42d0-9cc0-8e31d9821d64 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:36.997242 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626a298-c8e7-42d0-9cc0-8e31d9821d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:36.997694 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626a298-c8e7-42d0-9cc0-8e31d9821d64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:36.998810 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626a298-c8e7-42d0-9cc0-8e31d9821d64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:37.003158 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626a298-c8e7-42d0-9cc0-8e31d9821d64 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:37.003654 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978cd532-7631-415c-80e9-438faae11e1d admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:37.014321 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed5a46-e31d-4a8f-9eea-1bf11a4ccbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:37.015398 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed5a46-e31d-4a8f-9eea-1bf11a4ccbc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:37.015883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed5a46-e31d-4a8f-9eea-1bf11a4ccbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:37.016313 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed5a46-e31d-4a8f-9eea-1bf11a4ccbc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:37.018269 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed5a46-e31d-4a8f-9eea-1bf11a4ccbc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:37.021870 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed5a46-e31d-4a8f-9eea-1bf11a4ccbc7 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:37.027555 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 806/1597] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:27:37.027555 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626a298-c8e7-42d0-9cc0-8e31d9821d64 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:37.044971 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 792/1598] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:27:37.044971 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed5a46-e31d-4a8f-9eea-1bf11a4ccbc7 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:37.051694 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626a298-c8e7-42d0-9cc0-8e31d9821d64 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:37.061063 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a6dd2-a171-458b-b096-6304e2d092cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:37.062439 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a6dd2-a171-458b-b096-6304e2d092cc admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:37.063128 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a6dd2-a171-458b-b096-6304e2d092cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:37.064015 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a6dd2-a171-458b-b096-6304e2d092cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:37.065635 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a6dd2-a171-458b-b096-6304e2d092cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:37.066576 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed5a46-e31d-4a8f-9eea-1bf11a4ccbc7 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:37.069133 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a6dd2-a171-458b-b096-6304e2d092cc admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:37.074944 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b68fb7-6362-401e-bcae-f1c2d8cae2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:37.076323 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b68fb7-6362-401e-bcae-f1c2d8cae2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:37.076883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b68fb7-6362-401e-bcae-f1c2d8cae2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:37.077532 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b68fb7-6362-401e-bcae-f1c2d8cae2a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:37.078848 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b68fb7-6362-401e-bcae-f1c2d8cae2a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:37.083379 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b68fb7-6362-401e-bcae-f1c2d8cae2a1 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:37.093709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 807/1599] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:27:37.097063 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95381a3f-8f67-4621-bc22-f8a3f8b390c3 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:37.098571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95381a3f-8f67-4621-bc22-f8a3f8b390c3 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:37.099716 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95381a3f-8f67-4621-bc22-f8a3f8b390c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:37.109618 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 793/1600] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:27:37.111506 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b68fb7-6362-401e-bcae-f1c2d8cae2a1 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:37.157458 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-95381a3f-8f67-4621-bc22-f8a3f8b390c3 None None] MFA Rules not processed for user `6bf940bd33f34018ab0d61ec3afcee9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:37.160687 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-95381a3f-8f67-4621-bc22-f8a3f8b390c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:37.229192 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b68fb7-6362-401e-bcae-f1c2d8cae2a1 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:37.236886 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b038e9-2d78-442a-8ad1-38053967dada service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:37.238059 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b038e9-2d78-442a-8ad1-38053967dada service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:37.238821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b038e9-2d78-442a-8ad1-38053967dada service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:37.239347 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b038e9-2d78-442a-8ad1-38053967dada service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:37.318654 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 808/1601] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:37 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:37.318654 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95381a3f-8f67-4621-bc22-f8a3f8b390c3 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:37.343368 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95381a3f-8f67-4621-bc22-f8a3f8b390c3 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:37.356460 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01143a17-cae3-43a2-90cb-793208e7b005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:37.357674 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01143a17-cae3-43a2-90cb-793208e7b005 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:37.358174 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01143a17-cae3-43a2-90cb-793208e7b005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:37.358694 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01143a17-cae3-43a2-90cb-793208e7b005 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:37.359931 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01143a17-cae3-43a2-90cb-793208e7b005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:37.362854 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01143a17-cae3-43a2-90cb-793208e7b005 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:37.377909 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 809/1602] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:27:37.378297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b038e9-2d78-442a-8ad1-38053967dada service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:37.379000 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01143a17-cae3-43a2-90cb-793208e7b005 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:37.381260 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b038e9-2d78-442a-8ad1-38053967dada service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:37.388422 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:37.395176 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01143a17-cae3-43a2-90cb-793208e7b005 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:37.402263 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 794/1603] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:27:37.403933 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2656a-b840-4f65-9f0b-e0df30fd9e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:37.404259 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b038e9-2d78-442a-8ad1-38053967dada service cinder] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:37.405682 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2656a-b840-4f65-9f0b-e0df30fd9e8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:37.406522 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2656a-b840-4f65-9f0b-e0df30fd9e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:37.407130 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2656a-b840-4f65-9f0b-e0df30fd9e8e admin admin] PATH_INFO: `/v3/projects/d874153bdbff4a4db275deabdf712b2a/users/081aba900bfd4ace9e9f49daf8d941a0/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:37.425242 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:37.428019 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b038e9-2d78-442a-8ad1-38053967dada service cinder] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:37.437991 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa7194-fbdc-400e-b574-6caad18d698f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:37.439727 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa7194-fbdc-400e-b574-6caad18d698f admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:37.439727 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa7194-fbdc-400e-b574-6caad18d698f admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:37.440174 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa7194-fbdc-400e-b574-6caad18d698f admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:37.441444 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa7194-fbdc-400e-b574-6caad18d698f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:37.444678 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa7194-fbdc-400e-b574-6caad18d698f admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:37.453824 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2656a-b840-4f65-9f0b-e0df30fd9e8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d874153bdbff4a4db275deabdf712b2a, user_id=081aba900bfd4ace9e9f49daf8d941a0, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:37.462626 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2656a-b840-4f65-9f0b-e0df30fd9e8e admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:37.467013 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 795/1604] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:27:37.468724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa7194-fbdc-400e-b574-6caad18d698f admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:37.489648 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 810/1605] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:27:37 2022] PUT /identity/v3/projects/d874153bdbff4a4db275deabdf712b2a/users/081aba900bfd4ace9e9f49daf8d941a0/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:27:37.491214 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2656a-b840-4f65-9f0b-e0df30fd9e8e admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:37.498182 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa7194-fbdc-400e-b574-6caad18d698f admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:37.618781 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2656a-b840-4f65-9f0b-e0df30fd9e8e admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:37.627425 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef04f7-3e0d-4e91-8827-367581523908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:37.628527 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef04f7-3e0d-4e91-8827-367581523908 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:37.629048 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef04f7-3e0d-4e91-8827-367581523908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:37.629680 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef04f7-3e0d-4e91-8827-367581523908 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:37.630098 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e7314-3d3a-4d08-90c6-13588896552b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:37.631094 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef04f7-3e0d-4e91-8827-367581523908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:37.631293 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e7314-3d3a-4d08-90c6-13588896552b admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:37.631709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e7314-3d3a-4d08-90c6-13588896552b admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:37.632221 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e7314-3d3a-4d08-90c6-13588896552b admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:37.633586 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e7314-3d3a-4d08-90c6-13588896552b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:37.634445 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef04f7-3e0d-4e91-8827-367581523908 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:37.637050 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e7314-3d3a-4d08-90c6-13588896552b admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:37.652469 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 796/1606] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:27:37.655388 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef04f7-3e0d-4e91-8827-367581523908 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:37.666899 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 811/1607] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:27:37.668692 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e7314-3d3a-4d08-90c6-13588896552b admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:37.677456 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef04f7-3e0d-4e91-8827-367581523908 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:37.691024 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9006f-98a0-4261-92bd-5d55d8ce20ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:37.693009 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9006f-98a0-4261-92bd-5d55d8ce20ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:37.694334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9006f-98a0-4261-92bd-5d55d8ce20ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:37.695120 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9006f-98a0-4261-92bd-5d55d8ce20ee admin admin] PATH_INFO: `/v3/projects/95edc0ad1535457bb42cabef20825e41/users/a7cdb3afd6a845239a545df3f1ba77b3/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:37.721824 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf9006f-98a0-4261-92bd-5d55d8ce20ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=95edc0ad1535457bb42cabef20825e41, user_id=a7cdb3afd6a845239a545df3f1ba77b3, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:37.725774 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf9006f-98a0-4261-92bd-5d55d8ce20ee admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:37.756145 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 797/1608] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:27:37 2022] PUT /identity/v3/projects/95edc0ad1535457bb42cabef20825e41/users/a7cdb3afd6a845239a545df3f1ba77b3/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:27:37.759299 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9006f-98a0-4261-92bd-5d55d8ce20ee admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:37.807666 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e7314-3d3a-4d08-90c6-13588896552b admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:37.931973 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9006f-98a0-4261-92bd-5d55d8ce20ee admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:37.933637 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b9bb1-55bb-48b1-9133-e9ac1c549459 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:37.934929 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b9bb1-55bb-48b1-9133-e9ac1c549459 service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:37.935417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b9bb1-55bb-48b1-9133-e9ac1c549459 service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:37.935896 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b9bb1-55bb-48b1-9133-e9ac1c549459 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:37.942827 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb433354-0d3b-46ce-be82-5880fe32df30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:37.943912 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb433354-0d3b-46ce-be82-5880fe32df30 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:37.944472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb433354-0d3b-46ce-be82-5880fe32df30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:37.945033 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb433354-0d3b-46ce-be82-5880fe32df30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:37.946538 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb433354-0d3b-46ce-be82-5880fe32df30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:37.949062 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb433354-0d3b-46ce-be82-5880fe32df30 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:37.976710 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 798/1609] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:27:37.978475 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb433354-0d3b-46ce-be82-5880fe32df30 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:37.998909 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb433354-0d3b-46ce-be82-5880fe32df30 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:38.009882 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737d935-95fd-4aac-b223-64e4407878a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:38.011145 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737d935-95fd-4aac-b223-64e4407878a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:38.011848 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737d935-95fd-4aac-b223-64e4407878a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:38.012321 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737d935-95fd-4aac-b223-64e4407878a7 admin admin] PATH_INFO: `/v3/projects/eeedf1e5dcd24e52ad8a230144eb4ab2/users/18c3a4375ded41c89c877077ceb4f46d/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:38.046930 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737d935-95fd-4aac-b223-64e4407878a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeedf1e5dcd24e52ad8a230144eb4ab2, user_id=18c3a4375ded41c89c877077ceb4f46d, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:38.054254 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737d935-95fd-4aac-b223-64e4407878a7 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:38.060883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:38.094902 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 799/1610] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:27:37 2022] PUT /identity/v3/projects/eeedf1e5dcd24e52ad8a230144eb4ab2/users/18c3a4375ded41c89c877077ceb4f46d/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:27:38.094902 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31304504-b77a-4af7-afd3-eeb638e1f496 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:38.094902 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31304504-b77a-4af7-afd3-eeb638e1f496 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:38.094902 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31304504-b77a-4af7-afd3-eeb638e1f496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:38.099262 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b9bb1-55bb-48b1-9133-e9ac1c549459 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:38.102083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b9bb1-55bb-48b1-9133-e9ac1c549459 service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:38.126772 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-31304504-b77a-4af7-afd3-eeb638e1f496 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:38.129557 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 812/1611] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:37 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:27:38.129955 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-31304504-b77a-4af7-afd3-eeb638e1f496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:38.131285 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b9bb1-55bb-48b1-9133-e9ac1c549459 service cinder] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:38.156189 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b9bb1-55bb-48b1-9133-e9ac1c549459 service cinder] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:38.203675 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:38.319415 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 800/1612] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:38.321618 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31304504-b77a-4af7-afd3-eeb638e1f496 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:38.331414 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37168878-b750-4ea0-9656-0ba04a550297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:38.334601 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37168878-b750-4ea0-9656-0ba04a550297 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:38.335989 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37168878-b750-4ea0-9656-0ba04a550297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:38.336997 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37168878-b750-4ea0-9656-0ba04a550297 admin admin] PATH_INFO: `/v3/projects/377327fdaab64a01886a485b980cb95c/users/0759eda1fa50453da45b258ea46d54a1/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:38.363228 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31304504-b77a-4af7-afd3-eeb638e1f496 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:38.375783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7db983-a292-448c-b1a6-c0e6e717be5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:38.377635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7db983-a292-448c-b1a6-c0e6e717be5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:38.378342 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7db983-a292-448c-b1a6-c0e6e717be5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:38.379262 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7db983-a292-448c-b1a6-c0e6e717be5e admin admin] PATH_INFO: `/v3/projects/ce26e09d1d3c43379d4a119f322f5a52/users/388f72ff05784e6bae5ca4f085d7c55b/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:38.381735 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37168878-b750-4ea0-9656-0ba04a550297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=377327fdaab64a01886a485b980cb95c, user_id=0759eda1fa50453da45b258ea46d54a1, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:38.397888 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37168878-b750-4ea0-9656-0ba04a550297 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:38.442899 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7db983-a292-448c-b1a6-c0e6e717be5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce26e09d1d3c43379d4a119f322f5a52, user_id=388f72ff05784e6bae5ca4f085d7c55b, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:38.447518 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7db983-a292-448c-b1a6-c0e6e717be5e admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:38.468235 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 813/1613] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:27:38 2022] PUT /identity/v3/projects/377327fdaab64a01886a485b980cb95c/users/0759eda1fa50453da45b258ea46d54a1/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:27:38.484485 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee88e3-ea27-4ad5-b295-1ce6e85677e1 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:38.488840 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee88e3-ea27-4ad5-b295-1ce6e85677e1 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:38.489671 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee88e3-ea27-4ad5-b295-1ce6e85677e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:38.507293 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 801/1614] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:27:38 2022] PUT /identity/v3/projects/ce26e09d1d3c43379d4a119f322f5a52/users/388f72ff05784e6bae5ca4f085d7c55b/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:27:38.509502 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7db983-a292-448c-b1a6-c0e6e717be5e admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:38.574346 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-dcee88e3-ea27-4ad5-b295-1ce6e85677e1 None None] MFA Rules not processed for user `a7cdb3afd6a845239a545df3f1ba77b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:38.576769 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-dcee88e3-ea27-4ad5-b295-1ce6e85677e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:38.687502 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7db983-a292-448c-b1a6-c0e6e717be5e admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:38.697256 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38967e-0638-4f58-a800-b19261be74bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:38.699167 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38967e-0638-4f58-a800-b19261be74bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:38.699681 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38967e-0638-4f58-a800-b19261be74bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:38.700187 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38967e-0638-4f58-a800-b19261be74bd admin admin] PATH_INFO: `/v3/projects/079a1eed97ef4e6187c9f285d409149f/users/035cc211744f457f9fe65bd7d0e6bb79/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:38.724687 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 814/1615] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:38.727076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a2019-2e5b-4705-932c-ec476d5dee16 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:38.727592 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a2019-2e5b-4705-932c-ec476d5dee16 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:38.728102 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a2019-2e5b-4705-932c-ec476d5dee16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:38.748513 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38967e-0638-4f58-a800-b19261be74bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=079a1eed97ef4e6187c9f285d409149f, user_id=035cc211744f457f9fe65bd7d0e6bb79, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:38.756702 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38967e-0638-4f58-a800-b19261be74bd admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:38.772450 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-069a2019-2e5b-4705-932c-ec476d5dee16 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:38.774708 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-069a2019-2e5b-4705-932c-ec476d5dee16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:38.794250 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 815/1616] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:38.797125 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 802/1617] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:27:38 2022] PUT /identity/v3/projects/079a1eed97ef4e6187c9f285d409149f/users/035cc211744f457f9fe65bd7d0e6bb79/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:27:38.801170 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62689ef-fbb4-4ca6-9d95-9b27422f48d5 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:38.801357 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a2019-2e5b-4705-932c-ec476d5dee16 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:38.802127 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62689ef-fbb4-4ca6-9d95-9b27422f48d5 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:38.803169 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62689ef-fbb4-4ca6-9d95-9b27422f48d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:38.867641 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-d62689ef-fbb4-4ca6-9d95-9b27422f48d5 None None] MFA Rules not processed for user `0759eda1fa50453da45b258ea46d54a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:38.869663 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-d62689ef-fbb4-4ca6-9d95-9b27422f48d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:38.901026 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a2019-2e5b-4705-932c-ec476d5dee16 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:38.909516 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:38.997855 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 803/1618] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:38.999743 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ba3a3-aa21-4688-b33b-0b91e262d5b7 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:39.000142 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ba3a3-aa21-4688-b33b-0b91e262d5b7 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:39.000521 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ba3a3-aa21-4688-b33b-0b91e262d5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:39.015335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83e5d1-38fd-426a-8a5d-e7c6a118afb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:39.016717 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83e5d1-38fd-426a-8a5d-e7c6a118afb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:39.018001 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83e5d1-38fd-426a-8a5d-e7c6a118afb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:39.018565 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83e5d1-38fd-426a-8a5d-e7c6a118afb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:39.036357 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-dd4ba3a3-aa21-4688-b33b-0b91e262d5b7 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:39.038945 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-dd4ba3a3-aa21-4688-b33b-0b91e262d5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:39.066788 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:39.119878 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83e5d1-38fd-426a-8a5d-e7c6a118afb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:39.122844 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83e5d1-38fd-426a-8a5d-e7c6a118afb9 service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:39.143546 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 816/1619] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:27:39.145389 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83e5d1-38fd-426a-8a5d-e7c6a118afb9 service neutron] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:39.156958 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 804/1620] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:39.164813 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ba3a3-aa21-4688-b33b-0b91e262d5b7 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:39.165994 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83e5d1-38fd-426a-8a5d-e7c6a118afb9 service neutron] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:39.176220 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82e7fd-79e7-4145-8765-d4e3b71a6c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:39.177508 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82e7fd-79e7-4145-8765-d4e3b71a6c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:39.178024 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82e7fd-79e7-4145-8765-d4e3b71a6c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:39.178731 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82e7fd-79e7-4145-8765-d4e3b71a6c4f admin admin] PATH_INFO: `/v3/users/a6754d2c64054aac95ce60b7844bd46f` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:39.181105 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b82e7fd-79e7-4145-8765-d4e3b71a6c4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6754d2c64054aac95ce60b7844bd46f)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:39.185147 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b82e7fd-79e7-4145-8765-d4e3b71a6c4f admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:39.185956 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ba3a3-aa21-4688-b33b-0b91e262d5b7 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:39.197593 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599bd72-4931-4df5-b73a-4fa9767dcf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:39.198945 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599bd72-4931-4df5-b73a-4fa9767dcf21 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:39.199387 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599bd72-4931-4df5-b73a-4fa9767dcf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:39.199819 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599bd72-4931-4df5-b73a-4fa9767dcf21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:39.200916 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599bd72-4931-4df5-b73a-4fa9767dcf21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:39.206730 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599bd72-4931-4df5-b73a-4fa9767dcf21 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:39.272908 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 805/1621] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:27:39 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:27:39.275208 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43412fa-17f7-4fe0-bb0d-2d8ebc8314d9 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:39.275647 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43412fa-17f7-4fe0-bb0d-2d8ebc8314d9 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:39.276507 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43412fa-17f7-4fe0-bb0d-2d8ebc8314d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:39.295225 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-4b82e7fd-79e7-4145-8765-d4e3b71a6c4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6754d2c64054aac95ce60b7844bd46f'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:39.296364 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-4b82e7fd-79e7-4145-8765-d4e3b71a6c4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6754d2c64054aac95ce60b7844bd46f'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:39.309350 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-b43412fa-17f7-4fe0-bb0d-2d8ebc8314d9 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:39.311153 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-b43412fa-17f7-4fe0-bb0d-2d8ebc8314d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:39.316181 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-4b82e7fd-79e7-4145-8765-d4e3b71a6c4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6754d2c64054aac95ce60b7844bd46f'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:39.331837 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-4b82e7fd-79e7-4145-8765-d4e3b71a6c4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6754d2c64054aac95ce60b7844bd46f'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:39.351979 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-4b82e7fd-79e7-4145-8765-d4e3b71a6c4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6754d2c64054aac95ce60b7844bd46f'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:39.360220 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 817/1622] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:27:39 2022] DELETE /identity/v3/users/a6754d2c64054aac95ce60b7844bd46f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:27:39.362134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82e7fd-79e7-4145-8765-d4e3b71a6c4f admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:39.363545 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-4b82e7fd-79e7-4145-8765-d4e3b71a6c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:39.405472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 806/1623] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:39.406546 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43412fa-17f7-4fe0-bb0d-2d8ebc8314d9 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:39.408517 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-b43412fa-17f7-4fe0-bb0d-2d8ebc8314d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:39.428322 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43412fa-17f7-4fe0-bb0d-2d8ebc8314d9 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:39.447474 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:39.509878 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82e7fd-79e7-4145-8765-d4e3b71a6c4f admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:39.518334 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf600ce4-76c9-4156-b266-6e1c1eb3ca0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:39.520689 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf600ce4-76c9-4156-b266-6e1c1eb3ca0e service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:39.521154 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf600ce4-76c9-4156-b266-6e1c1eb3ca0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:39.521736 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf600ce4-76c9-4156-b266-6e1c1eb3ca0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:39.525968 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-cf600ce4-76c9-4156-b266-6e1c1eb3ca0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:39.547525 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca00b7-74b6-4852-a6e2-5ce66b01b846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:39.548522 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca00b7-74b6-4852-a6e2-5ce66b01b846 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:39.549860 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca00b7-74b6-4852-a6e2-5ce66b01b846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:39.550370 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca00b7-74b6-4852-a6e2-5ce66b01b846 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:39.551807 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca00b7-74b6-4852-a6e2-5ce66b01b846 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:39.554962 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca00b7-74b6-4852-a6e2-5ce66b01b846 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:39.617896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 807/1624] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:27:39 2022] POST /identity/v3/projects => generated 373 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:27:39.617896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca00b7-74b6-4852-a6e2-5ce66b01b846 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:39.696570 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:39.711018 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf600ce4-76c9-4156-b266-6e1c1eb3ca0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:39.716191 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf600ce4-76c9-4156-b266-6e1c1eb3ca0e service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:39.748313 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 818/1625] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:27:39.750799 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf600ce4-76c9-4156-b266-6e1c1eb3ca0e service neutron] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:39.754055 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-cf600ce4-76c9-4156-b266-6e1c1eb3ca0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:39.816057 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca00b7-74b6-4852-a6e2-5ce66b01b846 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:39.820630 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf600ce4-76c9-4156-b266-6e1c1eb3ca0e service neutron] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:39.823633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3b898-f532-4e89-9656-8c08b3965988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:39.826267 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3b898-f532-4e89-9656-8c08b3965988 service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:39.826803 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3b898-f532-4e89-9656-8c08b3965988 service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:39.827875 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3b898-f532-4e89-9656-8c08b3965988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:39.831952 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-bbd3b898-f532-4e89-9656-8c08b3965988 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:40.044853 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b457cd-44b9-40fb-ba91-7fb118db6f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:40.047642 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b457cd-44b9-40fb-ba91-7fb118db6f2f admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:40.048960 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b457cd-44b9-40fb-ba91-7fb118db6f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:40.049543 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b457cd-44b9-40fb-ba91-7fb118db6f2f admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:40.051110 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b457cd-44b9-40fb-ba91-7fb118db6f2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:40.055321 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b457cd-44b9-40fb-ba91-7fb118db6f2f admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:40.109464 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 819/1626] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:27:39 2022] POST /identity/v3/users => generated 300 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:27:40.117791 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851c340-d802-4ec5-ab0a-25155b0f5c6c None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:40.118269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851c340-d802-4ec5-ab0a-25155b0f5c6c None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:40.119116 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851c340-d802-4ec5-ab0a-25155b0f5c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:40.139090 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3b898-f532-4e89-9656-8c08b3965988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:40.145896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3b898-f532-4e89-9656-8c08b3965988 service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:40.160665 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-1851c340-d802-4ec5-ab0a-25155b0f5c6c None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:40.163472 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-1851c340-d802-4ec5-ab0a-25155b0f5c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:40.185788 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 820/1627] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:40.185788 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851c340-d802-4ec5-ab0a-25155b0f5c6c None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:40.186169 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 808/1628] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:27:40.187392 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3b898-f532-4e89-9656-8c08b3965988 service neutron] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:40.203177 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851c340-d802-4ec5-ab0a-25155b0f5c6c None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:40.213632 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c3e0c-d252-4be3-aa71-29f83bd905de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:40.214812 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c3e0c-d252-4be3-aa71-29f83bd905de service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:40.215492 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c3e0c-d252-4be3-aa71-29f83bd905de service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:40.216122 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c3e0c-d252-4be3-aa71-29f83bd905de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:40.221658 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3b898-f532-4e89-9656-8c08b3965988 service neutron] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:40.239183 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c3e0c-d252-4be3-aa71-29f83bd905de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:40.243288 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c3e0c-d252-4be3-aa71-29f83bd905de service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:40.245571 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc1834-2608-4c45-9534-71472fe6ad10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:40.246717 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc1834-2608-4c45-9534-71472fe6ad10 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:40.247789 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc1834-2608-4c45-9534-71472fe6ad10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:40.247789 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc1834-2608-4c45-9534-71472fe6ad10 admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:40.249047 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc1834-2608-4c45-9534-71472fe6ad10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:40.253056 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc1834-2608-4c45-9534-71472fe6ad10 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:40.277888 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 821/1629] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:27:40.279584 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c3e0c-d252-4be3-aa71-29f83bd905de service neutron] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:40.323982 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c3e0c-d252-4be3-aa71-29f83bd905de service neutron] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:40.347648 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19931f5-cc8f-40d6-a2b7-ece9329cf532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:40.355451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19931f5-cc8f-40d6-a2b7-ece9329cf532 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:40.356180 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19931f5-cc8f-40d6-a2b7-ece9329cf532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:40.356849 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19931f5-cc8f-40d6-a2b7-ece9329cf532 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:40.363054 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19931f5-cc8f-40d6-a2b7-ece9329cf532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:40.367408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19931f5-cc8f-40d6-a2b7-ece9329cf532 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:40.372779 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 809/1630] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:27:40 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:27:40.374947 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc1834-2608-4c45-9534-71472fe6ad10 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:40.381584 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-93bc1834-2608-4c45-9534-71472fe6ad10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:40.401436 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 822/1631] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:27:40.408210 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19931f5-cc8f-40d6-a2b7-ece9329cf532 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:40.413560 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc1834-2608-4c45-9534-71472fe6ad10 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:40.431686 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f5036-4067-46fd-84c3-5b820220b078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:40.433116 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f5036-4067-46fd-84c3-5b820220b078 service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:40.435468 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f5036-4067-46fd-84c3-5b820220b078 service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:40.436163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f5036-4067-46fd-84c3-5b820220b078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:40.463257 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19931f5-cc8f-40d6-a2b7-ece9329cf532 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:40.485085 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f5036-4067-46fd-84c3-5b820220b078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:40.489579 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a94c9e-4457-4bf1-a110-cc460d96583f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:40.493138 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a94c9e-4457-4bf1-a110-cc460d96583f admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:40.493842 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a94c9e-4457-4bf1-a110-cc460d96583f admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:40.495250 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f5036-4067-46fd-84c3-5b820220b078 service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:40.498505 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a94c9e-4457-4bf1-a110-cc460d96583f admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:40.500345 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a94c9e-4457-4bf1-a110-cc460d96583f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:40.510256 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a94c9e-4457-4bf1-a110-cc460d96583f admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:40.541620 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 823/1632] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:27:40.543363 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a94c9e-4457-4bf1-a110-cc460d96583f admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:40.560530 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 810/1633] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:27:40.566621 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f5036-4067-46fd-84c3-5b820220b078 service neutron] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:40.567279 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a94c9e-4457-4bf1-a110-cc460d96583f admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:40.577566 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d46bf-adbf-40e8-9847-8713076a3ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:40.580856 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d46bf-adbf-40e8-9847-8713076a3ad2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:40.582109 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d46bf-adbf-40e8-9847-8713076a3ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:40.582688 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d46bf-adbf-40e8-9847-8713076a3ad2 admin admin] PATH_INFO: `/v3/projects/241f150cc5fd4fa0a3b3a8d5619da577/users/40c6ef9de5374f3d85c7b7de41792139/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:40.623334 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d46bf-adbf-40e8-9847-8713076a3ad2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=241f150cc5fd4fa0a3b3a8d5619da577, user_id=40c6ef9de5374f3d85c7b7de41792139, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:40.630136 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d46bf-adbf-40e8-9847-8713076a3ad2 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:40.637334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f5036-4067-46fd-84c3-5b820220b078 service neutron] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:40.662388 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 824/1634] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:27:40 2022] PUT /identity/v3/projects/241f150cc5fd4fa0a3b3a8d5619da577/users/40c6ef9de5374f3d85c7b7de41792139/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:27:40.664691 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2375c-9686-40e4-b167-0feb7a1da8ea None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:40.664945 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2375c-9686-40e4-b167-0feb7a1da8ea None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:40.665419 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2375c-9686-40e4-b167-0feb7a1da8ea None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:40.666018 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a964f-9d5e-4e3a-8e17-e1e5986b3774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:40.670174 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 825/1635] 10.222.0.77 () {54 vars in 962 bytes} [Tue Aug 23 22:27:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:27:40.670479 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a964f-9d5e-4e3a-8e17-e1e5986b3774 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:40.670670 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a964f-9d5e-4e3a-8e17-e1e5986b3774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:40.672238 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2375c-9686-40e4-b167-0feb7a1da8ea None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:40.674641 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a964f-9d5e-4e3a-8e17-e1e5986b3774 admin admin] PATH_INFO: `/v3/projects/fa7d028322ac4e118d3e7812ffabfa98/users/d3223a1b8fa54f069fb262be5aea2a46/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:40.687989 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:40.744653 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a964f-9d5e-4e3a-8e17-e1e5986b3774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa7d028322ac4e118d3e7812ffabfa98, user_id=d3223a1b8fa54f069fb262be5aea2a46, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:40.750486 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a964f-9d5e-4e3a-8e17-e1e5986b3774 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:40.787097 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 811/1636] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:27:40 2022] PUT /identity/v3/projects/fa7d028322ac4e118d3e7812ffabfa98/users/d3223a1b8fa54f069fb262be5aea2a46/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:27:40.788728 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b825a-28c1-4803-b43e-32c6c7a8767f None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:40.789218 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b825a-28c1-4803-b43e-32c6c7a8767f None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:40.789585 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b825a-28c1-4803-b43e-32c6c7a8767f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:40.857703 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2375c-9686-40e4-b167-0feb7a1da8ea None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:40.894858 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-5f1b825a-28c1-4803-b43e-32c6c7a8767f None None] MFA Rules not processed for user `1a0af5bf009b48a8915c7320b16d08dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:40.904138 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-5f1b825a-28c1-4803-b43e-32c6c7a8767f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:41.073900 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454dd66-1255-462a-b94c-2806c081fd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:41.075129 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454dd66-1255-462a-b94c-2806c081fd03 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:41.079618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454dd66-1255-462a-b94c-2806c081fd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:41.080813 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454dd66-1255-462a-b94c-2806c081fd03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:41.083459 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5454dd66-1255-462a-b94c-2806c081fd03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:41.090650 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5454dd66-1255-462a-b94c-2806c081fd03 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:41.131581 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 826/1637] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 461 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:27:41.134027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:41.138028 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454dd66-1255-462a-b94c-2806c081fd03 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:41.177694 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454dd66-1255-462a-b94c-2806c081fd03 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:41.196435 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea03314-2c2b-412c-b1b4-a10d874682a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:41.197211 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 812/1638] 10.222.0.77 () {58 vars in 1059 bytes} [Tue Aug 23 22:27:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:41.198106 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea03314-2c2b-412c-b1b4-a10d874682a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:41.198712 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea03314-2c2b-412c-b1b4-a10d874682a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:41.199158 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea03314-2c2b-412c-b1b4-a10d874682a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:41.199327 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b825a-28c1-4803-b43e-32c6c7a8767f None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:41.200917 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea03314-2c2b-412c-b1b4-a10d874682a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:41.206113 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea03314-2c2b-412c-b1b4-a10d874682a5 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:41.242157 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b825a-28c1-4803-b43e-32c6c7a8767f None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:41.254962 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 827/1639] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:27:41.255448 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a2033-4203-4eeb-bba0-2c2ed4dc052e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:41.256402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a2033-4203-4eeb-bba0-2c2ed4dc052e admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:41.256986 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a2033-4203-4eeb-bba0-2c2ed4dc052e admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:41.257635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a2033-4203-4eeb-bba0-2c2ed4dc052e admin admin] PATH_INFO: `/v3/projects/241f150cc5fd4fa0a3b3a8d5619da577/users/40c6ef9de5374f3d85c7b7de41792139/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:41.264066 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a2033-4203-4eeb-bba0-2c2ed4dc052e admin admin] RBAC: Authorizing `identity:create_grant(project_id=241f150cc5fd4fa0a3b3a8d5619da577, user_id=40c6ef9de5374f3d85c7b7de41792139, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:41.265046 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64400e0-ee5b-4760-98a6-ed58319f6ac7 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:41.266473 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64400e0-ee5b-4760-98a6-ed58319f6ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:41.268405 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64400e0-ee5b-4760-98a6-ed58319f6ac7 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:41.271240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a2033-4203-4eeb-bba0-2c2ed4dc052e admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:41.273100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 828/1640] 10.222.0.77 () {54 vars in 912 bytes} [Tue Aug 23 22:27:41 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:27:41.277408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64400e0-ee5b-4760-98a6-ed58319f6ac7 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:41.321588 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 813/1641] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:27:41 2022] PUT /identity/v3/projects/241f150cc5fd4fa0a3b3a8d5619da577/users/40c6ef9de5374f3d85c7b7de41792139/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:27:41.321588 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76e081-2560-4625-9e52-31d46f176e7c None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:41.321588 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76e081-2560-4625-9e52-31d46f176e7c None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:41.321588 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76e081-2560-4625-9e52-31d46f176e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:41.323087 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64400e0-ee5b-4760-98a6-ed58319f6ac7 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:41.368882 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-ba76e081-2560-4625-9e52-31d46f176e7c None None] MFA Rules not processed for user `1a0af5bf009b48a8915c7320b16d08dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:41.371580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-ba76e081-2560-4625-9e52-31d46f176e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:41.492983 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678b7cf-b028-40b1-a40a-7da076a7824e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:41.497500 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678b7cf-b028-40b1-a40a-7da076a7824e admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:41.497500 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678b7cf-b028-40b1-a40a-7da076a7824e admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:41.497500 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678b7cf-b028-40b1-a40a-7da076a7824e admin admin] PATH_INFO: `/v3/projects/fa7d028322ac4e118d3e7812ffabfa98/users/d3223a1b8fa54f069fb262be5aea2a46/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:41.500502 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678b7cf-b028-40b1-a40a-7da076a7824e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa7d028322ac4e118d3e7812ffabfa98, user_id=d3223a1b8fa54f069fb262be5aea2a46, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:41.507821 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678b7cf-b028-40b1-a40a-7da076a7824e admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:41.549499 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 829/1642] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:27:41 2022] PUT /identity/v3/projects/fa7d028322ac4e118d3e7812ffabfa98/users/d3223a1b8fa54f069fb262be5aea2a46/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:27:41.549499 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54719f7d-7e57-4f7b-810e-1d7fe2c45c3d None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:41.549499 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54719f7d-7e57-4f7b-810e-1d7fe2c45c3d None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:41.549499 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54719f7d-7e57-4f7b-810e-1d7fe2c45c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:41.655805 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-54719f7d-7e57-4f7b-810e-1d7fe2c45c3d None None] MFA Rules not processed for user `40c6ef9de5374f3d85c7b7de41792139`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:41.661807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-54719f7d-7e57-4f7b-810e-1d7fe2c45c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:41.697439 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 814/1643] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Aug 23 22:27:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:41.700851 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721ff6e-c4c4-438e-9866-fd0a74b27427 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:41.703120 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721ff6e-c4c4-438e-9866-fd0a74b27427 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:41.704640 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721ff6e-c4c4-438e-9866-fd0a74b27427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:41.754835 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:41.808442 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-8721ff6e-c4c4-438e-9866-fd0a74b27427 None None] MFA Rules not processed for user `d3223a1b8fa54f069fb262be5aea2a46`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:41.823960 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-8721ff6e-c4c4-438e-9866-fd0a74b27427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:41.966568 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 830/1644] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:41 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 427 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:41.968267 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54719f7d-7e57-4f7b-810e-1d7fe2c45c3d None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:41.971307 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-54719f7d-7e57-4f7b-810e-1d7fe2c45c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:42.140530 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 815/1645] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:42.149915 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721ff6e-c4c4-438e-9866-fd0a74b27427 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:42.155898 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-8721ff6e-c4c4-438e-9866-fd0a74b27427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:42.208451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54719f7d-7e57-4f7b-810e-1d7fe2c45c3d None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:42.224043 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721ff6e-c4c4-438e-9866-fd0a74b27427 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:42.228908 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499caef-243d-44aa-be1b-f50f68a892b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:42.230517 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499caef-243d-44aa-be1b-f50f68a892b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:42.232036 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499caef-243d-44aa-be1b-f50f68a892b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:42.232036 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499caef-243d-44aa-be1b-f50f68a892b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:42.248854 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553378a1-67fc-4b04-ae69-47f1d407f43c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:42.249714 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553378a1-67fc-4b04-ae69-47f1d407f43c service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:42.250107 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553378a1-67fc-4b04-ae69-47f1d407f43c service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:42.250396 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553378a1-67fc-4b04-ae69-47f1d407f43c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:42.282302 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553378a1-67fc-4b04-ae69-47f1d407f43c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:42.286216 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553378a1-67fc-4b04-ae69-47f1d407f43c service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:42.319801 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 816/1646] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:42 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:27:42.372179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553378a1-67fc-4b04-ae69-47f1d407f43c service cinder] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:42.478979 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499caef-243d-44aa-be1b-f50f68a892b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:42.492672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499caef-243d-44aa-be1b-f50f68a892b5 service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:42.536106 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 831/1647] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:27:42.537627 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499caef-243d-44aa-be1b-f50f68a892b5 service cinder] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:42.543385 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:42.597591 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499caef-243d-44aa-be1b-f50f68a892b5 service cinder] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:42.604094 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553378a1-67fc-4b04-ae69-47f1d407f43c service cinder] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:42.613569 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee61167-50e9-4d4f-8b89-a6e92aa524cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:42.614449 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee61167-50e9-4d4f-8b89-a6e92aa524cc service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:42.614877 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee61167-50e9-4d4f-8b89-a6e92aa524cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:42.615333 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee61167-50e9-4d4f-8b89-a6e92aa524cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:42.622019 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875bb74-c8be-4841-af16-118383cbb020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:42.622859 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875bb74-c8be-4841-af16-118383cbb020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:42.626914 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875bb74-c8be-4841-af16-118383cbb020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:42.627551 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875bb74-c8be-4841-af16-118383cbb020 admin admin] PATH_INFO: `/v3/users/a7cdb3afd6a845239a545df3f1ba77b3` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:42.631468 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a875bb74-c8be-4841-af16-118383cbb020 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7cdb3afd6a845239a545df3f1ba77b3)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:42.633183 dv-cinder-850321-4-smb devstack@keystone.service[81751]: WARNING py.warnings [None req-a875bb74-c8be-4841-af16-118383cbb020 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:27:42.633183 dv-cinder-850321-4-smb devstack@keystone.service[81751]: warnings.warn(msg) Aug 23 22:27:42.633183 dv-cinder-850321-4-smb devstack@keystone.service[81751]: Aug 23 22:27:42.639802 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a875bb74-c8be-4841-af16-118383cbb020 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:42.650442 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee61167-50e9-4d4f-8b89-a6e92aa524cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:42.650442 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee61167-50e9-4d4f-8b89-a6e92aa524cc service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:42.689881 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 832/1648] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:27:42.814166 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee61167-50e9-4d4f-8b89-a6e92aa524cc service cinder] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:42.816791 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-8ee61167-50e9-4d4f-8b89-a6e92aa524cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:42.885570 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee61167-50e9-4d4f-8b89-a6e92aa524cc service cinder] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:42.911738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-a875bb74-c8be-4841-af16-118383cbb020 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7cdb3afd6a845239a545df3f1ba77b3'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:42.913286 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-a875bb74-c8be-4841-af16-118383cbb020 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7cdb3afd6a845239a545df3f1ba77b3'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:42.922308 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33adfc5-a006-4c79-9efe-5296efc236c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:42.925468 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33adfc5-a006-4c79-9efe-5296efc236c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:42.928838 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33adfc5-a006-4c79-9efe-5296efc236c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:42.933867 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33adfc5-a006-4c79-9efe-5296efc236c8 admin admin] PATH_INFO: `/v3/projects/7fa8a6c6849a47458b2964353436c095` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:42.939347 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33adfc5-a006-4c79-9efe-5296efc236c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fa8a6c6849a47458b2964353436c095)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:42.946436 dv-cinder-850321-4-smb devstack@keystone.service[81752]: WARNING py.warnings [None req-f33adfc5-a006-4c79-9efe-5296efc236c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:27:42.946436 dv-cinder-850321-4-smb devstack@keystone.service[81752]: warnings.warn(msg) Aug 23 22:27:42.946436 dv-cinder-850321-4-smb devstack@keystone.service[81752]: Aug 23 22:27:42.951377 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33adfc5-a006-4c79-9efe-5296efc236c8 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:42.955993 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-a875bb74-c8be-4841-af16-118383cbb020 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7cdb3afd6a845239a545df3f1ba77b3'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:42.983232 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-a875bb74-c8be-4841-af16-118383cbb020 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7cdb3afd6a845239a545df3f1ba77b3'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:42.987596 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-a875bb74-c8be-4841-af16-118383cbb020 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7cdb3afd6a845239a545df3f1ba77b3'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:43.121510 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 817/1649] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:27:42 2022] DELETE /identity/v3/users/a7cdb3afd6a845239a545df3f1ba77b3 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:27:43.124436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd698f1-5c36-43a6-b27f-5d4086529c3f None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:43.124934 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd698f1-5c36-43a6-b27f-5d4086529c3f None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:43.126942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd698f1-5c36-43a6-b27f-5d4086529c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:43.148838 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:43.187003 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-f33adfc5-a006-4c79-9efe-5296efc236c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fa8a6c6849a47458b2964353436c095', 'request_id': 'req-f33adfc5-a006-4c79-9efe-5296efc236c8'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:43.212144 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-f33adfc5-a006-4c79-9efe-5296efc236c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fa8a6c6849a47458b2964353436c095', 'request_id': 'req-f33adfc5-a006-4c79-9efe-5296efc236c8'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:43.238818 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-f33adfc5-a006-4c79-9efe-5296efc236c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fa8a6c6849a47458b2964353436c095', 'request_id': 'req-f33adfc5-a006-4c79-9efe-5296efc236c8'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:43.247113 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-efd698f1-5c36-43a6-b27f-5d4086529c3f None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:43.251374 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-efd698f1-5c36-43a6-b27f-5d4086529c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:43.310496 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-f33adfc5-a006-4c79-9efe-5296efc236c8 admin admin] The token cache is being invalidate because project 7fa8a6c6849a47458b2964353436c095 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:27:43.313240 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-f33adfc5-a006-4c79-9efe-5296efc236c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:43.318975 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-f33adfc5-a006-4c79-9efe-5296efc236c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:43.324117 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 833/1650] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:27:42 2022] DELETE /identity/v3/projects/7fa8a6c6849a47458b2964353436c095 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:27:43.330953 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33adfc5-a006-4c79-9efe-5296efc236c8 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:43.334119 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-f33adfc5-a006-4c79-9efe-5296efc236c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:43.527761 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 818/1651] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:43.624569 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33adfc5-a006-4c79-9efe-5296efc236c8 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:43.649756 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2263183-3498-4fc7-b3c7-fc36e1dea0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:43.652101 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2263183-3498-4fc7-b3c7-fc36e1dea0c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:43.653736 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2263183-3498-4fc7-b3c7-fc36e1dea0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:43.655465 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2263183-3498-4fc7-b3c7-fc36e1dea0c2 admin admin] PATH_INFO: `/v3/users/6bf940bd33f34018ab0d61ec3afcee9e` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:43.671015 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2263183-3498-4fc7-b3c7-fc36e1dea0c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bf940bd33f34018ab0d61ec3afcee9e)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:43.681423 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2263183-3498-4fc7-b3c7-fc36e1dea0c2 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:43.924604 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd698f1-5c36-43a6-b27f-5d4086529c3f None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:43.924604 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-efd698f1-5c36-43a6-b27f-5d4086529c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:44.051275 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-a2263183-3498-4fc7-b3c7-fc36e1dea0c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bf940bd33f34018ab0d61ec3afcee9e'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:44.051275 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-a2263183-3498-4fc7-b3c7-fc36e1dea0c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bf940bd33f34018ab0d61ec3afcee9e'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:44.105580 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-a2263183-3498-4fc7-b3c7-fc36e1dea0c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bf940bd33f34018ab0d61ec3afcee9e'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:44.134949 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-a2263183-3498-4fc7-b3c7-fc36e1dea0c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bf940bd33f34018ab0d61ec3afcee9e'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:44.184418 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-a2263183-3498-4fc7-b3c7-fc36e1dea0c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bf940bd33f34018ab0d61ec3afcee9e'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:44.210862 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 834/1652] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:27:43 2022] DELETE /identity/v3/users/6bf940bd33f34018ab0d61ec3afcee9e => generated 0 bytes in 882 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:27:44.273358 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd698f1-5c36-43a6-b27f-5d4086529c3f None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:44.414840 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:44.547982 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4f31e-219e-442e-adfb-76c0aa3c71e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:44.549040 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4f31e-219e-442e-adfb-76c0aa3c71e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:44.549536 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4f31e-219e-442e-adfb-76c0aa3c71e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:44.550045 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4f31e-219e-442e-adfb-76c0aa3c71e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:44.562884 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-56c4f31e-219e-442e-adfb-76c0aa3c71e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:44.630178 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2263183-3498-4fc7-b3c7-fc36e1dea0c2 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:44.633589 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-a2263183-3498-4fc7-b3c7-fc36e1dea0c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:44.884293 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4f31e-219e-442e-adfb-76c0aa3c71e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:44.886843 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:44.887154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4f31e-219e-442e-adfb-76c0aa3c71e9 service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:44.946471 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 819/1653] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 1085 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:27:44.969632 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2263183-3498-4fc7-b3c7-fc36e1dea0c2 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:44.990478 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207daa0-b8f5-4fb8-9373-a62c5a008460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:44.992615 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207daa0-b8f5-4fb8-9373-a62c5a008460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:44.992615 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207daa0-b8f5-4fb8-9373-a62c5a008460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:44.992876 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207daa0-b8f5-4fb8-9373-a62c5a008460 admin admin] PATH_INFO: `/v3/users/0759eda1fa50453da45b258ea46d54a1` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:45.006856 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207daa0-b8f5-4fb8-9373-a62c5a008460 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0759eda1fa50453da45b258ea46d54a1)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:45.010936 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207daa0-b8f5-4fb8-9373-a62c5a008460 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:45.218583 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-1207daa0-b8f5-4fb8-9373-a62c5a008460 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0759eda1fa50453da45b258ea46d54a1'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:45.226213 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-1207daa0-b8f5-4fb8-9373-a62c5a008460 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0759eda1fa50453da45b258ea46d54a1'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:45.255108 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-1207daa0-b8f5-4fb8-9373-a62c5a008460 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0759eda1fa50453da45b258ea46d54a1'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:45.285442 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-1207daa0-b8f5-4fb8-9373-a62c5a008460 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0759eda1fa50453da45b258ea46d54a1'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:45.344044 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-1207daa0-b8f5-4fb8-9373-a62c5a008460 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0759eda1fa50453da45b258ea46d54a1'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:45.382417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 835/1654] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:27:44 2022] DELETE /identity/v3/users/0759eda1fa50453da45b258ea46d54a1 => generated 0 bytes in 749 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:27:45.385426 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71a672-b124-4f69-b828-98c71e9d9c47 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:45.386093 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71a672-b124-4f69-b828-98c71e9d9c47 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:45.386639 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71a672-b124-4f69-b828-98c71e9d9c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:45.459029 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-2b71a672-b124-4f69-b828-98c71e9d9c47 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:45.460638 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-2b71a672-b124-4f69-b828-98c71e9d9c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:45.698928 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 820/1655] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:45.843466 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207daa0-b8f5-4fb8-9373-a62c5a008460 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:45.847861 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-1207daa0-b8f5-4fb8-9373-a62c5a008460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:46.081459 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207daa0-b8f5-4fb8-9373-a62c5a008460 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:46.105930 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cffa05-c383-4c6f-82bc-49ef045011d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:46.108299 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cffa05-c383-4c6f-82bc-49ef045011d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:46.111071 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cffa05-c383-4c6f-82bc-49ef045011d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:46.111578 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cffa05-c383-4c6f-82bc-49ef045011d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:46.160778 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cffa05-c383-4c6f-82bc-49ef045011d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:46.162933 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cffa05-c383-4c6f-82bc-49ef045011d2 service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:46.179692 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c909cd-08ea-43a5-8ef5-2e2e3f076389 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:46.180360 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c909cd-08ea-43a5-8ef5-2e2e3f076389 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:46.180985 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c909cd-08ea-43a5-8ef5-2e2e3f076389 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:46.184949 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 821/1656] 10.222.0.77 () {54 vars in 962 bytes} [Tue Aug 23 22:27:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:27:46.196143 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 836/1657] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:27:46.204645 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5b28b-13e6-41f0-896e-0f5a2b0708a1 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:46.205694 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5b28b-13e6-41f0-896e-0f5a2b0708a1 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:46.206140 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5b28b-13e6-41f0-896e-0f5a2b0708a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:46.263450 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-d4d5b28b-13e6-41f0-896e-0f5a2b0708a1 None None] MFA Rules not processed for user `1a0af5bf009b48a8915c7320b16d08dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:46.268173 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-d4d5b28b-13e6-41f0-896e-0f5a2b0708a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:46.515727 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 822/1658] 10.222.0.77 () {58 vars in 1059 bytes} [Tue Aug 23 22:27:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:27:46.523176 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c1b23-07bd-476e-af96-53d0038c5e69 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:46.523940 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c1b23-07bd-476e-af96-53d0038c5e69 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:46.524102 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c1b23-07bd-476e-af96-53d0038c5e69 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:46.526353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 837/1659] 10.222.0.77 () {54 vars in 912 bytes} [Tue Aug 23 22:27:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:27:46.546908 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459f6fb-ef8c-4691-8db4-0e7d51de8755 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:46.547944 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459f6fb-ef8c-4691-8db4-0e7d51de8755 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:46.549205 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459f6fb-ef8c-4691-8db4-0e7d51de8755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:46.611674 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:46.626265 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-4459f6fb-ef8c-4691-8db4-0e7d51de8755 None None] MFA Rules not processed for user `1a0af5bf009b48a8915c7320b16d08dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:46.629057 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-4459f6fb-ef8c-4691-8db4-0e7d51de8755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:46.671342 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 823/1660] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Aug 23 22:27:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:46.691903 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c1b23-07bd-476e-af96-53d0038c5e69 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:46.695560 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-fa7c1b23-07bd-476e-af96-53d0038c5e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:46.810595 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c1b23-07bd-476e-af96-53d0038c5e69 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:46.819048 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e2c37-7f8f-49ad-989a-83a45117de35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:46.819852 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e2c37-7f8f-49ad-989a-83a45117de35 service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:46.820324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e2c37-7f8f-49ad-989a-83a45117de35 service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:46.820656 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e2c37-7f8f-49ad-989a-83a45117de35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:46.850916 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e2c37-7f8f-49ad-989a-83a45117de35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:46.854010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e2c37-7f8f-49ad-989a-83a45117de35 service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:46.873521 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 838/1661] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:27:47.100839 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459f6fb-ef8c-4691-8db4-0e7d51de8755 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:47.103577 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-4459f6fb-ef8c-4691-8db4-0e7d51de8755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:47.153775 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459f6fb-ef8c-4691-8db4-0e7d51de8755 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:47.176138 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84979c-7b9f-4a0e-b9c5-d0ff5d4d9a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:47.177284 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84979c-7b9f-4a0e-b9c5-d0ff5d4d9a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:47.177935 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84979c-7b9f-4a0e-b9c5-d0ff5d4d9a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:47.178758 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84979c-7b9f-4a0e-b9c5-d0ff5d4d9a0e admin admin] PATH_INFO: `/v3/projects/879d579523934c009d0f0c4cc7db6e07` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:47.183327 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84979c-7b9f-4a0e-b9c5-d0ff5d4d9a0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=879d579523934c009d0f0c4cc7db6e07)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:47.194138 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84979c-7b9f-4a0e-b9c5-d0ff5d4d9a0e admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:47.404036 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-1a84979c-7b9f-4a0e-b9c5-d0ff5d4d9a0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '879d579523934c009d0f0c4cc7db6e07', 'request_id': 'req-1a84979c-7b9f-4a0e-b9c5-d0ff5d4d9a0e'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:47.442577 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-1a84979c-7b9f-4a0e-b9c5-d0ff5d4d9a0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '879d579523934c009d0f0c4cc7db6e07', 'request_id': 'req-1a84979c-7b9f-4a0e-b9c5-d0ff5d4d9a0e'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:47.459690 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-1a84979c-7b9f-4a0e-b9c5-d0ff5d4d9a0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '879d579523934c009d0f0c4cc7db6e07', 'request_id': 'req-1a84979c-7b9f-4a0e-b9c5-d0ff5d4d9a0e'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:47.497477 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-1a84979c-7b9f-4a0e-b9c5-d0ff5d4d9a0e admin admin] The token cache is being invalidate because project 879d579523934c009d0f0c4cc7db6e07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:27:47.497922 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-1a84979c-7b9f-4a0e-b9c5-d0ff5d4d9a0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:47.501644 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-1a84979c-7b9f-4a0e-b9c5-d0ff5d4d9a0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:47.509824 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 824/1662] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:27:47 2022] DELETE /identity/v3/projects/879d579523934c009d0f0c4cc7db6e07 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:27:47.516741 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a63b9-496a-4a76-a612-d523fe8eb4e6 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:47.517010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a63b9-496a-4a76-a612-d523fe8eb4e6 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:47.518451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a63b9-496a-4a76-a612-d523fe8eb4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:47.577344 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-872a63b9-496a-4a76-a612-d523fe8eb4e6 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:47.580837 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-872a63b9-496a-4a76-a612-d523fe8eb4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:47.591643 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:47.814116 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 839/1663] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:47.822114 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d3f8e-755c-4776-ac4e-00000050c55b None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:47.835720 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d3f8e-755c-4776-ac4e-00000050c55b None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:47.836503 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d3f8e-755c-4776-ac4e-00000050c55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:47.902771 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-fd5d3f8e-755c-4776-ac4e-00000050c55b None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:47.905652 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-fd5d3f8e-755c-4776-ac4e-00000050c55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:47.931510 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 825/1664] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:47.934752 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a63b9-496a-4a76-a612-d523fe8eb4e6 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:47.963875 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a63b9-496a-4a76-a612-d523fe8eb4e6 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:47.989336 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389022a-3f5f-49f7-94c6-ca9f19c86de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:47.991003 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389022a-3f5f-49f7-94c6-ca9f19c86de0 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:47.991988 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389022a-3f5f-49f7-94c6-ca9f19c86de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:47.992727 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389022a-3f5f-49f7-94c6-ca9f19c86de0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:47.994747 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389022a-3f5f-49f7-94c6-ca9f19c86de0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:27:47.995534 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389022a-3f5f-49f7-94c6-ca9f19c86de0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:48.000473 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389022a-3f5f-49f7-94c6-ca9f19c86de0 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:48.067833 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 840/1665] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:27:48.075870 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d3f8e-755c-4776-ac4e-00000050c55b None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:48.096215 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389022a-3f5f-49f7-94c6-ca9f19c86de0 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:48.102101 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-1389022a-3f5f-49f7-94c6-ca9f19c86de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:48.123465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d3f8e-755c-4776-ac4e-00000050c55b None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:48.168835 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389022a-3f5f-49f7-94c6-ca9f19c86de0 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:48.177090 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23eb57-1de6-4ee3-bf7d-3017868a01b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:48.179593 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23eb57-1de6-4ee3-bf7d-3017868a01b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:48.180092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23eb57-1de6-4ee3-bf7d-3017868a01b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:48.180635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23eb57-1de6-4ee3-bf7d-3017868a01b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:48.189185 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23eb57-1de6-4ee3-bf7d-3017868a01b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:48.211292 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec731f96-4464-4891-bc2a-110d0b7ee8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:48.212156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23eb57-1de6-4ee3-bf7d-3017868a01b7 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:48.215168 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec731f96-4464-4891-bc2a-110d0b7ee8af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:48.215168 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec731f96-4464-4891-bc2a-110d0b7ee8af admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:48.215168 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec731f96-4464-4891-bc2a-110d0b7ee8af admin admin] PATH_INFO: `/v3/projects/95edc0ad1535457bb42cabef20825e41` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:48.228560 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec731f96-4464-4891-bc2a-110d0b7ee8af admin admin] RBAC: Authorizing `identity:delete_project(project_id=95edc0ad1535457bb42cabef20825e41)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:48.238252 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec731f96-4464-4891-bc2a-110d0b7ee8af admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:48.345168 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 826/1666] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:27:48 2022] POST /identity/v3/projects => generated 403 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:27:48.354113 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23eb57-1de6-4ee3-bf7d-3017868a01b7 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:48.451344 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-ec731f96-4464-4891-bc2a-110d0b7ee8af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95edc0ad1535457bb42cabef20825e41', 'request_id': 'req-ec731f96-4464-4891-bc2a-110d0b7ee8af'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:48.525103 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-ec731f96-4464-4891-bc2a-110d0b7ee8af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95edc0ad1535457bb42cabef20825e41', 'request_id': 'req-ec731f96-4464-4891-bc2a-110d0b7ee8af'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:48.562531 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-ec731f96-4464-4891-bc2a-110d0b7ee8af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95edc0ad1535457bb42cabef20825e41', 'request_id': 'req-ec731f96-4464-4891-bc2a-110d0b7ee8af'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:48.643707 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-ec731f96-4464-4891-bc2a-110d0b7ee8af admin admin] The token cache is being invalidate because project 95edc0ad1535457bb42cabef20825e41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:27:48.644770 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-ec731f96-4464-4891-bc2a-110d0b7ee8af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:48.649671 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-ec731f96-4464-4891-bc2a-110d0b7ee8af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:48.659011 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 841/1667] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:27:48 2022] DELETE /identity/v3/projects/95edc0ad1535457bb42cabef20825e41 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:27:48.663364 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec731f96-4464-4891-bc2a-110d0b7ee8af admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:48.666032 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-ec731f96-4464-4891-bc2a-110d0b7ee8af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:48.699287 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23eb57-1de6-4ee3-bf7d-3017868a01b7 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:48.910856 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087270c-7082-4dfb-a02e-b9d5a91732ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:48.911721 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087270c-7082-4dfb-a02e-b9d5a91732ac admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:48.912980 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087270c-7082-4dfb-a02e-b9d5a91732ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:48.913472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087270c-7082-4dfb-a02e-b9d5a91732ac admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:48.919004 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087270c-7082-4dfb-a02e-b9d5a91732ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:48.924649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087270c-7082-4dfb-a02e-b9d5a91732ac admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:48.931514 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec731f96-4464-4891-bc2a-110d0b7ee8af admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:48.940213 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:48.961153 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46cde5d-efc2-4de9-aa01-7a6bc6f30076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:48.967433 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cde5d-efc2-4de9-aa01-7a6bc6f30076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:48.970663 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cde5d-efc2-4de9-aa01-7a6bc6f30076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:48.972680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cde5d-efc2-4de9-aa01-7a6bc6f30076 admin admin] PATH_INFO: `/v3/users/40c6ef9de5374f3d85c7b7de41792139` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:48.974301 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 827/1668] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:27:48 2022] POST /identity/v3/users => generated 302 bytes in 622 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:27:48.986342 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087270c-7082-4dfb-a02e-b9d5a91732ac admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:48.990439 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-9087270c-7082-4dfb-a02e-b9d5a91732ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:48.991827 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46cde5d-efc2-4de9-aa01-7a6bc6f30076 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40c6ef9de5374f3d85c7b7de41792139)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:49.006849 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46cde5d-efc2-4de9-aa01-7a6bc6f30076 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:49.024034 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087270c-7082-4dfb-a02e-b9d5a91732ac admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:49.049044 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b38f7a-c8be-4458-9ad6-0717c39ae696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:49.050913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b38f7a-c8be-4458-9ad6-0717c39ae696 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:49.053843 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b38f7a-c8be-4458-9ad6-0717c39ae696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:49.057446 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b38f7a-c8be-4458-9ad6-0717c39ae696 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:49.059214 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b38f7a-c8be-4458-9ad6-0717c39ae696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:49.067799 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b38f7a-c8be-4458-9ad6-0717c39ae696 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:49.126679 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 828/1669] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:27:49.131575 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b38f7a-c8be-4458-9ad6-0717c39ae696 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:49.140112 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:49.196045 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b38f7a-c8be-4458-9ad6-0717c39ae696 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:49.207114 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-f46cde5d-efc2-4de9-aa01-7a6bc6f30076 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40c6ef9de5374f3d85c7b7de41792139'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:49.211539 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-f46cde5d-efc2-4de9-aa01-7a6bc6f30076 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40c6ef9de5374f3d85c7b7de41792139'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:49.230325 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3c81d-0473-4c86-af2b-628e88748359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:49.233874 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3c81d-0473-4c86-af2b-628e88748359 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:49.233874 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3c81d-0473-4c86-af2b-628e88748359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:49.237125 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-f46cde5d-efc2-4de9-aa01-7a6bc6f30076 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40c6ef9de5374f3d85c7b7de41792139'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:49.238974 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3c81d-0473-4c86-af2b-628e88748359 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:49.241955 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3c81d-0473-4c86-af2b-628e88748359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:49.251746 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3c81d-0473-4c86-af2b-628e88748359 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:49.267429 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-f46cde5d-efc2-4de9-aa01-7a6bc6f30076 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40c6ef9de5374f3d85c7b7de41792139'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:49.309677 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 829/1670] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:27:49.318574 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3c81d-0473-4c86-af2b-628e88748359 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:49.319721 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-f46cde5d-efc2-4de9-aa01-7a6bc6f30076 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40c6ef9de5374f3d85c7b7de41792139'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:49.329429 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-d7c3c81d-0473-4c86-af2b-628e88748359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:49.356055 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 842/1671] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:27:48 2022] DELETE /identity/v3/users/40c6ef9de5374f3d85c7b7de41792139 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:27:49.420264 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3c81d-0473-4c86-af2b-628e88748359 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:49.652950 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe0524-f268-4ffa-bec9-e0522bc9299a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:49.654826 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe0524-f268-4ffa-bec9-e0522bc9299a admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:49.655761 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe0524-f268-4ffa-bec9-e0522bc9299a admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:49.656509 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe0524-f268-4ffa-bec9-e0522bc9299a admin admin] PATH_INFO: `/v3/projects/41933003737d4421b66262a68273292e/users/08abb3fa39364686804f7e1a596ed3ba/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:49.706153 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe0524-f268-4ffa-bec9-e0522bc9299a admin admin] RBAC: Authorizing `identity:create_grant(project_id=41933003737d4421b66262a68273292e, user_id=08abb3fa39364686804f7e1a596ed3ba, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:49.720014 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe0524-f268-4ffa-bec9-e0522bc9299a admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:49.767827 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 830/1672] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:27:49 2022] PUT /identity/v3/projects/41933003737d4421b66262a68273292e/users/08abb3fa39364686804f7e1a596ed3ba/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:27:49.781782 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc67a4-273e-46ad-8a4f-67323de8cd20 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:49.783107 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc67a4-273e-46ad-8a4f-67323de8cd20 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:49.783322 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc67a4-273e-46ad-8a4f-67323de8cd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:49.859170 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-58fc67a4-273e-46ad-8a4f-67323de8cd20 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:49.864622 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-58fc67a4-273e-46ad-8a4f-67323de8cd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:49.873753 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe0524-f268-4ffa-bec9-e0522bc9299a admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:49.876893 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-3abe0524-f268-4ffa-bec9-e0522bc9299a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:50.161534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe0524-f268-4ffa-bec9-e0522bc9299a admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:50.183430 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a51fc-d61d-4319-97e8-259281d90db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:50.186693 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a51fc-d61d-4319-97e8-259281d90db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:50.191825 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a51fc-d61d-4319-97e8-259281d90db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:50.192637 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a51fc-d61d-4319-97e8-259281d90db1 admin admin] PATH_INFO: `/v3/projects/377327fdaab64a01886a485b980cb95c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:50.197544 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a51fc-d61d-4319-97e8-259281d90db1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=377327fdaab64a01886a485b980cb95c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:50.204109 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a51fc-d61d-4319-97e8-259281d90db1 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:50.251892 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 843/1673] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:50.406049 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-0c8a51fc-d61d-4319-97e8-259281d90db1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '377327fdaab64a01886a485b980cb95c', 'request_id': 'req-0c8a51fc-d61d-4319-97e8-259281d90db1'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:50.425225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-0c8a51fc-d61d-4319-97e8-259281d90db1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '377327fdaab64a01886a485b980cb95c', 'request_id': 'req-0c8a51fc-d61d-4319-97e8-259281d90db1'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:50.428775 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:INSERT=3,keystone:SELECT=93,keystone:DELETE=4 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:50.442156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-0c8a51fc-d61d-4319-97e8-259281d90db1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '377327fdaab64a01886a485b980cb95c', 'request_id': 'req-0c8a51fc-d61d-4319-97e8-259281d90db1'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:50.476674 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-0c8a51fc-d61d-4319-97e8-259281d90db1 admin admin] The token cache is being invalidate because project 377327fdaab64a01886a485b980cb95c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:27:50.477341 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-0c8a51fc-d61d-4319-97e8-259281d90db1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:50.478731 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-0c8a51fc-d61d-4319-97e8-259281d90db1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:50.494335 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 831/1674] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:27:49 2022] DELETE /identity/v3/projects/377327fdaab64a01886a485b980cb95c => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:27:50.496593 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc67a4-273e-46ad-8a4f-67323de8cd20 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:50.535433 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc67a4-273e-46ad-8a4f-67323de8cd20 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:50.613461 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a51fc-d61d-4319-97e8-259281d90db1 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:50.615894 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-0c8a51fc-d61d-4319-97e8-259281d90db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:50.784845 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244cc1a-16d8-439e-aea1-b9abfaf81efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:50.790462 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244cc1a-16d8-439e-aea1-b9abfaf81efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:50.791011 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244cc1a-16d8-439e-aea1-b9abfaf81efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:50.794163 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244cc1a-16d8-439e-aea1-b9abfaf81efb admin admin] PATH_INFO: `/v3/users/d3223a1b8fa54f069fb262be5aea2a46` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:50.802205 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244cc1a-16d8-439e-aea1-b9abfaf81efb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3223a1b8fa54f069fb262be5aea2a46)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:50.807765 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244cc1a-16d8-439e-aea1-b9abfaf81efb admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:50.855633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a51fc-d61d-4319-97e8-259281d90db1 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:50.874603 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd04cb-54ca-4bca-af5a-1ca794b1c2f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:50.875622 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd04cb-54ca-4bca-af5a-1ca794b1c2f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:50.882676 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd04cb-54ca-4bca-af5a-1ca794b1c2f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:50.883251 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd04cb-54ca-4bca-af5a-1ca794b1c2f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:50.890403 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-c6bd04cb-54ca-4bca-af5a-1ca794b1c2f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:50.947083 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd04cb-54ca-4bca-af5a-1ca794b1c2f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:50.955697 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd04cb-54ca-4bca-af5a-1ca794b1c2f6 service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:50.984650 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:50.993210 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-3244cc1a-16d8-439e-aea1-b9abfaf81efb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3223a1b8fa54f069fb262be5aea2a46'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:50.996171 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-3244cc1a-16d8-439e-aea1-b9abfaf81efb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3223a1b8fa54f069fb262be5aea2a46'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:51.015111 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 832/1675] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:27:51.018106 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-3244cc1a-16d8-439e-aea1-b9abfaf81efb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3223a1b8fa54f069fb262be5aea2a46'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:51.050526 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-3244cc1a-16d8-439e-aea1-b9abfaf81efb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3223a1b8fa54f069fb262be5aea2a46'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:51.085069 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-3244cc1a-16d8-439e-aea1-b9abfaf81efb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3223a1b8fa54f069fb262be5aea2a46'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:51.101169 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 844/1676] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:27:50 2022] DELETE /identity/v3/users/d3223a1b8fa54f069fb262be5aea2a46 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:27:52.528605 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd04cb-54ca-4bca-af5a-1ca794b1c2f6 service neutron] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:52.535000 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-c6bd04cb-54ca-4bca-af5a-1ca794b1c2f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:52.577717 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd04cb-54ca-4bca-af5a-1ca794b1c2f6 service neutron] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:52.864572 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba928c-13f3-4ef5-8a7c-c92617b31358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:52.866059 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba928c-13f3-4ef5-8a7c-c92617b31358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:52.866693 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba928c-13f3-4ef5-8a7c-c92617b31358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:52.867384 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba928c-13f3-4ef5-8a7c-c92617b31358 admin admin] PATH_INFO: `/v3/projects/241f150cc5fd4fa0a3b3a8d5619da577` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:52.874010 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba928c-13f3-4ef5-8a7c-c92617b31358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=241f150cc5fd4fa0a3b3a8d5619da577)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:52.878805 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba928c-13f3-4ef5-8a7c-c92617b31358 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:53.095635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-48ba928c-13f3-4ef5-8a7c-c92617b31358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '241f150cc5fd4fa0a3b3a8d5619da577', 'request_id': 'req-48ba928c-13f3-4ef5-8a7c-c92617b31358'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:53.122108 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-48ba928c-13f3-4ef5-8a7c-c92617b31358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '241f150cc5fd4fa0a3b3a8d5619da577', 'request_id': 'req-48ba928c-13f3-4ef5-8a7c-c92617b31358'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:53.149647 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-48ba928c-13f3-4ef5-8a7c-c92617b31358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '241f150cc5fd4fa0a3b3a8d5619da577', 'request_id': 'req-48ba928c-13f3-4ef5-8a7c-c92617b31358'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:53.195075 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-48ba928c-13f3-4ef5-8a7c-c92617b31358 admin admin] The token cache is being invalidate because project 241f150cc5fd4fa0a3b3a8d5619da577 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:27:53.195439 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-48ba928c-13f3-4ef5-8a7c-c92617b31358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:53.203477 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-48ba928c-13f3-4ef5-8a7c-c92617b31358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:53.212762 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 833/1677] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:27:52 2022] DELETE /identity/v3/projects/241f150cc5fd4fa0a3b3a8d5619da577 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:27:53.214900 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8813fd-35aa-4b3a-ad70-d3caaec609b1 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:53.215643 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8813fd-35aa-4b3a-ad70-d3caaec609b1 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:53.215643 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8813fd-35aa-4b3a-ad70-d3caaec609b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:53.278868 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-3f8813fd-35aa-4b3a-ad70-d3caaec609b1 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:53.291095 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-3f8813fd-35aa-4b3a-ad70-d3caaec609b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:53.448126 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 845/1678] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:27:53.457900 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c91524-3c77-4f2a-99d0-fc46e43a4023 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:53.458399 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c91524-3c77-4f2a-99d0-fc46e43a4023 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:53.458714 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c91524-3c77-4f2a-99d0-fc46e43a4023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:53.517425 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-51c91524-3c77-4f2a-99d0-fc46e43a4023 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:53.530647 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-51c91524-3c77-4f2a-99d0-fc46e43a4023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:53.577894 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 834/1679] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:53.584108 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8813fd-35aa-4b3a-ad70-d3caaec609b1 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:53.615284 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8813fd-35aa-4b3a-ad70-d3caaec609b1 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:53.645010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e15ba-d6b1-4760-be37-a73949c14c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:53.646069 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e15ba-d6b1-4760-be37-a73949c14c32 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:53.646526 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e15ba-d6b1-4760-be37-a73949c14c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:53.646979 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e15ba-d6b1-4760-be37-a73949c14c32 admin admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:53.653055 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e15ba-d6b1-4760-be37-a73949c14c32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:27:53.655893 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e15ba-d6b1-4760-be37-a73949c14c32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:53.665961 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e15ba-d6b1-4760-be37-a73949c14c32 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:53.721440 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 846/1680] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:27:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:27:53.724642 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c91524-3c77-4f2a-99d0-fc46e43a4023 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:53.759212 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c91524-3c77-4f2a-99d0-fc46e43a4023 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:53.815755 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4a55d-9c24-4e40-8b29-6c1d6b020245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:53.823740 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4a55d-9c24-4e40-8b29-6c1d6b020245 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:53.824625 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4a55d-9c24-4e40-8b29-6c1d6b020245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:53.828548 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4a55d-9c24-4e40-8b29-6c1d6b020245 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:53.830281 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc4a55d-9c24-4e40-8b29-6c1d6b020245 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:53.846276 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc4a55d-9c24-4e40-8b29-6c1d6b020245 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:53.880297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:53.966782 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 835/1681] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:27:53 2022] POST /identity/v3/projects => generated 379 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:27:53.970499 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e15ba-d6b1-4760-be37-a73949c14c32 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:54.021563 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e15ba-d6b1-4760-be37-a73949c14c32 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:54.285609 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff02d7e-2112-49c0-824a-942a2ed9621d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:54.286803 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff02d7e-2112-49c0-824a-942a2ed9621d admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:54.287907 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff02d7e-2112-49c0-824a-942a2ed9621d admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:54.287907 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff02d7e-2112-49c0-824a-942a2ed9621d admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:54.289074 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff02d7e-2112-49c0-824a-942a2ed9621d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:54.292432 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff02d7e-2112-49c0-824a-942a2ed9621d admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:54.384530 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 847/1682] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:27:53 2022] POST /identity/v3/users => generated 290 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:27:54.385628 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4a55d-9c24-4e40-8b29-6c1d6b020245 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:54.445527 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4a55d-9c24-4e40-8b29-6c1d6b020245 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:54.461089 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500a194-9a92-4313-85b2-30a9d9f42e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:54.461089 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500a194-9a92-4313-85b2-30a9d9f42e23 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:54.463258 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500a194-9a92-4313-85b2-30a9d9f42e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:54.464149 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500a194-9a92-4313-85b2-30a9d9f42e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:54.468215 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1500a194-9a92-4313-85b2-30a9d9f42e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:54.478158 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1500a194-9a92-4313-85b2-30a9d9f42e23 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:54.525413 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 836/1683] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:27:54.528074 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff02d7e-2112-49c0-824a-942a2ed9621d admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:54.541858 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500a194-9a92-4313-85b2-30a9d9f42e23 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:54.548349 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-1500a194-9a92-4313-85b2-30a9d9f42e23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:54.570440 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff02d7e-2112-49c0-824a-942a2ed9621d admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:54.610871 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffce91-8d38-4773-a398-8db1dc29f66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:54.612223 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffce91-8d38-4773-a398-8db1dc29f66f admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:54.612857 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffce91-8d38-4773-a398-8db1dc29f66f admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:54.618502 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffce91-8d38-4773-a398-8db1dc29f66f admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:54.619580 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ffce91-8d38-4773-a398-8db1dc29f66f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:54.621755 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ffce91-8d38-4773-a398-8db1dc29f66f admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:54.639947 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500a194-9a92-4313-85b2-30a9d9f42e23 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:54.658171 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 848/1684] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:27:54.660062 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0bb741-9be9-4845-9454-1a491d3776cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:54.660844 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bb741-9be9-4845-9454-1a491d3776cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:54.661451 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bb741-9be9-4845-9454-1a491d3776cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:54.664390 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffce91-8d38-4773-a398-8db1dc29f66f admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:54.666048 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bb741-9be9-4845-9454-1a491d3776cc admin admin] PATH_INFO: `/v3/projects/fa7d028322ac4e118d3e7812ffabfa98` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:54.673636 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0bb741-9be9-4845-9454-1a491d3776cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa7d028322ac4e118d3e7812ffabfa98)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:54.688993 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffce91-8d38-4773-a398-8db1dc29f66f admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:54.690309 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0bb741-9be9-4845-9454-1a491d3776cc admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:54.705675 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd28e53-8e63-406e-9898-66cc04e8f5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:54.707584 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd28e53-8e63-406e-9898-66cc04e8f5a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:54.708247 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd28e53-8e63-406e-9898-66cc04e8f5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:54.708876 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd28e53-8e63-406e-9898-66cc04e8f5a9 admin admin] PATH_INFO: `/v3/projects/fcadb3a03e2a4ad49a041887b429ca6c/users/ac5e2bb2419e4014b47d1f57a2ad50c1/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:54.768773 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd28e53-8e63-406e-9898-66cc04e8f5a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcadb3a03e2a4ad49a041887b429ca6c, user_id=ac5e2bb2419e4014b47d1f57a2ad50c1, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:54.779724 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd28e53-8e63-406e-9898-66cc04e8f5a9 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:54.841806 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 849/1685] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:27:54 2022] PUT /identity/v3/projects/fcadb3a03e2a4ad49a041887b429ca6c/users/ac5e2bb2419e4014b47d1f57a2ad50c1/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:27:54.855334 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f198d8c-0ac8-4b24-a414-69c78d3ee725 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:54.857607 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f198d8c-0ac8-4b24-a414-69c78d3ee725 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:54.860101 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f198d8c-0ac8-4b24-a414-69c78d3ee725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:54.922343 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:54.936775 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-1e0bb741-9be9-4845-9454-1a491d3776cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa7d028322ac4e118d3e7812ffabfa98', 'request_id': 'req-1e0bb741-9be9-4845-9454-1a491d3776cc'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:54.964601 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-1e0bb741-9be9-4845-9454-1a491d3776cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa7d028322ac4e118d3e7812ffabfa98', 'request_id': 'req-1e0bb741-9be9-4845-9454-1a491d3776cc'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:54.996137 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-1e0bb741-9be9-4845-9454-1a491d3776cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa7d028322ac4e118d3e7812ffabfa98', 'request_id': 'req-1e0bb741-9be9-4845-9454-1a491d3776cc'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:55.012971 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-3f198d8c-0ac8-4b24-a414-69c78d3ee725 None None] MFA Rules not processed for user `ac5e2bb2419e4014b47d1f57a2ad50c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:55.016975 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-3f198d8c-0ac8-4b24-a414-69c78d3ee725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:55.038167 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-1e0bb741-9be9-4845-9454-1a491d3776cc admin admin] The token cache is being invalidate because project fa7d028322ac4e118d3e7812ffabfa98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:27:55.038731 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-1e0bb741-9be9-4845-9454-1a491d3776cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:55.040493 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-1e0bb741-9be9-4845-9454-1a491d3776cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:55.048590 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 837/1686] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:27:54 2022] DELETE /identity/v3/projects/fa7d028322ac4e118d3e7812ffabfa98 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:27:55.055560 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6545e-8234-4a94-925f-9cf815995805 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:55.055764 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6545e-8234-4a94-925f-9cf815995805 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:55.056046 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6545e-8234-4a94-925f-9cf815995805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:55.115091 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-fda6545e-8234-4a94-925f-9cf815995805 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:55.121336 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-fda6545e-8234-4a94-925f-9cf815995805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:55.266527 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 850/1687] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:55.273326 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f198d8c-0ac8-4b24-a414-69c78d3ee725 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:55.276905 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-3f198d8c-0ac8-4b24-a414-69c78d3ee725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:55.460938 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 838/1688] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:55.484452 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e0eee-8de2-40c0-a466-d9d3541719b3 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:55.487677 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e0eee-8de2-40c0-a466-d9d3541719b3 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:55.488208 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e0eee-8de2-40c0-a466-d9d3541719b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:55.552055 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-4d2e0eee-8de2-40c0-a466-d9d3541719b3 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:55.558381 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f198d8c-0ac8-4b24-a414-69c78d3ee725 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:55.560004 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-4d2e0eee-8de2-40c0-a466-d9d3541719b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:55.591374 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 839/1689] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:55.600992 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e0eee-8de2-40c0-a466-d9d3541719b3 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:55.602112 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae44a98-ff9c-4e10-ac24-4c8690be2fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:55.603678 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae44a98-ff9c-4e10-ac24-4c8690be2fde admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:55.603955 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae44a98-ff9c-4e10-ac24-4c8690be2fde admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:55.604546 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae44a98-ff9c-4e10-ac24-4c8690be2fde admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:55.614350 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae44a98-ff9c-4e10-ac24-4c8690be2fde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:55.619153 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae44a98-ff9c-4e10-ac24-4c8690be2fde admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:55.636895 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e0eee-8de2-40c0-a466-d9d3541719b3 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:55.649343 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25da767-0b7b-42df-91ab-48f8f98be08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:55.650183 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25da767-0b7b-42df-91ab-48f8f98be08d admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:55.650476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25da767-0b7b-42df-91ab-48f8f98be08d admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:55.650952 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25da767-0b7b-42df-91ab-48f8f98be08d admin admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:55.651657 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25da767-0b7b-42df-91ab-48f8f98be08d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:27:55.651967 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25da767-0b7b-42df-91ab-48f8f98be08d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:55.655789 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25da767-0b7b-42df-91ab-48f8f98be08d admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:55.707447 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 840/1690] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:27:55.716137 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25da767-0b7b-42df-91ab-48f8f98be08d admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:55.747548 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25da767-0b7b-42df-91ab-48f8f98be08d admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:55.766454 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43f503-da72-42cd-950f-4427e9f8067d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:55.767226 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43f503-da72-42cd-950f-4427e9f8067d admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:55.767513 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43f503-da72-42cd-950f-4427e9f8067d admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:55.767792 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43f503-da72-42cd-950f-4427e9f8067d admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:55.768455 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43f503-da72-42cd-950f-4427e9f8067d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:55.771043 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 851/1691] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:27:55 2022] POST /identity/v3/projects => generated 377 bytes in 492 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:27:55.771287 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43f503-da72-42cd-950f-4427e9f8067d admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:55.777127 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae44a98-ff9c-4e10-ac24-4c8690be2fde admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:55.874360 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 841/1692] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:27:55 2022] POST /identity/v3/projects => generated 375 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:27:55.880336 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43f503-da72-42cd-950f-4427e9f8067d admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:55.991233 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:56.189097 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae44a98-ff9c-4e10-ac24-4c8690be2fde admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:56.311677 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43f503-da72-42cd-950f-4427e9f8067d admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:56.318091 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:56.337404 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4289f-f677-4cc0-a4b0-2a7916da3054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:56.345340 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4289f-f677-4cc0-a4b0-2a7916da3054 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:56.347193 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4289f-f677-4cc0-a4b0-2a7916da3054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:56.348859 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4289f-f677-4cc0-a4b0-2a7916da3054 admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:56.357118 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4289f-f677-4cc0-a4b0-2a7916da3054 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:56.370588 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4289f-f677-4cc0-a4b0-2a7916da3054 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:56.456977 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 842/1693] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:27:55 2022] POST /identity/v3/users => generated 288 bytes in 577 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:27:56.458448 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4289f-f677-4cc0-a4b0-2a7916da3054 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:56.498536 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4289f-f677-4cc0-a4b0-2a7916da3054 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:56.524509 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2c8cc-c68b-40af-8e87-1b66caf0624d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:56.524940 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2c8cc-c68b-40af-8e87-1b66caf0624d admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:56.525304 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2c8cc-c68b-40af-8e87-1b66caf0624d admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:56.525810 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2c8cc-c68b-40af-8e87-1b66caf0624d admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:56.527168 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2c8cc-c68b-40af-8e87-1b66caf0624d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:56.530294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2c8cc-c68b-40af-8e87-1b66caf0624d admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:56.536365 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf127fd-5de3-458a-939e-0e2f66645e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:56.539804 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf127fd-5de3-458a-939e-0e2f66645e2d admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:56.541360 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf127fd-5de3-458a-939e-0e2f66645e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:56.541360 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf127fd-5de3-458a-939e-0e2f66645e2d admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:56.548511 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf127fd-5de3-458a-939e-0e2f66645e2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:56.585079 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf127fd-5de3-458a-939e-0e2f66645e2d admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:56.586089 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 843/1694] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:27:56.586089 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2c8cc-c68b-40af-8e87-1b66caf0624d admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:56.605016 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2c8cc-c68b-40af-8e87-1b66caf0624d admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:56.619980 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212637e-cf30-47d2-96a1-ba009cf37f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:56.621994 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212637e-cf30-47d2-96a1-ba009cf37f0b admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:56.623473 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212637e-cf30-47d2-96a1-ba009cf37f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:56.624297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212637e-cf30-47d2-96a1-ba009cf37f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:56.627200 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e212637e-cf30-47d2-96a1-ba009cf37f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:56.631616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e212637e-cf30-47d2-96a1-ba009cf37f0b admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:56.650476 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 852/1695] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:27:55 2022] POST /identity/v3/users => generated 295 bytes in 876 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:27:56.653683 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf127fd-5de3-458a-939e-0e2f66645e2d admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:56.676135 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 844/1696] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:27:56.681560 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212637e-cf30-47d2-96a1-ba009cf37f0b admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:56.701878 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf127fd-5de3-458a-939e-0e2f66645e2d admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:56.718040 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc0b45-513b-432c-a381-28732f4b5a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:56.718730 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc0b45-513b-432c-a381-28732f4b5a56 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:56.719192 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc0b45-513b-432c-a381-28732f4b5a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:56.719355 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc0b45-513b-432c-a381-28732f4b5a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:56.720100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc0b45-513b-432c-a381-28732f4b5a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:56.722744 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212637e-cf30-47d2-96a1-ba009cf37f0b admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:56.727165 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc0b45-513b-432c-a381-28732f4b5a56 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:56.760167 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd3e98-4834-486b-9e05-9330c1695e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:56.760167 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd3e98-4834-486b-9e05-9330c1695e80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:56.760167 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd3e98-4834-486b-9e05-9330c1695e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:56.760167 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd3e98-4834-486b-9e05-9330c1695e80 admin admin] PATH_INFO: `/v3/projects/929e36d97bc14eb8a3a69769476e832b/users/8d7cdf34f3074e11964cb0dd75aa928d/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:56.798877 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 853/1697] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:27:56.800571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc0b45-513b-432c-a381-28732f4b5a56 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:56.818714 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd3e98-4834-486b-9e05-9330c1695e80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=929e36d97bc14eb8a3a69769476e832b, user_id=8d7cdf34f3074e11964cb0dd75aa928d, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:56.819989 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd3e98-4834-486b-9e05-9330c1695e80 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:56.846542 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc0b45-513b-432c-a381-28732f4b5a56 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:56.869280 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 845/1698] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:27:56 2022] PUT /identity/v3/projects/929e36d97bc14eb8a3a69769476e832b/users/8d7cdf34f3074e11964cb0dd75aa928d/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:27:56.872016 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee5403-7b11-43df-8beb-2ab563f9b20b None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:56.872503 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee5403-7b11-43df-8beb-2ab563f9b20b None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:56.872983 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee5403-7b11-43df-8beb-2ab563f9b20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:56.956202 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-1fee5403-7b11-43df-8beb-2ab563f9b20b None None] MFA Rules not processed for user `8d7cdf34f3074e11964cb0dd75aa928d`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:56.957726 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-1fee5403-7b11-43df-8beb-2ab563f9b20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:57.240848 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e15fea-94cd-4dda-b0d2-16e92865ef2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:57.242864 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e15fea-94cd-4dda-b0d2-16e92865ef2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:57.243369 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e15fea-94cd-4dda-b0d2-16e92865ef2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:57.243863 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e15fea-94cd-4dda-b0d2-16e92865ef2b admin admin] PATH_INFO: `/v3/projects/870af9b2c1fc42f588569f7d14659f1e/users/0c81fbdfa6854260a40bf2f59537a1d7/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:57.323392 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e15fea-94cd-4dda-b0d2-16e92865ef2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=870af9b2c1fc42f588569f7d14659f1e, user_id=0c81fbdfa6854260a40bf2f59537a1d7, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:57.328867 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 846/1699] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:57.345528 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e15fea-94cd-4dda-b0d2-16e92865ef2b admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:57.347035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee5403-7b11-43df-8beb-2ab563f9b20b None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:57.413638 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 854/1700] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:27:56 2022] PUT /identity/v3/projects/870af9b2c1fc42f588569f7d14659f1e/users/0c81fbdfa6854260a40bf2f59537a1d7/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:27:57.418859 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e15fea-94cd-4dda-b0d2-16e92865ef2b admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:57.447289 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee5403-7b11-43df-8beb-2ab563f9b20b None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:57.752060 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:57.799172 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae55eaf-e366-469d-927b-92ac147dd4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:57.803231 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae55eaf-e366-469d-927b-92ac147dd4c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:57.803742 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae55eaf-e366-469d-927b-92ac147dd4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:57.804273 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae55eaf-e366-469d-927b-92ac147dd4c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:57.805684 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae55eaf-e366-469d-927b-92ac147dd4c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:57.809788 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae55eaf-e366-469d-927b-92ac147dd4c4 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:57.839542 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e15fea-94cd-4dda-b0d2-16e92865ef2b admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:57.866724 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc1cc4-0cfd-4a82-b4ef-8b6e889340a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:57.872583 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc1cc4-0cfd-4a82-b4ef-8b6e889340a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:57.876372 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc1cc4-0cfd-4a82-b4ef-8b6e889340a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:57.877266 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc1cc4-0cfd-4a82-b4ef-8b6e889340a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:57.885585 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc1cc4-0cfd-4a82-b4ef-8b6e889340a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:57.894090 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc1cc4-0cfd-4a82-b4ef-8b6e889340a2 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:57.925238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 847/1701] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:27:57 2022] POST /identity/v3/projects => generated 375 bytes in 588 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:27:57.932516 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae55eaf-e366-469d-927b-92ac147dd4c4 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:57.952822 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 855/1702] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 535 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:27:57.959414 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc1cc4-0cfd-4a82-b4ef-8b6e889340a2 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:57.983490 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc1cc4-0cfd-4a82-b4ef-8b6e889340a2 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:58.072407 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:58.167930 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae55eaf-e366-469d-927b-92ac147dd4c4 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:58.194503 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51dec0-aee8-45bc-a2f8-c545d4b189b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:58.196031 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51dec0-aee8-45bc-a2f8-c545d4b189b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:58.198022 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51dec0-aee8-45bc-a2f8-c545d4b189b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:58.198699 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51dec0-aee8-45bc-a2f8-c545d4b189b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:58.200559 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51dec0-aee8-45bc-a2f8-c545d4b189b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:58.204186 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51dec0-aee8-45bc-a2f8-c545d4b189b8 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:58.250319 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d4515-b61d-4fb3-95d4-fe99d7318025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:58.251427 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d4515-b61d-4fb3-95d4-fe99d7318025 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:58.252370 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d4515-b61d-4fb3-95d4-fe99d7318025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:58.252830 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d4515-b61d-4fb3-95d4-fe99d7318025 admin admin] PATH_INFO: `/v3/projects/870af9b2c1fc42f588569f7d14659f1e/users/0c81fbdfa6854260a40bf2f59537a1d7/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:58.263366 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d4515-b61d-4fb3-95d4-fe99d7318025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=870af9b2c1fc42f588569f7d14659f1e, user_id=0c81fbdfa6854260a40bf2f59537a1d7, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:58.275233 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d4515-b61d-4fb3-95d4-fe99d7318025 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:58.299179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 848/1703] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:27:57 2022] POST /identity/v3/users => generated 294 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:27:58.306467 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51dec0-aee8-45bc-a2f8-c545d4b189b8 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:58.331027 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 856/1704] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:27:57 2022] PUT /identity/v3/projects/870af9b2c1fc42f588569f7d14659f1e/users/0c81fbdfa6854260a40bf2f59537a1d7/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:27:58.356438 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51dec0-aee8-45bc-a2f8-c545d4b189b8 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:58.361167 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180a7f4-5877-4664-b8c4-032373617268 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:58.362748 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180a7f4-5877-4664-b8c4-032373617268 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:58.363797 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180a7f4-5877-4664-b8c4-032373617268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:58.495854 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-f180a7f4-5877-4664-b8c4-032373617268 None None] MFA Rules not processed for user `0c81fbdfa6854260a40bf2f59537a1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:58.498571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-f180a7f4-5877-4664-b8c4-032373617268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:58.677972 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82374cc9-8f3d-4f49-b3fe-90e29a1a8ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:58.680180 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82374cc9-8f3d-4f49-b3fe-90e29a1a8ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:58.680324 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82374cc9-8f3d-4f49-b3fe-90e29a1a8ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:58.680800 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82374cc9-8f3d-4f49-b3fe-90e29a1a8ea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:58.705571 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82374cc9-8f3d-4f49-b3fe-90e29a1a8ea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:58.712310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82374cc9-8f3d-4f49-b3fe-90e29a1a8ea3 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:58.830432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 849/1705] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 518 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:27:58.835607 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82374cc9-8f3d-4f49-b3fe-90e29a1a8ea3 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:58.849334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-82374cc9-8f3d-4f49-b3fe-90e29a1a8ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:58.959309 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82374cc9-8f3d-4f49-b3fe-90e29a1a8ea3 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:58.996192 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 857/1706] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 642 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:59.017872 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078a16d-233a-4ff8-9c28-c41fb5c83bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:59.017872 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078a16d-233a-4ff8-9c28-c41fb5c83bcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:59.019847 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180a7f4-5877-4664-b8c4-032373617268 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:59.028061 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078a16d-233a-4ff8-9c28-c41fb5c83bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:59.030908 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078a16d-233a-4ff8-9c28-c41fb5c83bcf admin admin] PATH_INFO: `/v3/users/94743715df794202a31ee31187e1d41e` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:59.036961 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078a16d-233a-4ff8-9c28-c41fb5c83bcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=94743715df794202a31ee31187e1d41e)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:59.046902 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078a16d-233a-4ff8-9c28-c41fb5c83bcf admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:59.076103 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180a7f4-5877-4664-b8c4-032373617268 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:59.110069 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb541b-3d9c-4f09-a94b-6c86bd3cd352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:59.120378 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb541b-3d9c-4f09-a94b-6c86bd3cd352 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:59.120378 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb541b-3d9c-4f09-a94b-6c86bd3cd352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:59.120378 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb541b-3d9c-4f09-a94b-6c86bd3cd352 admin admin] PATH_INFO: `/v3/projects/c467c80b371b45c99e841839ccc494af/users/a36d940c85b64023a483c39017834d2d/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:59.202744 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb541b-3d9c-4f09-a94b-6c86bd3cd352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c467c80b371b45c99e841839ccc494af, user_id=a36d940c85b64023a483c39017834d2d, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:59.223027 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb541b-3d9c-4f09-a94b-6c86bd3cd352 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:59.261593 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-a078a16d-233a-4ff8-9c28-c41fb5c83bcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94743715df794202a31ee31187e1d41e'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:59.262570 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-a078a16d-233a-4ff8-9c28-c41fb5c83bcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94743715df794202a31ee31187e1d41e'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:59.282715 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-a078a16d-233a-4ff8-9c28-c41fb5c83bcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94743715df794202a31ee31187e1d41e'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:59.286131 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:59.300085 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 858/1707] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:27:58 2022] PUT /identity/v3/projects/c467c80b371b45c99e841839ccc494af/users/a36d940c85b64023a483c39017834d2d/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:27:59.302961 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe57a71-6654-4279-91a3-28365519ac5e None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:59.303380 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe57a71-6654-4279-91a3-28365519ac5e None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:59.303779 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe57a71-6654-4279-91a3-28365519ac5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:59.316920 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-a078a16d-233a-4ff8-9c28-c41fb5c83bcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94743715df794202a31ee31187e1d41e'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:59.322885 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-a078a16d-233a-4ff8-9c28-c41fb5c83bcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94743715df794202a31ee31187e1d41e'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:27:59.409178 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 850/1708] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:27:58 2022] DELETE /identity/v3/users/94743715df794202a31ee31187e1d41e => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:27:59.415575 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078a16d-233a-4ff8-9c28-c41fb5c83bcf admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:59.421567 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-a078a16d-233a-4ff8-9c28-c41fb5c83bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:59.476212 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-3fe57a71-6654-4279-91a3-28365519ac5e None None] MFA Rules not processed for user `08abb3fa39364686804f7e1a596ed3ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:59.478689 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-3fe57a71-6654-4279-91a3-28365519ac5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:59.717902 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 859/1709] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:27:59 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:59.717902 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe57a71-6654-4279-91a3-28365519ac5e None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:59.717902 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-3fe57a71-6654-4279-91a3-28365519ac5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:59.726309 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078a16d-233a-4ff8-9c28-c41fb5c83bcf admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:59.747287 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b8979-c790-4e72-98bc-604418f83e27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:59.748960 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b8979-c790-4e72-98bc-604418f83e27 service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:59.759249 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b8979-c790-4e72-98bc-604418f83e27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:59.760692 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b8979-c790-4e72-98bc-604418f83e27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:59.764814 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:59.771788 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-bc6b8979-c790-4e72-98bc-604418f83e27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:59.990419 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe57a71-6654-4279-91a3-28365519ac5e None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:00.003931 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fe678-9df0-41a1-a58c-d20ab1ef2c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:00.005785 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fe678-9df0-41a1-a58c-d20ab1ef2c9e admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:00.006436 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fe678-9df0-41a1-a58c-d20ab1ef2c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:00.007369 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fe678-9df0-41a1-a58c-d20ab1ef2c9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:00.011050 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71fe678-9df0-41a1-a58c-d20ab1ef2c9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:00.020740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71fe678-9df0-41a1-a58c-d20ab1ef2c9e admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:00.076773 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 860/1710] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:28:00.077036 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b8979-c790-4e72-98bc-604418f83e27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:00.079633 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa638a-bdc8-4073-b20e-250abaab4030 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:00.080109 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa638a-bdc8-4073-b20e-250abaab4030 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:00.080563 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa638a-bdc8-4073-b20e-250abaab4030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:00.081230 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b8979-c790-4e72-98bc-604418f83e27 service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:00.118146 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 851/1711] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 708 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:00.119839 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b8979-c790-4e72-98bc-604418f83e27 service cinder] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:00.130322 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-bc6b8979-c790-4e72-98bc-604418f83e27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:00.160278 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-eeaa638a-bdc8-4073-b20e-250abaab4030 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:00.164492 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-eeaa638a-bdc8-4073-b20e-250abaab4030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:00.182378 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b8979-c790-4e72-98bc-604418f83e27 service cinder] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:00.205123 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 861/1712] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:00.208851 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa638a-bdc8-4073-b20e-250abaab4030 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:00.221291 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2fb337-3bdb-4ea6-8619-badedf9858a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:00.224856 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fb337-3bdb-4ea6-8619-badedf9858a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:00.225557 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fb337-3bdb-4ea6-8619-badedf9858a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:00.226052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fb337-3bdb-4ea6-8619-badedf9858a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:00.227325 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2fb337-3bdb-4ea6-8619-badedf9858a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:00.240627 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2fb337-3bdb-4ea6-8619-badedf9858a5 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:00.255675 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa638a-bdc8-4073-b20e-250abaab4030 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:00.280063 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979143a9-091c-42cd-be43-857acb3fd69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:00.281619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979143a9-091c-42cd-be43-857acb3fd69b admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:00.282180 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979143a9-091c-42cd-be43-857acb3fd69b admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:00.283887 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979143a9-091c-42cd-be43-857acb3fd69b admin admin] PATH_INFO: `/v3/projects/c467c80b371b45c99e841839ccc494af/users/a36d940c85b64023a483c39017834d2d/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:00.294115 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979143a9-091c-42cd-be43-857acb3fd69b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c467c80b371b45c99e841839ccc494af, user_id=a36d940c85b64023a483c39017834d2d, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:00.300788 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979143a9-091c-42cd-be43-857acb3fd69b admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:00.372766 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 862/1713] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:28:00 2022] PUT /identity/v3/projects/c467c80b371b45c99e841839ccc494af/users/a36d940c85b64023a483c39017834d2d/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:00.390504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979143a9-091c-42cd-be43-857acb3fd69b admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:00.394027 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-979143a9-091c-42cd-be43-857acb3fd69b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:00.418580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 852/1714] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:28:00 2022] POST /identity/v3/projects => generated 403 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:28:00.421349 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8f5d0-07d7-4d20-b4f3-2a33ad7b943c None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:00.422469 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8f5d0-07d7-4d20-b4f3-2a33ad7b943c None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:00.423642 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8f5d0-07d7-4d20-b4f3-2a33ad7b943c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:00.554182 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-82d8f5d0-07d7-4d20-b4f3-2a33ad7b943c None None] MFA Rules not processed for user `a36d940c85b64023a483c39017834d2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:00.557112 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-82d8f5d0-07d7-4d20-b4f3-2a33ad7b943c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:00.627706 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979143a9-091c-42cd-be43-857acb3fd69b admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:00.862769 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:00.919006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70704dee-4fa8-4137-91f3-b182cdc1b124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:00.928062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70704dee-4fa8-4137-91f3-b182cdc1b124 service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:00.928510 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70704dee-4fa8-4137-91f3-b182cdc1b124 service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:00.929011 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70704dee-4fa8-4137-91f3-b182cdc1b124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:00.995194 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 853/1715] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 568 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:00.995194 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8f5d0-07d7-4d20-b4f3-2a33ad7b943c None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:01.113661 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:01.151684 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70704dee-4fa8-4137-91f3-b182cdc1b124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:01.155140 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70704dee-4fa8-4137-91f3-b182cdc1b124 service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:01.205963 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 863/1716] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 833 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:01.210469 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70704dee-4fa8-4137-91f3-b182cdc1b124 service neutron] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:01.216997 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-70704dee-4fa8-4137-91f3-b182cdc1b124 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:01.235245 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8f5d0-07d7-4d20-b4f3-2a33ad7b943c None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:01.245782 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6c450-bc2d-4bb1-9a53-28757e64a244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:01.246906 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6c450-bc2d-4bb1-9a53-28757e64a244 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:01.247323 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6c450-bc2d-4bb1-9a53-28757e64a244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:01.247774 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6c450-bc2d-4bb1-9a53-28757e64a244 admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:01.249121 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6c450-bc2d-4bb1-9a53-28757e64a244 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:01.254188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6c450-bc2d-4bb1-9a53-28757e64a244 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:01.324098 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 854/1717] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:28:00 2022] POST /identity/v3/users => generated 308 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:28:01.329289 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6c450-bc2d-4bb1-9a53-28757e64a244 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:01.380495 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6c450-bc2d-4bb1-9a53-28757e64a244 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:01.403265 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6e968-bf2a-4a04-a87f-adee59e6a264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:01.404468 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6e968-bf2a-4a04-a87f-adee59e6a264 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:01.405177 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6e968-bf2a-4a04-a87f-adee59e6a264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:01.407655 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6e968-bf2a-4a04-a87f-adee59e6a264 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:01.408589 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad6e968-bf2a-4a04-a87f-adee59e6a264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:01.416324 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad6e968-bf2a-4a04-a87f-adee59e6a264 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:01.477820 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 855/1718] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:28:01.480228 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6e968-bf2a-4a04-a87f-adee59e6a264 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:01.508013 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70704dee-4fa8-4137-91f3-b182cdc1b124 service neutron] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:01.526467 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6e968-bf2a-4a04-a87f-adee59e6a264 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:01.544893 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e705b-55b8-4be4-bddb-b9a880c60123 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:01.546481 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e705b-55b8-4be4-bddb-b9a880c60123 service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:01.548190 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e705b-55b8-4be4-bddb-b9a880c60123 service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:01.549300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ffb46-8e4a-4ebf-ac68-7a366829cb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:01.550237 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ffb46-8e4a-4ebf-ac68-7a366829cb78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:01.550528 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ffb46-8e4a-4ebf-ac68-7a366829cb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:01.550805 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ffb46-8e4a-4ebf-ac68-7a366829cb78 admin admin] PATH_INFO: `/v3/projects/641e4a5d1e614d52b031d745c113ead2/users/187851e27dc54b418400ebd4df42c483/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:01.551169 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e705b-55b8-4be4-bddb-b9a880c60123 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:01.558237 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-3e9e705b-55b8-4be4-bddb-b9a880c60123 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:01.596828 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ffb46-8e4a-4ebf-ac68-7a366829cb78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=641e4a5d1e614d52b031d745c113ead2, user_id=187851e27dc54b418400ebd4df42c483, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:01.601267 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ffb46-8e4a-4ebf-ac68-7a366829cb78 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:01.668783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 856/1719] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:28:01 2022] PUT /identity/v3/projects/641e4a5d1e614d52b031d745c113ead2/users/187851e27dc54b418400ebd4df42c483/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:28:01.674453 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ffb46-8e4a-4ebf-ac68-7a366829cb78 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:01.852455 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e705b-55b8-4be4-bddb-b9a880c60123 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:01.863871 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e705b-55b8-4be4-bddb-b9a880c60123 service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:01.923784 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 864/1720] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 717 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:01.989635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ffb46-8e4a-4ebf-ac68-7a366829cb78 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:02.003134 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1571d-ddf6-4401-9dd0-35d3eacedf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:02.005933 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1571d-ddf6-4401-9dd0-35d3eacedf62 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:02.010051 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1571d-ddf6-4401-9dd0-35d3eacedf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:02.010714 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1571d-ddf6-4401-9dd0-35d3eacedf62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:02.012255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1571d-ddf6-4401-9dd0-35d3eacedf62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:02.023503 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1571d-ddf6-4401-9dd0-35d3eacedf62 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:02.082310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 857/1721] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:28:02.088115 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e705b-55b8-4be4-bddb-b9a880c60123 service cinder] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:02.143526 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e705b-55b8-4be4-bddb-b9a880c60123 service cinder] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:02.179926 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442f1c6-fa4b-4767-bad5-2c741643ffc5 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:02.180429 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442f1c6-fa4b-4767-bad5-2c741643ffc5 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:02.180960 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442f1c6-fa4b-4767-bad5-2c741643ffc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:02.191482 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928db37-3674-4ea8-84ce-7757c0dd8593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:02.192538 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928db37-3674-4ea8-84ce-7757c0dd8593 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:02.193002 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928db37-3674-4ea8-84ce-7757c0dd8593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:02.193440 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928db37-3674-4ea8-84ce-7757c0dd8593 admin admin] PATH_INFO: `/v3/projects/641e4a5d1e614d52b031d745c113ead2/users/187851e27dc54b418400ebd4df42c483/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:02.208851 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928db37-3674-4ea8-84ce-7757c0dd8593 admin admin] RBAC: Authorizing `identity:create_grant(project_id=641e4a5d1e614d52b031d745c113ead2, user_id=187851e27dc54b418400ebd4df42c483, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:02.227412 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928db37-3674-4ea8-84ce-7757c0dd8593 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:02.276557 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 865/1722] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:28:02 2022] PUT /identity/v3/projects/641e4a5d1e614d52b031d745c113ead2/users/187851e27dc54b418400ebd4df42c483/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:02.372010 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-8442f1c6-fa4b-4767-bad5-2c741643ffc5 None None] MFA Rules not processed for user `081aba900bfd4ace9e9f49daf8d941a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:02.383636 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-8442f1c6-fa4b-4767-bad5-2c741643ffc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:02.614483 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:02.829410 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 858/1723] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 636 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:02.844420 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087047f-58ec-4da1-a3ea-69dcd66f776b None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:02.844686 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087047f-58ec-4da1-a3ea-69dcd66f776b None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:02.845310 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087047f-58ec-4da1-a3ea-69dcd66f776b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:02.872530 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442f1c6-fa4b-4767-bad5-2c741643ffc5 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:02.947949 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-9087047f-58ec-4da1-a3ea-69dcd66f776b None None] MFA Rules not processed for user `081aba900bfd4ace9e9f49daf8d941a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:02.957680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-9087047f-58ec-4da1-a3ea-69dcd66f776b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:03.009580 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 866/1724] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:03.054406 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087047f-58ec-4da1-a3ea-69dcd66f776b None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:03.058009 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-9087047f-58ec-4da1-a3ea-69dcd66f776b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:03.264457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442f1c6-fa4b-4767-bad5-2c741643ffc5 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:03.318129 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432dd90e-188e-4bf8-a97f-de914da7cb37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:03.339247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432dd90e-188e-4bf8-a97f-de914da7cb37 service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:03.339751 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432dd90e-188e-4bf8-a97f-de914da7cb37 service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:03.352680 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432dd90e-188e-4bf8-a97f-de914da7cb37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:03.363032 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-432dd90e-188e-4bf8-a97f-de914da7cb37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:03.428262 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087047f-58ec-4da1-a3ea-69dcd66f776b None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:03.473617 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6b615-a7bd-41fa-a50d-a0b3149fd1d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:03.475012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6b615-a7bd-41fa-a50d-a0b3149fd1d7 service nova] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:03.475600 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6b615-a7bd-41fa-a50d-a0b3149fd1d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:03.476102 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6b615-a7bd-41fa-a50d-a0b3149fd1d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:03.536172 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6b615-a7bd-41fa-a50d-a0b3149fd1d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:03.545285 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6b615-a7bd-41fa-a50d-a0b3149fd1d7 service nova] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:03.626414 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 867/1725] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:03.810839 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432dd90e-188e-4bf8-a97f-de914da7cb37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:03.814537 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432dd90e-188e-4bf8-a97f-de914da7cb37 service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:03.870852 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 859/1726] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 999 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:04.150930 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6b615-a7bd-41fa-a50d-a0b3149fd1d7 service nova] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:04.155967 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-c0f6b615-a7bd-41fa-a50d-a0b3149fd1d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:04.200487 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:04.460656 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6b615-a7bd-41fa-a50d-a0b3149fd1d7 service nova] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:04.472052 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d1fc7-7faa-453c-ad93-315545df4026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:04.473456 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d1fc7-7faa-453c-ad93-315545df4026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:04.473976 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d1fc7-7faa-453c-ad93-315545df4026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:04.474521 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d1fc7-7faa-453c-ad93-315545df4026 admin admin] PATH_INFO: `/v3/projects/8c575bf150244d2f94f08642497b559f` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:04.477546 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d1fc7-7faa-453c-ad93-315545df4026 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c575bf150244d2f94f08642497b559f)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:04.481722 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d1fc7-7faa-453c-ad93-315545df4026 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:04.749645 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-c36d1fc7-7faa-453c-ad93-315545df4026 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c575bf150244d2f94f08642497b559f', 'request_id': 'req-c36d1fc7-7faa-453c-ad93-315545df4026'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:04.767634 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-c36d1fc7-7faa-453c-ad93-315545df4026 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c575bf150244d2f94f08642497b559f', 'request_id': 'req-c36d1fc7-7faa-453c-ad93-315545df4026'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:04.800535 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-c36d1fc7-7faa-453c-ad93-315545df4026 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c575bf150244d2f94f08642497b559f', 'request_id': 'req-c36d1fc7-7faa-453c-ad93-315545df4026'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:04.866822 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-c36d1fc7-7faa-453c-ad93-315545df4026 admin admin] The token cache is being invalidate because project 8c575bf150244d2f94f08642497b559f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:28:04.867406 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-c36d1fc7-7faa-453c-ad93-315545df4026 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:04.870145 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-c36d1fc7-7faa-453c-ad93-315545df4026 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:04.873874 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 868/1727] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:28:04 2022] DELETE /identity/v3/projects/8c575bf150244d2f94f08642497b559f => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:04.882354 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326c5cf-b56c-4acd-98e4-4bcab0b29e7a None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:04.883916 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326c5cf-b56c-4acd-98e4-4bcab0b29e7a None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:04.884654 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326c5cf-b56c-4acd-98e4-4bcab0b29e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:04.971956 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-a326c5cf-b56c-4acd-98e4-4bcab0b29e7a None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:04.974907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-a326c5cf-b56c-4acd-98e4-4bcab0b29e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:05.294078 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 860/1728] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:05.309910 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9ccff-4e17-41ca-a6ee-2b60dd3287b5 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:05.310822 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9ccff-4e17-41ca-a6ee-2b60dd3287b5 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:05.311554 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9ccff-4e17-41ca-a6ee-2b60dd3287b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:05.395447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-fad9ccff-4e17-41ca-a6ee-2b60dd3287b5 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:05.412750 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-fad9ccff-4e17-41ca-a6ee-2b60dd3287b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:05.464447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 869/1729] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:05.472070 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326c5cf-b56c-4acd-98e4-4bcab0b29e7a None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:05.506669 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326c5cf-b56c-4acd-98e4-4bcab0b29e7a None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:05.538721 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19026893-7b11-4df9-8d74-acec2e715ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:05.540131 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19026893-7b11-4df9-8d74-acec2e715ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:05.546147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19026893-7b11-4df9-8d74-acec2e715ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:05.547875 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19026893-7b11-4df9-8d74-acec2e715ef6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:05.549353 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19026893-7b11-4df9-8d74-acec2e715ef6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:28:05.550077 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19026893-7b11-4df9-8d74-acec2e715ef6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:05.563740 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19026893-7b11-4df9-8d74-acec2e715ef6 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:05.639948 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 861/1730] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:28:05.640315 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9ccff-4e17-41ca-a6ee-2b60dd3287b5 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:05.684770 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9ccff-4e17-41ca-a6ee-2b60dd3287b5 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:05.729918 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8537bb1-dbda-4760-88e3-174f200a110a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:05.731068 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8537bb1-dbda-4760-88e3-174f200a110a admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:05.749180 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8537bb1-dbda-4760-88e3-174f200a110a admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:05.749180 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8537bb1-dbda-4760-88e3-174f200a110a admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:05.749180 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8537bb1-dbda-4760-88e3-174f200a110a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:05.759389 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8537bb1-dbda-4760-88e3-174f200a110a admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:05.879579 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 870/1731] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:28:05 2022] POST /identity/v3/projects => generated 357 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:28:05.881739 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19026893-7b11-4df9-8d74-acec2e715ef6 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:05.883034 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2b13d-4561-4188-9964-928ec22d50e9 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:05.883524 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2b13d-4561-4188-9964-928ec22d50e9 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:05.884084 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2b13d-4561-4188-9964-928ec22d50e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:05.957129 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19026893-7b11-4df9-8d74-acec2e715ef6 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:05.974260 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:06.005165 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-a3c2b13d-4561-4188-9964-928ec22d50e9 None None] MFA Rules not processed for user `18c3a4375ded41c89c877077ceb4f46d`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:06.007632 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-a3c2b13d-4561-4188-9964-928ec22d50e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:06.339638 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6e58d-656f-4464-a722-5e45d84cd6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:06.340341 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6e58d-656f-4464-a722-5e45d84cd6b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:06.340693 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6e58d-656f-4464-a722-5e45d84cd6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:06.341177 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6e58d-656f-4464-a722-5e45d84cd6b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:06.342795 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6e58d-656f-4464-a722-5e45d84cd6b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:06.347583 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6e58d-656f-4464-a722-5e45d84cd6b0 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:06.367740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:06.381417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 871/1732] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 500 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:06.422165 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2b13d-4561-4188-9964-928ec22d50e9 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:06.424977 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-a3c2b13d-4561-4188-9964-928ec22d50e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:06.435814 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 862/1733] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:28:05 2022] POST /identity/v3/users => generated 279 bytes in 555 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:28:06.454843 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6e58d-656f-4464-a722-5e45d84cd6b0 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:06.519486 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6e58d-656f-4464-a722-5e45d84cd6b0 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:06.554523 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186b1c9-8b67-4666-80cb-71831748b40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:06.555873 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186b1c9-8b67-4666-80cb-71831748b40f admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:06.557697 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186b1c9-8b67-4666-80cb-71831748b40f admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:06.558227 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186b1c9-8b67-4666-80cb-71831748b40f admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:06.559544 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186b1c9-8b67-4666-80cb-71831748b40f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:06.562844 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186b1c9-8b67-4666-80cb-71831748b40f admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:06.642314 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 863/1734] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:28:06.643687 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186b1c9-8b67-4666-80cb-71831748b40f admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:06.667869 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2b13d-4561-4188-9964-928ec22d50e9 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:06.681754 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186b1c9-8b67-4666-80cb-71831748b40f admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:06.687767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926eb0f-0fa0-42fe-bc4a-69764e0f5e19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:06.688913 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926eb0f-0fa0-42fe-bc4a-69764e0f5e19 service nova] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:06.689965 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926eb0f-0fa0-42fe-bc4a-69764e0f5e19 service nova] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:06.690464 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926eb0f-0fa0-42fe-bc4a-69764e0f5e19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:06.692623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897144b8-f7c7-409c-b606-9d382f3a26ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:06.693949 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897144b8-f7c7-409c-b606-9d382f3a26ff admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:06.694569 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897144b8-f7c7-409c-b606-9d382f3a26ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:06.695216 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897144b8-f7c7-409c-b606-9d382f3a26ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:06.696364 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897144b8-f7c7-409c-b606-9d382f3a26ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:06.699779 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897144b8-f7c7-409c-b606-9d382f3a26ff admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:06.728176 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926eb0f-0fa0-42fe-bc4a-69764e0f5e19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:06.737926 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926eb0f-0fa0-42fe-bc4a-69764e0f5e19 service nova] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:06.752031 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 864/1735] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:28:06.752785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897144b8-f7c7-409c-b606-9d382f3a26ff admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:06.792065 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 872/1736] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:28:06.801794 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897144b8-f7c7-409c-b606-9d382f3a26ff admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:06.821564 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ae162-e3b3-4924-b067-ac588a7b02d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:06.823629 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ae162-e3b3-4924-b067-ac588a7b02d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:06.824154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ae162-e3b3-4924-b067-ac588a7b02d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:06.824826 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ae162-e3b3-4924-b067-ac588a7b02d7 admin admin] PATH_INFO: `/v3/projects/7596a990f9dd4b74ae5f84d52a5ba7a0/users/18f109c52ebd4697a0dbfab5214e236a/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:06.911677 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ae162-e3b3-4924-b067-ac588a7b02d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7596a990f9dd4b74ae5f84d52a5ba7a0, user_id=18f109c52ebd4697a0dbfab5214e236a, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:06.932415 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ae162-e3b3-4924-b067-ac588a7b02d7 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:06.959826 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926eb0f-0fa0-42fe-bc4a-69764e0f5e19 service nova] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:06.962856 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-2926eb0f-0fa0-42fe-bc4a-69764e0f5e19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:07.079179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 865/1737] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:28:06 2022] PUT /identity/v3/projects/7596a990f9dd4b74ae5f84d52a5ba7a0/users/18f109c52ebd4697a0dbfab5214e236a/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:07.085429 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4542be-ffa7-4741-80ac-a1a4244db60e None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:07.092707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4542be-ffa7-4741-80ac-a1a4244db60e None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:07.093079 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4542be-ffa7-4741-80ac-a1a4244db60e None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:07.110124 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 866/1738] 10.222.0.77 () {54 vars in 912 bytes} [Tue Aug 23 22:28:07 2022] GET /identity => generated 270 bytes in 28 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:28:07.113163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c399fb9-fbdf-4324-b170-0c8e109cc882 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:07.113704 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c399fb9-fbdf-4324-b170-0c8e109cc882 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:07.114217 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c399fb9-fbdf-4324-b170-0c8e109cc882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:07.235132 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-2c399fb9-fbdf-4324-b170-0c8e109cc882 None None] MFA Rules not processed for user `18f109c52ebd4697a0dbfab5214e236a`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:07.242196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-2c399fb9-fbdf-4324-b170-0c8e109cc882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:07.333391 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926eb0f-0fa0-42fe-bc4a-69764e0f5e19 service nova] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:07.764765 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af57ab-b635-4cf2-8357-1babe950ec40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:07.766837 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af57ab-b635-4cf2-8357-1babe950ec40 service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:07.767451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af57ab-b635-4cf2-8357-1babe950ec40 service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:07.768154 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af57ab-b635-4cf2-8357-1babe950ec40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:07.784836 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 867/1739] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:07 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 674 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:07.793356 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8960b-89b6-4ed8-a90f-cb72cc59a897 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:07.794317 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-04af57ab-b635-4cf2-8357-1babe950ec40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:07.796326 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8960b-89b6-4ed8-a90f-cb72cc59a897 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:07.796984 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8960b-89b6-4ed8-a90f-cb72cc59a897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:07.991744 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-a7a8960b-89b6-4ed8-a90f-cb72cc59a897 None None] MFA Rules not processed for user `84ea6fbc3de84b7db9e62b9ee6055c52`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:07.995560 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-a7a8960b-89b6-4ed8-a90f-cb72cc59a897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:08.072235 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:08.121343 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af57ab-b635-4cf2-8357-1babe950ec40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:08.124172 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af57ab-b635-4cf2-8357-1babe950ec40 service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:08.163717 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:08.187036 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 873/1740] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 1228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:28:08.193923 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af57ab-b635-4cf2-8357-1babe950ec40 service cinder] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:08.348421 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 868/1741] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Aug 23 22:28:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 563 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:08.574372 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8960b-89b6-4ed8-a90f-cb72cc59a897 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:08.576840 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-a7a8960b-89b6-4ed8-a90f-cb72cc59a897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:08.624487 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af57ab-b635-4cf2-8357-1babe950ec40 service cinder] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:08.626217 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8960b-89b6-4ed8-a90f-cb72cc59a897 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:08.638238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e753e29-0da3-4908-8324-e7077de446f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:08.639760 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e753e29-0da3-4908-8324-e7077de446f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:08.645573 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e753e29-0da3-4908-8324-e7077de446f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:08.646334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e753e29-0da3-4908-8324-e7077de446f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:08.665257 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75febbde-027c-4b1c-8c27-510a3a620edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:08.671240 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75febbde-027c-4b1c-8c27-510a3a620edd admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:08.673731 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75febbde-027c-4b1c-8c27-510a3a620edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:08.674383 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75febbde-027c-4b1c-8c27-510a3a620edd admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:08.675932 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75febbde-027c-4b1c-8c27-510a3a620edd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:08.684330 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75febbde-027c-4b1c-8c27-510a3a620edd admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:08.684683 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e753e29-0da3-4908-8324-e7077de446f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:08.694988 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e753e29-0da3-4908-8324-e7077de446f1 service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:08.760308 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 869/1742] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:08.842336 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 874/1743] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:28:08 2022] POST /identity/v3/projects => generated 357 bytes in 652 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:28:08.846376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e753e29-0da3-4908-8324-e7077de446f1 service neutron] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:08.896999 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e753e29-0da3-4908-8324-e7077de446f1 service neutron] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:09.205086 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd36b46-9ac0-4c22-9d9b-6fece122973e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:09.211049 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd36b46-9ac0-4c22-9d9b-6fece122973e admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:09.211569 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd36b46-9ac0-4c22-9d9b-6fece122973e admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:09.220492 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd36b46-9ac0-4c22-9d9b-6fece122973e admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:09.222068 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd36b46-9ac0-4c22-9d9b-6fece122973e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:09.245076 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd36b46-9ac0-4c22-9d9b-6fece122973e admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:09.364496 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11345a-d99d-486c-aa71-1884c03495dc None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:09.367522 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11345a-d99d-486c-aa71-1884c03495dc None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:09.371186 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11345a-d99d-486c-aa71-1884c03495dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:09.391321 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 870/1744] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:28:08 2022] POST /identity/v3/users => generated 285 bytes in 547 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:28:09.416506 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd36b46-9ac0-4c22-9d9b-6fece122973e admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:09.495934 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd36b46-9ac0-4c22-9d9b-6fece122973e admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:09.538315 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5230269-9d87-4724-b4dc-33b43bb02507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:09.540091 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5230269-9d87-4724-b4dc-33b43bb02507 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:09.540378 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5230269-9d87-4724-b4dc-33b43bb02507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:09.541903 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5230269-9d87-4724-b4dc-33b43bb02507 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:09.550616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5230269-9d87-4724-b4dc-33b43bb02507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:09.559802 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5230269-9d87-4724-b4dc-33b43bb02507 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:09.595058 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-9e11345a-d99d-486c-aa71-1884c03495dc None None] MFA Rules not processed for user `035cc211744f457f9fe65bd7d0e6bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:09.599513 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-9e11345a-d99d-486c-aa71-1884c03495dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:09.618168 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 871/1745] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:28:09.621295 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5230269-9d87-4724-b4dc-33b43bb02507 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:09.664441 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5230269-9d87-4724-b4dc-33b43bb02507 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:09.689018 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23e449-a149-4d34-891d-39078dff3240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:09.692558 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23e449-a149-4d34-891d-39078dff3240 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:09.693082 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23e449-a149-4d34-891d-39078dff3240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:09.695812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23e449-a149-4d34-891d-39078dff3240 admin admin] PATH_INFO: `/v3/projects/c04e39c7c4944c2ab1ee6b7940f3acee/users/2716972d727c43839c4c1b2470532a89/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:09.835954 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23e449-a149-4d34-891d-39078dff3240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c04e39c7c4944c2ab1ee6b7940f3acee, user_id=2716972d727c43839c4c1b2470532a89, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:09.847721 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23e449-a149-4d34-891d-39078dff3240 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:09.904693 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 872/1746] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:28:09 2022] PUT /identity/v3/projects/c04e39c7c4944c2ab1ee6b7940f3acee/users/2716972d727c43839c4c1b2470532a89/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:09.919055 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23e449-a149-4d34-891d-39078dff3240 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:10.005436 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 875/1747] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:09 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 640 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:10.019944 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d75bc-e46a-42fb-ab8f-54626e793417 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:10.022683 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d75bc-e46a-42fb-ab8f-54626e793417 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:10.023178 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d75bc-e46a-42fb-ab8f-54626e793417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:10.085715 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-0a4d75bc-e46a-42fb-ab8f-54626e793417 None None] MFA Rules not processed for user `035cc211744f457f9fe65bd7d0e6bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:10.089067 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-0a4d75bc-e46a-42fb-ab8f-54626e793417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:10.191522 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23e449-a149-4d34-891d-39078dff3240 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:10.214023 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94340712-6eac-49ae-a16d-748139e5dc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:10.217124 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94340712-6eac-49ae-a16d-748139e5dc0b admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:10.217327 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94340712-6eac-49ae-a16d-748139e5dc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:10.222088 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94340712-6eac-49ae-a16d-748139e5dc0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:10.224291 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94340712-6eac-49ae-a16d-748139e5dc0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:10.227975 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94340712-6eac-49ae-a16d-748139e5dc0b admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:10.263515 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 873/1748] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:28:10.271739 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94340712-6eac-49ae-a16d-748139e5dc0b admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:10.282412 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 876/1749] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:28:10.343239 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d75bc-e46a-42fb-ab8f-54626e793417 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:10.354763 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94340712-6eac-49ae-a16d-748139e5dc0b admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:10.386416 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa012e8f-c6f7-432c-8fc0-529dfed6ada1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:10.388590 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa012e8f-c6f7-432c-8fc0-529dfed6ada1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:10.391091 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa012e8f-c6f7-432c-8fc0-529dfed6ada1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:10.394048 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa012e8f-c6f7-432c-8fc0-529dfed6ada1 admin admin] PATH_INFO: `/v3/projects/c04e39c7c4944c2ab1ee6b7940f3acee/users/2716972d727c43839c4c1b2470532a89/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:10.402169 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa012e8f-c6f7-432c-8fc0-529dfed6ada1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c04e39c7c4944c2ab1ee6b7940f3acee, user_id=2716972d727c43839c4c1b2470532a89, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:10.403470 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:10.417307 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa012e8f-c6f7-432c-8fc0-529dfed6ada1 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:10.463824 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 874/1750] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:28:10 2022] PUT /identity/v3/projects/c04e39c7c4944c2ab1ee6b7940f3acee/users/2716972d727c43839c4c1b2470532a89/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:28:10.478680 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531ca77-32ba-4747-90c3-0a4b5a92cdef None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:10.479516 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531ca77-32ba-4747-90c3-0a4b5a92cdef None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:10.480072 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531ca77-32ba-4747-90c3-0a4b5a92cdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:10.510008 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:10.600298 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-8531ca77-32ba-4747-90c3-0a4b5a92cdef None None] MFA Rules not processed for user `2716972d727c43839c4c1b2470532a89`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:10.605344 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-8531ca77-32ba-4747-90c3-0a4b5a92cdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:10.866793 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d75bc-e46a-42fb-ab8f-54626e793417 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:11.162031 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 875/1751] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:10 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 686 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:11.177891 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233f821-293f-4848-a643-0b7ae2b9756e None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:11.178810 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233f821-293f-4848-a643-0b7ae2b9756e None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:11.179538 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233f821-293f-4848-a643-0b7ae2b9756e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:11.223080 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f7032-2653-48ae-b962-75a19a58f136 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:11.239878 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f7032-2653-48ae-b962-75a19a58f136 service nova] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:11.240441 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f7032-2653-48ae-b962-75a19a58f136 service nova] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:11.244124 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f7032-2653-48ae-b962-75a19a58f136 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:11.283281 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-f233f821-293f-4848-a643-0b7ae2b9756e None None] MFA Rules not processed for user `187851e27dc54b418400ebd4df42c483`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:11.285283 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-f233f821-293f-4848-a643-0b7ae2b9756e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:11.486016 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f7032-2653-48ae-b962-75a19a58f136 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:11.488457 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f7032-2653-48ae-b962-75a19a58f136 service nova] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:11.549023 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 877/1752] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:10 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 1207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:11.550868 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f7032-2653-48ae-b962-75a19a58f136 service nova] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:11.563562 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-265f7032-2653-48ae-b962-75a19a58f136 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:11.574358 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 876/1753] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:11 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:11.576180 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233f821-293f-4848-a643-0b7ae2b9756e None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:11.800201 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:11.887329 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f7032-2653-48ae-b962-75a19a58f136 service nova] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:11.910820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57982095-b2b5-41bb-8113-8e80214d6ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:11.911878 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57982095-b2b5-41bb-8113-8e80214d6ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:11.912315 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57982095-b2b5-41bb-8113-8e80214d6ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:11.912757 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57982095-b2b5-41bb-8113-8e80214d6ef1 admin admin] PATH_INFO: `/v3/users/ac5e2bb2419e4014b47d1f57a2ad50c1` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:11.918611 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57982095-b2b5-41bb-8113-8e80214d6ef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac5e2bb2419e4014b47d1f57a2ad50c1)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:11.932849 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57982095-b2b5-41bb-8113-8e80214d6ef1 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:11.980575 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233f821-293f-4848-a643-0b7ae2b9756e None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:12.009431 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ea7ea-192b-4640-90d7-1c8ae732fa3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:12.010582 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ea7ea-192b-4640-90d7-1c8ae732fa3b service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:12.011047 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ea7ea-192b-4640-90d7-1c8ae732fa3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:12.014188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ea7ea-192b-4640-90d7-1c8ae732fa3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:12.083643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ea7ea-192b-4640-90d7-1c8ae732fa3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:12.086741 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ea7ea-192b-4640-90d7-1c8ae732fa3b service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:12.150602 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 877/1754] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:11 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:12.249030 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdafe18-9623-4e81-b1b6-c722f8bda2b4 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:12.251585 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdafe18-9623-4e81-b1b6-c722f8bda2b4 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:12.251987 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdafe18-9623-4e81-b1b6-c722f8bda2b4 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:12.255687 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 878/1755] 10.222.0.77 () {54 vars in 961 bytes} [Tue Aug 23 22:28:12 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:28:12.283930 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7ca63-93b1-4adc-b291-59c8b86bd5c1 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:12.285256 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7ca63-93b1-4adc-b291-59c8b86bd5c1 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:12.285737 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-57982095-b2b5-41bb-8113-8e80214d6ef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac5e2bb2419e4014b47d1f57a2ad50c1'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:12.286459 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7ca63-93b1-4adc-b291-59c8b86bd5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:12.288715 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-57982095-b2b5-41bb-8113-8e80214d6ef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac5e2bb2419e4014b47d1f57a2ad50c1'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:12.327080 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-57982095-b2b5-41bb-8113-8e80214d6ef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac5e2bb2419e4014b47d1f57a2ad50c1'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:12.360995 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-57982095-b2b5-41bb-8113-8e80214d6ef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac5e2bb2419e4014b47d1f57a2ad50c1'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:12.391645 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-a9d7ca63-93b1-4adc-b291-59c8b86bd5c1 None None] MFA Rules not processed for user `2000b80e34ae45d2a8b658cd394419f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:12.391645 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-a9d7ca63-93b1-4adc-b291-59c8b86bd5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:12.425981 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:12.461945 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-57982095-b2b5-41bb-8113-8e80214d6ef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac5e2bb2419e4014b47d1f57a2ad50c1'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:12.525535 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 878/1756] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:28:11 2022] DELETE /identity/v3/users/ac5e2bb2419e4014b47d1f57a2ad50c1 => generated 0 bytes in 973 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:12.525535 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57982095-b2b5-41bb-8113-8e80214d6ef1 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:12.530111 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-57982095-b2b5-41bb-8113-8e80214d6ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:12.768080 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57982095-b2b5-41bb-8113-8e80214d6ef1 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:12.785570 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd257c5-ca34-45bc-831e-6c9b17f02028 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:12.787703 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd257c5-ca34-45bc-831e-6c9b17f02028 service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:12.788176 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd257c5-ca34-45bc-831e-6c9b17f02028 service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:12.790432 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd257c5-ca34-45bc-831e-6c9b17f02028 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:12.794533 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 879/1757] 10.222.0.77 () {58 vars in 1058 bytes} [Tue Aug 23 22:28:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 514 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:28:12.798924 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60517179-3dbb-467a-b580-87048a75ac08 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:12.800370 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-8bd257c5-ca34-45bc-831e-6c9b17f02028 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:12.803798 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60517179-3dbb-467a-b580-87048a75ac08 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:12.804315 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60517179-3dbb-467a-b580-87048a75ac08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:12.900592 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-60517179-3dbb-467a-b580-87048a75ac08 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:12.911572 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-60517179-3dbb-467a-b580-87048a75ac08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:13.191975 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd257c5-ca34-45bc-831e-6c9b17f02028 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:13.201562 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd257c5-ca34-45bc-831e-6c9b17f02028 service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:13.259074 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 879/1758] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:12 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 735 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:13.260124 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd257c5-ca34-45bc-831e-6c9b17f02028 service cinder] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:13.354674 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 880/1759] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 560 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:13.376857 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:13.480216 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60517179-3dbb-467a-b580-87048a75ac08 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:13.482883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-60517179-3dbb-467a-b580-87048a75ac08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:13.822174 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd257c5-ca34-45bc-831e-6c9b17f02028 service cinder] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:13.870223 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4368b3-c32d-4ae6-b33a-d1bf4310f71b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2000b80e34ae45d2a8b658cd394419f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:13.876403 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60517179-3dbb-467a-b580-87048a75ac08 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:13.878317 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4368b3-c32d-4ae6-b33a-d1bf4310f71b service placement] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:13.880451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4368b3-c32d-4ae6-b33a-d1bf4310f71b service placement] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:13.882267 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4368b3-c32d-4ae6-b33a-d1bf4310f71b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:13.894892 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-df4368b3-c32d-4ae6-b33a-d1bf4310f71b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:13.927286 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3320e48-862b-4eaa-a6b7-c7ce0a60cdf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:13.928350 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3320e48-862b-4eaa-a6b7-c7ce0a60cdf9 service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:13.928979 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3320e48-862b-4eaa-a6b7-c7ce0a60cdf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:13.933630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3320e48-862b-4eaa-a6b7-c7ce0a60cdf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:13.949218 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4368b3-c32d-4ae6-b33a-d1bf4310f71b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:13.954738 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4368b3-c32d-4ae6-b33a-d1bf4310f71b service placement] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:13.982883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 880/1760] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 723 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:13.986074 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d435c-0dd8-4d08-97ce-7f9e5ea02b23 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:13.986910 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d435c-0dd8-4d08-97ce-7f9e5ea02b23 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:13.988350 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d435c-0dd8-4d08-97ce-7f9e5ea02b23 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:13.998006 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3320e48-862b-4eaa-a6b7-c7ce0a60cdf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:14.000147 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 881/1761] 10.222.0.77 () {54 vars in 912 bytes} [Tue Aug 23 22:28:13 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:28:14.005131 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3320e48-862b-4eaa-a6b7-c7ce0a60cdf9 service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:14.025040 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772e03a-bede-4915-adc3-e974b9067e5f None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:14.025690 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772e03a-bede-4915-adc3-e974b9067e5f None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:14.027370 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772e03a-bede-4915-adc3-e974b9067e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:14.064002 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 881/1762] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:14.194991 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-b772e03a-bede-4915-adc3-e974b9067e5f None None] MFA Rules not processed for user `84ea6fbc3de84b7db9e62b9ee6055c52`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:14.199912 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-b772e03a-bede-4915-adc3-e974b9067e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:14.240650 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 882/1763] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Aug 23 22:28:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:14.496933 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3320e48-862b-4eaa-a6b7-c7ce0a60cdf9 service neutron] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:14.548294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3320e48-862b-4eaa-a6b7-c7ce0a60cdf9 service neutron] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:14.569001 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf4812-abc1-48e4-89d7-e18516244b86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:14.617890 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf4812-abc1-48e4-89d7-e18516244b86 service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:14.622609 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf4812-abc1-48e4-89d7-e18516244b86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:14.623102 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf4812-abc1-48e4-89d7-e18516244b86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:14.672596 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf4812-abc1-48e4-89d7-e18516244b86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:14.683635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf4812-abc1-48e4-89d7-e18516244b86 service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:14.725396 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 882/1764] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:28:16.848773 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4a10d-a2a2-41f8-b3e1-0bdc003cdf70 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:16.850589 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4a10d-a2a2-41f8-b3e1-0bdc003cdf70 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:16.853175 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4a10d-a2a2-41f8-b3e1-0bdc003cdf70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:17.053009 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b537f-952d-44e0-8688-c207c51c293a None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:17.053989 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b537f-952d-44e0-8688-c207c51c293a None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:17.054318 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b537f-952d-44e0-8688-c207c51c293a None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:17.056878 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 883/1765] 10.222.0.77 () {54 vars in 921 bytes} [Tue Aug 23 22:28:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:28:17.059679 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-85f4a10d-a2a2-41f8-b3e1-0bdc003cdf70 None None] MFA Rules not processed for user `388f72ff05784e6bae5ca4f085d7c55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:17.072275 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-85f4a10d-a2a2-41f8-b3e1-0bdc003cdf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:17.114372 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0da41b-651d-4eb8-a30a-abe1d800cd76 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:17.114971 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0da41b-651d-4eb8-a30a-abe1d800cd76 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:17.115534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0da41b-651d-4eb8-a30a-abe1d800cd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:17.283624 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-0c0da41b-651d-4eb8-a30a-abe1d800cd76 None None] MFA Rules not processed for user `2000b80e34ae45d2a8b658cd394419f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:17.286192 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-0c0da41b-651d-4eb8-a30a-abe1d800cd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:17.428651 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 884/1766] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Aug 23 22:28:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:28:17.469697 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0da41b-651d-4eb8-a30a-abe1d800cd76 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:17.581672 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0da41b-651d-4eb8-a30a-abe1d800cd76 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:17.641693 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 883/1767] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 794 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:17.643142 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e907a3d-6147-437a-82c2-f9a6848f8cb3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2000b80e34ae45d2a8b658cd394419f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:17.644359 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e907a3d-6147-437a-82c2-f9a6848f8cb3 service placement] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:17.644899 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e907a3d-6147-437a-82c2-f9a6848f8cb3 service placement] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:17.645464 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e907a3d-6147-437a-82c2-f9a6848f8cb3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:17.646477 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4a10d-a2a2-41f8-b3e1-0bdc003cdf70 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:17.666720 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-85f4a10d-a2a2-41f8-b3e1-0bdc003cdf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:17.768063 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e907a3d-6147-437a-82c2-f9a6848f8cb3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:17.772126 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4a10d-a2a2-41f8-b3e1-0bdc003cdf70 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:17.779076 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e907a3d-6147-437a-82c2-f9a6848f8cb3 service placement] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:17.842497 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05761d-3fa4-4d84-bb42-e67114d3a32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:17.844866 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05761d-3fa4-4d84-bb42-e67114d3a32e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:17.845294 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05761d-3fa4-4d84-bb42-e67114d3a32e admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:17.863578 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05761d-3fa4-4d84-bb42-e67114d3a32e admin admin] PATH_INFO: `/v3/projects/fcadb3a03e2a4ad49a041887b429ca6c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:17.870913 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05761d-3fa4-4d84-bb42-e67114d3a32e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcadb3a03e2a4ad49a041887b429ca6c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:17.913882 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05761d-3fa4-4d84-bb42-e67114d3a32e admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:17.922099 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 885/1768] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:28:17.933925 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e907a3d-6147-437a-82c2-f9a6848f8cb3 service placement] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:17.958219 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-6e907a3d-6147-437a-82c2-f9a6848f8cb3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:18.206543 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:18.352194 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-fb05761d-3fa4-4d84-bb42-e67114d3a32e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcadb3a03e2a4ad49a041887b429ca6c', 'request_id': 'req-fb05761d-3fa4-4d84-bb42-e67114d3a32e'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:18.450612 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-fb05761d-3fa4-4d84-bb42-e67114d3a32e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcadb3a03e2a4ad49a041887b429ca6c', 'request_id': 'req-fb05761d-3fa4-4d84-bb42-e67114d3a32e'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:18.554901 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-fb05761d-3fa4-4d84-bb42-e67114d3a32e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcadb3a03e2a4ad49a041887b429ca6c', 'request_id': 'req-fb05761d-3fa4-4d84-bb42-e67114d3a32e'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:18.677021 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-fb05761d-3fa4-4d84-bb42-e67114d3a32e admin admin] The token cache is being invalidate because project fcadb3a03e2a4ad49a041887b429ca6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:28:18.683755 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-fb05761d-3fa4-4d84-bb42-e67114d3a32e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:18.691301 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-fb05761d-3fa4-4d84-bb42-e67114d3a32e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:18.699016 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 884/1769] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:28:17 2022] DELETE /identity/v3/projects/fcadb3a03e2a4ad49a041887b429ca6c => generated 0 bytes in 1057 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:18.705922 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065f424-f2a2-48c4-882b-ee7307c93f89 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:18.705922 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065f424-f2a2-48c4-882b-ee7307c93f89 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:18.711313 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065f424-f2a2-48c4-882b-ee7307c93f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:18.751944 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e907a3d-6147-437a-82c2-f9a6848f8cb3 service placement] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:18.887247 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-c065f424-f2a2-48c4-882b-ee7307c93f89 None None] MFA Rules not processed for user `035cc211744f457f9fe65bd7d0e6bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:18.892388 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-c065f424-f2a2-48c4-882b-ee7307c93f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:18.932914 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:19.285272 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 885/1770] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 585 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:19.288019 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065f424-f2a2-48c4-882b-ee7307c93f89 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:19.300912 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-c065f424-f2a2-48c4-882b-ee7307c93f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:19.394905 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48fc6e-f97b-404e-b216-2887cce27749 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:19.408737 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48fc6e-f97b-404e-b216-2887cce27749 service nova] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:19.415366 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48fc6e-f97b-404e-b216-2887cce27749 service nova] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:19.416036 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48fc6e-f97b-404e-b216-2887cce27749 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:19.429172 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-cd48fc6e-f97b-404e-b216-2887cce27749 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:19.624007 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065f424-f2a2-48c4-882b-ee7307c93f89 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:19.643719 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42deebaf-7166-4882-90b5-d48f38acd336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:19.647049 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42deebaf-7166-4882-90b5-d48f38acd336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:19.647627 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42deebaf-7166-4882-90b5-d48f38acd336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:19.649562 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42deebaf-7166-4882-90b5-d48f38acd336 admin admin] PATH_INFO: `/v3/users/0c81fbdfa6854260a40bf2f59537a1d7` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:19.652619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42deebaf-7166-4882-90b5-d48f38acd336 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c81fbdfa6854260a40bf2f59537a1d7)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:19.662417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42deebaf-7166-4882-90b5-d48f38acd336 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:19.946717 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-42deebaf-7166-4882-90b5-d48f38acd336 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c81fbdfa6854260a40bf2f59537a1d7'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:19.957507 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-42deebaf-7166-4882-90b5-d48f38acd336 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c81fbdfa6854260a40bf2f59537a1d7'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:19.971572 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48fc6e-f97b-404e-b216-2887cce27749 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:19.984981 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48fc6e-f97b-404e-b216-2887cce27749 service nova] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:20.004616 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-42deebaf-7166-4882-90b5-d48f38acd336 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c81fbdfa6854260a40bf2f59537a1d7'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:20.029660 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-42deebaf-7166-4882-90b5-d48f38acd336 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c81fbdfa6854260a40bf2f59537a1d7'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:20.091983 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-42deebaf-7166-4882-90b5-d48f38acd336 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c81fbdfa6854260a40bf2f59537a1d7'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:20.095065 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 886/1771] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 2172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:20.173671 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 886/1772] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:28:19 2022] DELETE /identity/v3/users/0c81fbdfa6854260a40bf2f59537a1d7 => generated 0 bytes in 888 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:21.142558 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48fc6e-f97b-404e-b216-2887cce27749 service nova] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:21.144482 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-cd48fc6e-f97b-404e-b216-2887cce27749 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:21.188840 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48fc6e-f97b-404e-b216-2887cce27749 service nova] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:21.406265 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:21.430954 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21e5c5-9ff1-44fc-9377-42920535763a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:21.437137 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21e5c5-9ff1-44fc-9377-42920535763a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:21.438161 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21e5c5-9ff1-44fc-9377-42920535763a admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:21.438744 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21e5c5-9ff1-44fc-9377-42920535763a admin admin] PATH_INFO: `/v3/users/08abb3fa39364686804f7e1a596ed3ba` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:21.442872 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21e5c5-9ff1-44fc-9377-42920535763a admin admin] RBAC: Authorizing `identity:delete_user(user_id=08abb3fa39364686804f7e1a596ed3ba)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:21.447800 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21e5c5-9ff1-44fc-9377-42920535763a admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:21.743961 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-7f21e5c5-9ff1-44fc-9377-42920535763a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08abb3fa39364686804f7e1a596ed3ba'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:21.747225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-7f21e5c5-9ff1-44fc-9377-42920535763a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08abb3fa39364686804f7e1a596ed3ba'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:21.791916 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-7f21e5c5-9ff1-44fc-9377-42920535763a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08abb3fa39364686804f7e1a596ed3ba'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:21.818421 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-7f21e5c5-9ff1-44fc-9377-42920535763a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08abb3fa39364686804f7e1a596ed3ba'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:21.828749 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-7f21e5c5-9ff1-44fc-9377-42920535763a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08abb3fa39364686804f7e1a596ed3ba'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:21.972969 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 887/1773] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:28:21 2022] DELETE /identity/v3/users/08abb3fa39364686804f7e1a596ed3ba => generated 0 bytes in 831 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:22.581635 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96220aed-9101-4953-beae-d69819e5a4fd None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:22.582425 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96220aed-9101-4953-beae-d69819e5a4fd None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:22.582425 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96220aed-9101-4953-beae-d69819e5a4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:22.864807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-96220aed-9101-4953-beae-d69819e5a4fd None None] MFA Rules not processed for user `02e415eb75984daa97ee79fc0146f318`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:22.868292 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-96220aed-9101-4953-beae-d69819e5a4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:22.941767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:23.216798 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 887/1774] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Aug 23 22:28:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 637 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:28:23.250842 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa196754-6924-40f3-a082-91b6de87ba5f None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:23.251658 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa196754-6924-40f3-a082-91b6de87ba5f None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:23.251658 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa196754-6924-40f3-a082-91b6de87ba5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:23.297722 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-aa196754-6924-40f3-a082-91b6de87ba5f None None] MFA Rules not processed for user `18c3a4375ded41c89c877077ceb4f46d`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:23.299263 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-aa196754-6924-40f3-a082-91b6de87ba5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:23.560962 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 888/1775] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:28:23.576082 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96220aed-9101-4953-beae-d69819e5a4fd None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:23.580443 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-96220aed-9101-4953-beae-d69819e5a4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:24.100634 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96220aed-9101-4953-beae-d69819e5a4fd None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:24.135214 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e7e46-4b98-4308-94ce-228780f1f85d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abda1f23a18c4c808483cd6b53952975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:24.136544 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e7e46-4b98-4308-94ce-228780f1f85d service swift] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:24.137188 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e7e46-4b98-4308-94ce-228780f1f85d service swift] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:24.137826 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e7e46-4b98-4308-94ce-228780f1f85d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:24.169423 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e7e46-4b98-4308-94ce-228780f1f85d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:24.173037 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e7e46-4b98-4308-94ce-228780f1f85d service swift] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:24.199096 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa196754-6924-40f3-a082-91b6de87ba5f None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:24.202374 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-aa196754-6924-40f3-a082-91b6de87ba5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:24.268918 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 888/1776] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Aug 23 22:28:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 694 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 22:28:24.697828 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa196754-6924-40f3-a082-91b6de87ba5f None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:24.745535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0ff90-ac9c-45c1-b0fc-2ec70da981a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:24.750019 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0ff90-ac9c-45c1-b0fc-2ec70da981a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:24.751724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0ff90-ac9c-45c1-b0fc-2ec70da981a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:24.754379 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0ff90-ac9c-45c1-b0fc-2ec70da981a3 admin admin] PATH_INFO: `/v3/projects/41933003737d4421b66262a68273292e` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:24.760277 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d0ff90-ac9c-45c1-b0fc-2ec70da981a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41933003737d4421b66262a68273292e)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:24.774994 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d0ff90-ac9c-45c1-b0fc-2ec70da981a3 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:24.969884 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:25.103461 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f9d0ff90-ac9c-45c1-b0fc-2ec70da981a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41933003737d4421b66262a68273292e', 'request_id': 'req-f9d0ff90-ac9c-45c1-b0fc-2ec70da981a3'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:25.168638 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f9d0ff90-ac9c-45c1-b0fc-2ec70da981a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41933003737d4421b66262a68273292e', 'request_id': 'req-f9d0ff90-ac9c-45c1-b0fc-2ec70da981a3'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:25.223475 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f9d0ff90-ac9c-45c1-b0fc-2ec70da981a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41933003737d4421b66262a68273292e', 'request_id': 'req-f9d0ff90-ac9c-45c1-b0fc-2ec70da981a3'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:25.372195 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f9d0ff90-ac9c-45c1-b0fc-2ec70da981a3 admin admin] The token cache is being invalidate because project 41933003737d4421b66262a68273292e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:28:25.380282 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f9d0ff90-ac9c-45c1-b0fc-2ec70da981a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:25.385675 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f9d0ff90-ac9c-45c1-b0fc-2ec70da981a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:25.393097 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 889/1777] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:28:24 2022] DELETE /identity/v3/projects/41933003737d4421b66262a68273292e => generated 0 bytes in 1197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:25.399956 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e7e46-4b98-4308-94ce-228780f1f85d service swift] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:25.452974 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e7e46-4b98-4308-94ce-228780f1f85d service swift] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:25.823616 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa4d8e-a9fd-46be-948b-19a5bfc1992e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:25.831083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa4d8e-a9fd-46be-948b-19a5bfc1992e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:25.836190 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa4d8e-a9fd-46be-948b-19a5bfc1992e admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:25.836190 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa4d8e-a9fd-46be-948b-19a5bfc1992e admin admin] PATH_INFO: `/v3/users/187851e27dc54b418400ebd4df42c483` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:25.844341 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa4d8e-a9fd-46be-948b-19a5bfc1992e admin admin] RBAC: Authorizing `identity:delete_user(user_id=187851e27dc54b418400ebd4df42c483)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:25.849467 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa4d8e-a9fd-46be-948b-19a5bfc1992e admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:25.968888 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:26.047568 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-03fa4d8e-a9fd-46be-948b-19a5bfc1992e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '187851e27dc54b418400ebd4df42c483'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:26.049332 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-03fa4d8e-a9fd-46be-948b-19a5bfc1992e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '187851e27dc54b418400ebd4df42c483'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:26.079565 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-03fa4d8e-a9fd-46be-948b-19a5bfc1992e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '187851e27dc54b418400ebd4df42c483'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:26.112948 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-03fa4d8e-a9fd-46be-948b-19a5bfc1992e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '187851e27dc54b418400ebd4df42c483'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:26.192746 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-03fa4d8e-a9fd-46be-948b-19a5bfc1992e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '187851e27dc54b418400ebd4df42c483'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:26.231799 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 889/1778] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:28:25 2022] DELETE /identity/v3/users/187851e27dc54b418400ebd4df42c483 => generated 0 bytes in 833 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:26.662466 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0ff90-ac9c-45c1-b0fc-2ec70da981a3 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:26.667265 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-f9d0ff90-ac9c-45c1-b0fc-2ec70da981a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:26.739974 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0ff90-ac9c-45c1-b0fc-2ec70da981a3 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:27.028012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2050e1-45d9-411d-9c3e-85bdfd281a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:27.031300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2050e1-45d9-411d-9c3e-85bdfd281a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:27.035184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2050e1-45d9-411d-9c3e-85bdfd281a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:27.038445 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2050e1-45d9-411d-9c3e-85bdfd281a13 admin admin] PATH_INFO: `/v3/projects/870af9b2c1fc42f588569f7d14659f1e` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:27.045419 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2050e1-45d9-411d-9c3e-85bdfd281a13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=870af9b2c1fc42f588569f7d14659f1e)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:27.055733 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2050e1-45d9-411d-9c3e-85bdfd281a13 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:27.347303 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-0f2050e1-45d9-411d-9c3e-85bdfd281a13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '870af9b2c1fc42f588569f7d14659f1e', 'request_id': 'req-0f2050e1-45d9-411d-9c3e-85bdfd281a13'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:27.383471 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-0f2050e1-45d9-411d-9c3e-85bdfd281a13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '870af9b2c1fc42f588569f7d14659f1e', 'request_id': 'req-0f2050e1-45d9-411d-9c3e-85bdfd281a13'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:27.440428 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-0f2050e1-45d9-411d-9c3e-85bdfd281a13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '870af9b2c1fc42f588569f7d14659f1e', 'request_id': 'req-0f2050e1-45d9-411d-9c3e-85bdfd281a13'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:27.505140 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-0f2050e1-45d9-411d-9c3e-85bdfd281a13 admin admin] The token cache is being invalidate because project 870af9b2c1fc42f588569f7d14659f1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:28:27.507550 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-0f2050e1-45d9-411d-9c3e-85bdfd281a13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:27.526864 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-0f2050e1-45d9-411d-9c3e-85bdfd281a13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:27.542014 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 890/1779] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:28:26 2022] DELETE /identity/v3/projects/870af9b2c1fc42f588569f7d14659f1e => generated 0 bytes in 877 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:27.544961 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9fca2-996b-4ab2-91ae-44cb414ef480 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:27.545564 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9fca2-996b-4ab2-91ae-44cb414ef480 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:27.545656 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9fca2-996b-4ab2-91ae-44cb414ef480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:27.598781 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-92e9fca2-996b-4ab2-91ae-44cb414ef480 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:27.600511 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-92e9fca2-996b-4ab2-91ae-44cb414ef480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:27.962590 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca641191-8e2d-4e3e-8ca1-2342f76da51d None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:27.963368 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca641191-8e2d-4e3e-8ca1-2342f76da51d None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:27.963526 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca641191-8e2d-4e3e-8ca1-2342f76da51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:27.974244 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 890/1780] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:28:28.053435 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-ca641191-8e2d-4e3e-8ca1-2342f76da51d None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:28.061977 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-ca641191-8e2d-4e3e-8ca1-2342f76da51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:28.106295 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 891/1781] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:28.111032 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e9fca2-996b-4ab2-91ae-44cb414ef480 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:28.124160 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e9fca2-996b-4ab2-91ae-44cb414ef480 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:28.161268 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96d76b-fecd-410f-8dc6-2d51a0a325e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:28.161999 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96d76b-fecd-410f-8dc6-2d51a0a325e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:28.162267 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96d76b-fecd-410f-8dc6-2d51a0a325e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:28.162548 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96d76b-fecd-410f-8dc6-2d51a0a325e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:28.163243 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96d76b-fecd-410f-8dc6-2d51a0a325e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:28:28.163553 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96d76b-fecd-410f-8dc6-2d51a0a325e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:28.165250 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96d76b-fecd-410f-8dc6-2d51a0a325e5 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:28.268516 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca641191-8e2d-4e3e-8ca1-2342f76da51d None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:28.282259 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 891/1782] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:28:28.320334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca641191-8e2d-4e3e-8ca1-2342f76da51d None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:28.371959 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f9aab-0856-4fc5-9e75-5e8b4f4004f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:28.391420 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f9aab-0856-4fc5-9e75-5e8b4f4004f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:28.391880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f9aab-0856-4fc5-9e75-5e8b4f4004f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:28.394224 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f9aab-0856-4fc5-9e75-5e8b4f4004f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:28.395672 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f9aab-0856-4fc5-9e75-5e8b4f4004f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:28.406567 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f9aab-0856-4fc5-9e75-5e8b4f4004f1 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:28.574450 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96d76b-fecd-410f-8dc6-2d51a0a325e5 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:28.584416 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 892/1783] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:28:28 2022] POST /identity/v3/projects => generated 387 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:28:28.638265 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96d76b-fecd-410f-8dc6-2d51a0a325e5 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:28.929879 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6238a-c56d-44e2-a80a-7aa4e1f2abd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:28.933172 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6238a-c56d-44e2-a80a-7aa4e1f2abd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:28.941590 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6238a-c56d-44e2-a80a-7aa4e1f2abd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:28.942610 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6238a-c56d-44e2-a80a-7aa4e1f2abd2 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:28.953893 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a6238a-c56d-44e2-a80a-7aa4e1f2abd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:28.964655 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a6238a-c56d-44e2-a80a-7aa4e1f2abd2 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:29.122694 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f9aab-0856-4fc5-9e75-5e8b4f4004f1 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:29.123337 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 892/1784] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:28:28 2022] POST /identity/v3/users => generated 294 bytes in 549 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:28:29.153843 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f9aab-0856-4fc5-9e75-5e8b4f4004f1 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:29.184120 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f45f64-13e2-4134-8448-08ac308f903f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:29.190522 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f45f64-13e2-4134-8448-08ac308f903f admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:29.194105 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f45f64-13e2-4134-8448-08ac308f903f admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:29.194611 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f45f64-13e2-4134-8448-08ac308f903f admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:29.195584 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f45f64-13e2-4134-8448-08ac308f903f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:29.202110 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f45f64-13e2-4134-8448-08ac308f903f admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:29.254563 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 893/1785] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:28:29.259023 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6238a-c56d-44e2-a80a-7aa4e1f2abd2 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:29.282284 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6238a-c56d-44e2-a80a-7aa4e1f2abd2 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:29.312516 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b85085-df07-4d10-b7a6-eadc80f000e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:29.321863 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b85085-df07-4d10-b7a6-eadc80f000e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:29.322724 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b85085-df07-4d10-b7a6-eadc80f000e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:29.323428 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b85085-df07-4d10-b7a6-eadc80f000e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:29.324785 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b85085-df07-4d10-b7a6-eadc80f000e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:29.328196 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b85085-df07-4d10-b7a6-eadc80f000e6 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:29.418039 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 893/1786] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:28:29.423566 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f45f64-13e2-4134-8448-08ac308f903f admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:29.441101 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:29.462349 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f45f64-13e2-4134-8448-08ac308f903f admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:29.504483 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3faed0-3aca-4d16-b741-a7598c176154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:29.507980 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3faed0-3aca-4d16-b741-a7598c176154 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:29.507980 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3faed0-3aca-4d16-b741-a7598c176154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:29.507980 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3faed0-3aca-4d16-b741-a7598c176154 admin admin] PATH_INFO: `/v3/projects/c10ad9a154a64487b66adcc60f37268a/users/5fce10faaaca4ee59838986bec14494c/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:29.578820 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3faed0-3aca-4d16-b741-a7598c176154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c10ad9a154a64487b66adcc60f37268a, user_id=5fce10faaaca4ee59838986bec14494c, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:29.581758 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3faed0-3aca-4d16-b741-a7598c176154 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:29.635575 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 894/1787] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:28:29 2022] PUT /identity/v3/projects/c10ad9a154a64487b66adcc60f37268a/users/5fce10faaaca4ee59838986bec14494c/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:29.646811 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ec330-37bd-40c7-a73e-b03b4f2e478e None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:29.647803 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ec330-37bd-40c7-a73e-b03b4f2e478e None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:29.647803 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ec330-37bd-40c7-a73e-b03b4f2e478e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:29.735551 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:29.796719 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-067ec330-37bd-40c7-a73e-b03b4f2e478e None None] MFA Rules not processed for user `5fce10faaaca4ee59838986bec14494c`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:29.804613 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-067ec330-37bd-40c7-a73e-b03b4f2e478e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:30.169540 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 894/1788] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 525 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:30.174865 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3faed0-3aca-4d16-b741-a7598c176154 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:30.298992 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708c044-9e8e-41ba-91aa-2f14aa96713c None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:30.304610 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708c044-9e8e-41ba-91aa-2f14aa96713c None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:30.306204 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708c044-9e8e-41ba-91aa-2f14aa96713c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:30.489244 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-b708c044-9e8e-41ba-91aa-2f14aa96713c None None] MFA Rules not processed for user `84ea6fbc3de84b7db9e62b9ee6055c52`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:30.494465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3faed0-3aca-4d16-b741-a7598c176154 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:30.499615 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-b708c044-9e8e-41ba-91aa-2f14aa96713c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:30.515096 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41cdec2-9c72-4954-9334-9442523afd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:30.516541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cdec2-9c72-4954-9334-9442523afd4b admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:30.519955 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cdec2-9c72-4954-9334-9442523afd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:30.520504 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cdec2-9c72-4954-9334-9442523afd4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:30.521788 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41cdec2-9c72-4954-9334-9442523afd4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:30.533133 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41cdec2-9c72-4954-9334-9442523afd4b admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:30.664240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 895/1789] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:28:30 2022] POST /identity/v3/projects => generated 385 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:28:30.665490 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41cdec2-9c72-4954-9334-9442523afd4b admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:30.684021 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-e41cdec2-9c72-4954-9334-9442523afd4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:30.864691 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 895/1790] 10.222.0.84 () {58 vars in 1015 bytes} [Tue Aug 23 22:28:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 569 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:30.879411 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708c044-9e8e-41ba-91aa-2f14aa96713c None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:30.948502 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708c044-9e8e-41ba-91aa-2f14aa96713c None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:31.125164 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41cdec2-9c72-4954-9334-9442523afd4b admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:31.142344 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e61eb-8fe1-4786-8007-e99092ad1390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:31.144566 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e61eb-8fe1-4786-8007-e99092ad1390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:31.146944 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e61eb-8fe1-4786-8007-e99092ad1390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:31.149731 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e61eb-8fe1-4786-8007-e99092ad1390 admin admin] PATH_INFO: `/v3/users/8d7cdf34f3074e11964cb0dd75aa928d` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:31.152001 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e61eb-8fe1-4786-8007-e99092ad1390 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d7cdf34f3074e11964cb0dd75aa928d)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:31.162012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e61eb-8fe1-4786-8007-e99092ad1390 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:31.183575 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c476501-3e6f-454a-bd83-10f90f2adca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:31.192190 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c476501-3e6f-454a-bd83-10f90f2adca2 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:31.194228 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c476501-3e6f-454a-bd83-10f90f2adca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:31.197280 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c476501-3e6f-454a-bd83-10f90f2adca2 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:31.199351 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c476501-3e6f-454a-bd83-10f90f2adca2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:31.211377 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c476501-3e6f-454a-bd83-10f90f2adca2 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:31.352679 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 896/1791] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:28:30 2022] POST /identity/v3/users => generated 299 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:28:31.354667 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c476501-3e6f-454a-bd83-10f90f2adca2 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:31.368106 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-680e61eb-8fe1-4786-8007-e99092ad1390 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d7cdf34f3074e11964cb0dd75aa928d'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:31.370139 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-680e61eb-8fe1-4786-8007-e99092ad1390 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d7cdf34f3074e11964cb0dd75aa928d'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:31.375235 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-6c476501-3e6f-454a-bd83-10f90f2adca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:31.397524 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-680e61eb-8fe1-4786-8007-e99092ad1390 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d7cdf34f3074e11964cb0dd75aa928d'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:31.439367 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-680e61eb-8fe1-4786-8007-e99092ad1390 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d7cdf34f3074e11964cb0dd75aa928d'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:31.443924 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-680e61eb-8fe1-4786-8007-e99092ad1390 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d7cdf34f3074e11964cb0dd75aa928d'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:31.453220 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:31.532035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 896/1792] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:28:30 2022] DELETE /identity/v3/users/8d7cdf34f3074e11964cb0dd75aa928d => generated 0 bytes in 867 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:31.535350 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e61eb-8fe1-4786-8007-e99092ad1390 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:31.542635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-680e61eb-8fe1-4786-8007-e99092ad1390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:31.607972 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:31.719198 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c476501-3e6f-454a-bd83-10f90f2adca2 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:31.853506 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e61eb-8fe1-4786-8007-e99092ad1390 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:31.885676 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdedfb1-0c44-4bf9-ac49-19559886ed49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:31.886931 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdedfb1-0c44-4bf9-ac49-19559886ed49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:31.887439 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdedfb1-0c44-4bf9-ac49-19559886ed49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:31.887950 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdedfb1-0c44-4bf9-ac49-19559886ed49 admin admin] PATH_INFO: `/v3/projects/641e4a5d1e614d52b031d745c113ead2` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:31.900998 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdedfb1-0c44-4bf9-ac49-19559886ed49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=641e4a5d1e614d52b031d745c113ead2)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:31.912950 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdedfb1-0c44-4bf9-ac49-19559886ed49 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:31.932732 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47291716-0105-460f-b110-c0082635ede8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:31.934272 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47291716-0105-460f-b110-c0082635ede8 service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:31.937616 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47291716-0105-460f-b110-c0082635ede8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:31.938143 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47291716-0105-460f-b110-c0082635ede8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:31.942703 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-47291716-0105-460f-b110-c0082635ede8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:31.982565 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47291716-0105-460f-b110-c0082635ede8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:31.986319 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47291716-0105-460f-b110-c0082635ede8 service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:32.011402 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 897/1793] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:32.013309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47291716-0105-460f-b110-c0082635ede8 service neutron] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:32.028309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-47291716-0105-460f-b110-c0082635ede8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:32.080088 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-9bdedfb1-0c44-4bf9-ac49-19559886ed49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '641e4a5d1e614d52b031d745c113ead2', 'request_id': 'req-9bdedfb1-0c44-4bf9-ac49-19559886ed49'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:32.088953 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47291716-0105-460f-b110-c0082635ede8 service neutron] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:32.094892 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-9bdedfb1-0c44-4bf9-ac49-19559886ed49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '641e4a5d1e614d52b031d745c113ead2', 'request_id': 'req-9bdedfb1-0c44-4bf9-ac49-19559886ed49'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:32.153045 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-9bdedfb1-0c44-4bf9-ac49-19559886ed49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '641e4a5d1e614d52b031d745c113ead2', 'request_id': 'req-9bdedfb1-0c44-4bf9-ac49-19559886ed49'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:32.182285 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-9bdedfb1-0c44-4bf9-ac49-19559886ed49 admin admin] The token cache is being invalidate because project 641e4a5d1e614d52b031d745c113ead2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:28:32.182285 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-9bdedfb1-0c44-4bf9-ac49-19559886ed49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:32.182285 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-9bdedfb1-0c44-4bf9-ac49-19559886ed49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:32.182285 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 897/1794] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:28:31 2022] DELETE /identity/v3/projects/641e4a5d1e614d52b031d745c113ead2 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:32.182285 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdedfb1-0c44-4bf9-ac49-19559886ed49 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:32.189411 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-9bdedfb1-0c44-4bf9-ac49-19559886ed49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:32.319509 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca62c1-8823-4ea0-9ca8-a1d8be136118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:32.320155 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca62c1-8823-4ea0-9ca8-a1d8be136118 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:32.320489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca62c1-8823-4ea0-9ca8-a1d8be136118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:32.320766 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca62c1-8823-4ea0-9ca8-a1d8be136118 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:32.322374 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca62c1-8823-4ea0-9ca8-a1d8be136118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:32.341766 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca62c1-8823-4ea0-9ca8-a1d8be136118 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:32.408039 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdedfb1-0c44-4bf9-ac49-19559886ed49 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:32.413254 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4f637-e1f2-4cab-941c-f6929a0647a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:32.414943 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4f637-e1f2-4cab-941c-f6929a0647a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:32.415234 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4f637-e1f2-4cab-941c-f6929a0647a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:32.415745 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4f637-e1f2-4cab-941c-f6929a0647a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:32.415950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 898/1795] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:28:32.418116 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-39a4f637-e1f2-4cab-941c-f6929a0647a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:32.421549 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138df82e-5a97-4637-89e6-148ad5cd1126 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:32.425071 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138df82e-5a97-4637-89e6-148ad5cd1126 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:32.427109 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138df82e-5a97-4637-89e6-148ad5cd1126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:32.458972 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4f637-e1f2-4cab-941c-f6929a0647a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:32.467062 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4f637-e1f2-4cab-941c-f6929a0647a6 service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:32.480043 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-138df82e-5a97-4637-89e6-148ad5cd1126 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:32.482701 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-138df82e-5a97-4637-89e6-148ad5cd1126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:32.516474 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 898/1796] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:32.519586 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9249a0-5b5a-42b7-85e0-e3838a911bf3 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:32.525238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9249a0-5b5a-42b7-85e0-e3838a911bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:32.525238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9249a0-5b5a-42b7-85e0-e3838a911bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:32.527304 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 899/1797] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:32.532176 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138df82e-5a97-4637-89e6-148ad5cd1126 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:32.540486 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-138df82e-5a97-4637-89e6-148ad5cd1126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:32.597412 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138df82e-5a97-4637-89e6-148ad5cd1126 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:32.614034 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-8b9249a0-5b5a-42b7-85e0-e3838a911bf3 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:32.614034 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-8b9249a0-5b5a-42b7-85e0-e3838a911bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:32.638852 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212e236-aa72-46d5-a226-30f966e16364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:32.642582 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212e236-aa72-46d5-a226-30f966e16364 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:32.643391 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212e236-aa72-46d5-a226-30f966e16364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:32.644726 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212e236-aa72-46d5-a226-30f966e16364 admin admin] PATH_INFO: `/v3/projects/1655f07b44814a77ab99095d9745a27f/users/9e232c00305846278e0a9a2c18bf97b2/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:32.668870 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 899/1798] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:32.671798 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9249a0-5b5a-42b7-85e0-e3838a911bf3 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:32.683731 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-8b9249a0-5b5a-42b7-85e0-e3838a911bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:32.714753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212e236-aa72-46d5-a226-30f966e16364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1655f07b44814a77ab99095d9745a27f, user_id=9e232c00305846278e0a9a2c18bf97b2, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:32.723684 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212e236-aa72-46d5-a226-30f966e16364 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:32.752372 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9249a0-5b5a-42b7-85e0-e3838a911bf3 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:32.778572 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33227bde-ef69-47e9-b9b7-3e2bf9558683 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:32.779322 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33227bde-ef69-47e9-b9b7-3e2bf9558683 service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:32.780009 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33227bde-ef69-47e9-b9b7-3e2bf9558683 service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:32.783647 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33227bde-ef69-47e9-b9b7-3e2bf9558683 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:32.803293 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:32.810625 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33227bde-ef69-47e9-b9b7-3e2bf9558683 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:32.813292 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33227bde-ef69-47e9-b9b7-3e2bf9558683 service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:32.842427 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 900/1799] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:28:32 2022] PUT /identity/v3/projects/1655f07b44814a77ab99095d9745a27f/users/9e232c00305846278e0a9a2c18bf97b2/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:32.849144 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c9c7e-e848-4819-a574-dd3c11e4b0ba None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:32.849628 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c9c7e-e848-4819-a574-dd3c11e4b0ba None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:32.851062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c9c7e-e848-4819-a574-dd3c11e4b0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:32.852976 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 900/1800] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:32.864924 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33227bde-ef69-47e9-b9b7-3e2bf9558683 service neutron] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:32.892504 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33227bde-ef69-47e9-b9b7-3e2bf9558683 service neutron] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:32.939886 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-269c9c7e-e848-4819-a574-dd3c11e4b0ba None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:32.946824 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-269c9c7e-e848-4819-a574-dd3c11e4b0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:33.090979 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be689b3b-479c-4367-a140-b200076f0ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:33.092564 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be689b3b-479c-4367-a140-b200076f0ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:33.093308 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be689b3b-479c-4367-a140-b200076f0ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:33.094247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be689b3b-479c-4367-a140-b200076f0ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:33.096107 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be689b3b-479c-4367-a140-b200076f0ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:33.103280 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be689b3b-479c-4367-a140-b200076f0ab5 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:33.148018 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:33.160610 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 901/1801] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:28:33.169068 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 901/1802] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:33.170225 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c9c7e-e848-4819-a574-dd3c11e4b0ba None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:33.171671 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be689b3b-479c-4367-a140-b200076f0ab5 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:33.193086 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c9c7e-e848-4819-a574-dd3c11e4b0ba None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:33.203512 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd98a9e-ac60-4bc4-a528-f03d7b411370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:33.204816 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd98a9e-ac60-4bc4-a528-f03d7b411370 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:33.205340 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd98a9e-ac60-4bc4-a528-f03d7b411370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:33.206067 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd98a9e-ac60-4bc4-a528-f03d7b411370 admin admin] PATH_INFO: `/v3/projects/1655f07b44814a77ab99095d9745a27f/users/9e232c00305846278e0a9a2c18bf97b2/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:33.210983 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd98a9e-ac60-4bc4-a528-f03d7b411370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1655f07b44814a77ab99095d9745a27f, user_id=9e232c00305846278e0a9a2c18bf97b2, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:33.214296 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be689b3b-479c-4367-a140-b200076f0ab5 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:33.233650 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd98a9e-ac60-4bc4-a528-f03d7b411370 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:33.237933 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6352674-1360-486f-b2fc-7884b8d7e84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:33.238770 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6352674-1360-486f-b2fc-7884b8d7e84b admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:33.239105 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6352674-1360-486f-b2fc-7884b8d7e84b admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:33.239379 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6352674-1360-486f-b2fc-7884b8d7e84b admin admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:33.240085 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6352674-1360-486f-b2fc-7884b8d7e84b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:28:33.240476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6352674-1360-486f-b2fc-7884b8d7e84b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:33.246914 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6352674-1360-486f-b2fc-7884b8d7e84b admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:33.288128 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 902/1803] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:28:33 2022] PUT /identity/v3/projects/1655f07b44814a77ab99095d9745a27f/users/9e232c00305846278e0a9a2c18bf97b2/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:33.301577 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada063fd-2893-4e3a-9301-08ad0c0d3b56 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:33.302882 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada063fd-2893-4e3a-9301-08ad0c0d3b56 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:33.303425 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada063fd-2893-4e3a-9301-08ad0c0d3b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:33.327601 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 902/1804] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:28:33.328797 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6352674-1360-486f-b2fc-7884b8d7e84b admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:33.369197 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6352674-1360-486f-b2fc-7884b8d7e84b admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:33.426485 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-ada063fd-2893-4e3a-9301-08ad0c0d3b56 None None] MFA Rules not processed for user `9e232c00305846278e0a9a2c18bf97b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:33.429933 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-ada063fd-2893-4e3a-9301-08ad0c0d3b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:33.616127 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff881988-3fc2-4287-af27-58a8a8122dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:33.617350 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff881988-3fc2-4287-af27-58a8a8122dad admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:33.617900 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff881988-3fc2-4287-af27-58a8a8122dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:33.618340 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff881988-3fc2-4287-af27-58a8a8122dad admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:33.619488 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff881988-3fc2-4287-af27-58a8a8122dad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:33.621740 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff881988-3fc2-4287-af27-58a8a8122dad admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:33.699082 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 903/1805] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:28:33 2022] POST /identity/v3/projects => generated 365 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:28:33.706465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff881988-3fc2-4287-af27-58a8a8122dad admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:33.817569 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 903/1806] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 510 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:28:33.846574 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada063fd-2893-4e3a-9301-08ad0c0d3b56 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:33.850861 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-ada063fd-2893-4e3a-9301-08ad0c0d3b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:34.106527 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff881988-3fc2-4287-af27-58a8a8122dad admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:34.128351 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d12b3-35b8-432c-9462-e6af5d876020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:34.137269 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d12b3-35b8-432c-9462-e6af5d876020 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:34.140444 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d12b3-35b8-432c-9462-e6af5d876020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:34.141340 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d12b3-35b8-432c-9462-e6af5d876020 admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:34.147893 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d12b3-35b8-432c-9462-e6af5d876020 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:34.159090 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d12b3-35b8-432c-9462-e6af5d876020 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:34.221507 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:34.255302 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada063fd-2893-4e3a-9301-08ad0c0d3b56 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:34.273447 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 904/1807] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:28:33 2022] POST /identity/v3/users => generated 283 bytes in 568 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:28:34.311856 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d12b3-35b8-432c-9462-e6af5d876020 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:34.381637 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d12b3-35b8-432c-9462-e6af5d876020 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:34.427603 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ce477-40dd-4f42-a30e-6e1a029b3af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:34.430797 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ce477-40dd-4f42-a30e-6e1a029b3af3 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:34.441967 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ce477-40dd-4f42-a30e-6e1a029b3af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:34.448467 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ce477-40dd-4f42-a30e-6e1a029b3af3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:34.453041 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ce477-40dd-4f42-a30e-6e1a029b3af3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:34.468971 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ce477-40dd-4f42-a30e-6e1a029b3af3 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:34.560762 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 905/1808] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:28:34.571384 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ce477-40dd-4f42-a30e-6e1a029b3af3 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:34.619112 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ce477-40dd-4f42-a30e-6e1a029b3af3 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:34.642481 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fcf1d3-1732-496f-87a2-45da4fc932f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:34.642481 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fcf1d3-1732-496f-87a2-45da4fc932f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:34.644368 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fcf1d3-1732-496f-87a2-45da4fc932f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:34.644882 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fcf1d3-1732-496f-87a2-45da4fc932f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:34.646743 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266597d8-89a0-448c-b547-c35a03169e22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:34.647178 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fcf1d3-1732-496f-87a2-45da4fc932f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:34.647973 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266597d8-89a0-448c-b547-c35a03169e22 service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:34.648869 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266597d8-89a0-448c-b547-c35a03169e22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:34.649734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266597d8-89a0-448c-b547-c35a03169e22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:34.651873 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fcf1d3-1732-496f-87a2-45da4fc932f6 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:34.693944 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 906/1809] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:28:34.695696 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fcf1d3-1732-496f-87a2-45da4fc932f6 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:34.731508 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fcf1d3-1732-496f-87a2-45da4fc932f6 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:34.761641 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df74c0c-9d17-46ce-8c5b-e716e3c5f348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:34.763321 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df74c0c-9d17-46ce-8c5b-e716e3c5f348 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:34.767959 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df74c0c-9d17-46ce-8c5b-e716e3c5f348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:34.769381 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df74c0c-9d17-46ce-8c5b-e716e3c5f348 admin admin] PATH_INFO: `/v3/projects/0585a5ba629e45f3928c5ea88ee605d2/users/b240e53f64ba4c84a40077bfc4dc9229/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:34.827922 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df74c0c-9d17-46ce-8c5b-e716e3c5f348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0585a5ba629e45f3928c5ea88ee605d2, user_id=b240e53f64ba4c84a40077bfc4dc9229, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:34.830169 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:34.834215 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df74c0c-9d17-46ce-8c5b-e716e3c5f348 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:34.878843 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 907/1810] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:28:34 2022] PUT /identity/v3/projects/0585a5ba629e45f3928c5ea88ee605d2/users/b240e53f64ba4c84a40077bfc4dc9229/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:34.892138 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d92e3-d2c0-4424-934a-be00523df377 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:34.892843 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d92e3-d2c0-4424-934a-be00523df377 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:34.894449 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d92e3-d2c0-4424-934a-be00523df377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:34.898423 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266597d8-89a0-448c-b547-c35a03169e22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:34.900246 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266597d8-89a0-448c-b547-c35a03169e22 service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:34.966395 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 904/1811] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:33 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 1121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:28:35.053554 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-088d92e3-d2c0-4424-934a-be00523df377 None None] MFA Rules not processed for user `b240e53f64ba4c84a40077bfc4dc9229`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:35.054923 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-088d92e3-d2c0-4424-934a-be00523df377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:35.138217 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266597d8-89a0-448c-b547-c35a03169e22 service cinder] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:35.161199 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266597d8-89a0-448c-b547-c35a03169e22 service cinder] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:35.416912 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 908/1812] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 526 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:35.418962 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d92e3-d2c0-4424-934a-be00523df377 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:35.432696 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d0d40-79da-4983-b715-45a4ee1a411e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:35.434387 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d0d40-79da-4983-b715-45a4ee1a411e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:35.435267 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d0d40-79da-4983-b715-45a4ee1a411e admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:35.437071 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d0d40-79da-4983-b715-45a4ee1a411e admin admin] PATH_INFO: `/v3/users/5fce10faaaca4ee59838986bec14494c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:35.440029 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d0d40-79da-4983-b715-45a4ee1a411e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fce10faaaca4ee59838986bec14494c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:35.446084 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d0d40-79da-4983-b715-45a4ee1a411e admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:35.504121 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d92e3-d2c0-4424-934a-be00523df377 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:35.552270 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3983064-3601-4e3f-b436-3d85d9774373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:35.569694 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3983064-3601-4e3f-b436-3d85d9774373 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:35.570117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3983064-3601-4e3f-b436-3d85d9774373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:35.570384 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3983064-3601-4e3f-b436-3d85d9774373 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:35.571110 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3983064-3601-4e3f-b436-3d85d9774373 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:35.581907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3983064-3601-4e3f-b436-3d85d9774373 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:35.766382 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-5e0d0d40-79da-4983-b715-45a4ee1a411e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fce10faaaca4ee59838986bec14494c'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:35.768598 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-5e0d0d40-79da-4983-b715-45a4ee1a411e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fce10faaaca4ee59838986bec14494c'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:35.810858 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-5e0d0d40-79da-4983-b715-45a4ee1a411e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fce10faaaca4ee59838986bec14494c'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:35.865207 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 909/1813] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:28:35 2022] POST /identity/v3/projects => generated 365 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:28:35.875277 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3983064-3601-4e3f-b436-3d85d9774373 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:35.877282 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-5e0d0d40-79da-4983-b715-45a4ee1a411e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fce10faaaca4ee59838986bec14494c'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:35.887167 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-f3983064-3601-4e3f-b436-3d85d9774373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:35.975658 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-5e0d0d40-79da-4983-b715-45a4ee1a411e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fce10faaaca4ee59838986bec14494c'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:36.009892 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 905/1814] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:28:35 2022] DELETE /identity/v3/users/5fce10faaaca4ee59838986bec14494c => generated 0 bytes in 870 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:36.020588 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905a481-87a6-4542-90aa-a4a060a80c0f None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:36.021252 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905a481-87a6-4542-90aa-a4a060a80c0f None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:36.021793 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905a481-87a6-4542-90aa-a4a060a80c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:36.137711 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-4905a481-87a6-4542-90aa-a4a060a80c0f None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:36.140370 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-4905a481-87a6-4542-90aa-a4a060a80c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:36.367516 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3983064-3601-4e3f-b436-3d85d9774373 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:36.488801 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:36.566344 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:36.637683 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 906/1815] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 619 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:36.705652 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40000f4a-e360-4d71-afd7-e912371399d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:36.706904 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40000f4a-e360-4d71-afd7-e912371399d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:36.707442 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40000f4a-e360-4d71-afd7-e912371399d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:36.708256 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40000f4a-e360-4d71-afd7-e912371399d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:36.710061 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40000f4a-e360-4d71-afd7-e912371399d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:36.724344 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40000f4a-e360-4d71-afd7-e912371399d5 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:36.736788 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905a481-87a6-4542-90aa-a4a060a80c0f None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:36.739892 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-4905a481-87a6-4542-90aa-a4a060a80c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:36.803825 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 910/1816] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:28:35 2022] POST /identity/v3/users => generated 289 bytes in 938 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:28:36.810261 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40000f4a-e360-4d71-afd7-e912371399d5 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:36.846732 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40000f4a-e360-4d71-afd7-e912371399d5 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:36.857552 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec295d5-7466-4cb5-abfe-7451de69dbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:36.859585 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec295d5-7466-4cb5-abfe-7451de69dbbb admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:36.859955 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec295d5-7466-4cb5-abfe-7451de69dbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:36.861214 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec295d5-7466-4cb5-abfe-7451de69dbbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:36.865923 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec295d5-7466-4cb5-abfe-7451de69dbbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:36.882002 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec295d5-7466-4cb5-abfe-7451de69dbbb admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:36.932205 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 911/1817] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:28:36.946229 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec295d5-7466-4cb5-abfe-7451de69dbbb admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:36.986758 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905a481-87a6-4542-90aa-a4a060a80c0f None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:36.990324 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec295d5-7466-4cb5-abfe-7451de69dbbb admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:37.004668 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fde820-c282-48f0-a564-4212963599b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:37.005705 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fde820-c282-48f0-a564-4212963599b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:37.006071 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fde820-c282-48f0-a564-4212963599b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:37.006348 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fde820-c282-48f0-a564-4212963599b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:37.026433 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f1026-67a5-48f3-a999-e3970471016b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:37.027363 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f1026-67a5-48f3-a999-e3970471016b admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:37.027730 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f1026-67a5-48f3-a999-e3970471016b admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:37.028026 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f1026-67a5-48f3-a999-e3970471016b admin admin] PATH_INFO: `/v3/projects/5367bd5a55d74a74bdf2073377133aa5/users/05797ac1a16b472ea0224af53a286068/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:37.046576 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fde820-c282-48f0-a564-4212963599b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:37.048348 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fde820-c282-48f0-a564-4212963599b6 service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:37.076199 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 907/1818] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:37.078208 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f1026-67a5-48f3-a999-e3970471016b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5367bd5a55d74a74bdf2073377133aa5, user_id=05797ac1a16b472ea0224af53a286068, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:37.081664 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f1026-67a5-48f3-a999-e3970471016b admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:37.153645 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 912/1819] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:28:36 2022] PUT /identity/v3/projects/5367bd5a55d74a74bdf2073377133aa5/users/05797ac1a16b472ea0224af53a286068/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:37.161412 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fde820-c282-48f0-a564-4212963599b6 service neutron] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:37.187969 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fde820-c282-48f0-a564-4212963599b6 service neutron] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:37.416753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f6481-5599-4564-88b4-88162123c9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:37.417426 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f6481-5599-4564-88b4-88162123c9af admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:37.417724 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f6481-5599-4564-88b4-88162123c9af admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:37.418000 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f6481-5599-4564-88b4-88162123c9af admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:37.419077 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f6481-5599-4564-88b4-88162123c9af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:37.421710 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f6481-5599-4564-88b4-88162123c9af admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:37.453963 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 908/1820] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:28:37.455805 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f1026-67a5-48f3-a999-e3970471016b admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:37.490163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f1026-67a5-48f3-a999-e3970471016b admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:37.523609 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf0763-994c-4eea-9f3f-23e085ee8a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:37.524696 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf0763-994c-4eea-9f3f-23e085ee8a14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:37.525179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf0763-994c-4eea-9f3f-23e085ee8a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:37.525724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf0763-994c-4eea-9f3f-23e085ee8a14 admin admin] PATH_INFO: `/v3/projects/5367bd5a55d74a74bdf2073377133aa5/users/05797ac1a16b472ea0224af53a286068/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:37.549230 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf0763-994c-4eea-9f3f-23e085ee8a14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5367bd5a55d74a74bdf2073377133aa5, user_id=05797ac1a16b472ea0224af53a286068, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:37.553107 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf0763-994c-4eea-9f3f-23e085ee8a14 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:37.618534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 913/1821] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:28:37 2022] PUT /identity/v3/projects/5367bd5a55d74a74bdf2073377133aa5/users/05797ac1a16b472ea0224af53a286068/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:37.637587 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751751ac-cfb1-4a84-ba6b-6c8d2ebd7b26 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:37.649725 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751751ac-cfb1-4a84-ba6b-6c8d2ebd7b26 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:37.650553 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751751ac-cfb1-4a84-ba6b-6c8d2ebd7b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:37.795365 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-751751ac-cfb1-4a84-ba6b-6c8d2ebd7b26 None None] MFA Rules not processed for user `05797ac1a16b472ea0224af53a286068`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:37.804921 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-751751ac-cfb1-4a84-ba6b-6c8d2ebd7b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:38.129388 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 909/1822] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:37 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 500 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:38.177593 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf0763-994c-4eea-9f3f-23e085ee8a14 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:38.182854 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-ffcf0763-994c-4eea-9f3f-23e085ee8a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:38.342110 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11535df2-2d8b-465f-8bc4-c5ab532af7fe None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:38.343240 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11535df2-2d8b-465f-8bc4-c5ab532af7fe None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:38.344094 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11535df2-2d8b-465f-8bc4-c5ab532af7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:38.458676 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-11535df2-2d8b-465f-8bc4-c5ab532af7fe None None] MFA Rules not processed for user `388f72ff05784e6bae5ca4f085d7c55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:38.460755 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-11535df2-2d8b-465f-8bc4-c5ab532af7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:38.572055 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:38.588228 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf0763-994c-4eea-9f3f-23e085ee8a14 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:38.614040 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff912b9c-bf71-40cb-b881-da9f74c2fff9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:38.616344 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff912b9c-bf71-40cb-b881-da9f74c2fff9 service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:38.620021 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff912b9c-bf71-40cb-b881-da9f74c2fff9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:38.621994 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff912b9c-bf71-40cb-b881-da9f74c2fff9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:38.683918 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff912b9c-bf71-40cb-b881-da9f74c2fff9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:38.692733 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff912b9c-bf71-40cb-b881-da9f74c2fff9 service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:38.742420 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 910/1823] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:38.765864 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 914/1824] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:38 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:39.074125 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11535df2-2d8b-465f-8bc4-c5ab532af7fe None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:39.091342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11535df2-2d8b-465f-8bc4-c5ab532af7fe None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:39.097227 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9eefd3-6455-4ced-86a7-b46f1facfce8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:39.098202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9eefd3-6455-4ced-86a7-b46f1facfce8 service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:39.098851 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9eefd3-6455-4ced-86a7-b46f1facfce8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:39.099448 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9eefd3-6455-4ced-86a7-b46f1facfce8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:39.101901 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-ad9eefd3-6455-4ced-86a7-b46f1facfce8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:39.254311 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff912b9c-bf71-40cb-b881-da9f74c2fff9 service cinder] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:39.255760 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-ff912b9c-bf71-40cb-b881-da9f74c2fff9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:39.292344 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9eefd3-6455-4ced-86a7-b46f1facfce8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:39.296288 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9eefd3-6455-4ced-86a7-b46f1facfce8 service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:39.376215 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 911/1825] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:39.554627 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff912b9c-bf71-40cb-b881-da9f74c2fff9 service cinder] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:39.582649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4769922-5833-4a99-abb1-7619d5976bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:39.583479 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4769922-5833-4a99-abb1-7619d5976bc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:39.583737 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4769922-5833-4a99-abb1-7619d5976bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:39.584206 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4769922-5833-4a99-abb1-7619d5976bc8 admin admin] PATH_INFO: `/v3/projects/929e36d97bc14eb8a3a69769476e832b` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:39.597605 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4769922-5833-4a99-abb1-7619d5976bc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=929e36d97bc14eb8a3a69769476e832b)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:39.600665 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4769922-5833-4a99-abb1-7619d5976bc8 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:39.667568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:39.970792 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-b4769922-5833-4a99-abb1-7619d5976bc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '929e36d97bc14eb8a3a69769476e832b', 'request_id': 'req-b4769922-5833-4a99-abb1-7619d5976bc8'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:39.994101 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be601cd8-b6b8-4c04-9484-3feb086534ea None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:39.995579 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be601cd8-b6b8-4c04-9484-3feb086534ea None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:39.996468 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be601cd8-b6b8-4c04-9484-3feb086534ea None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:40.002405 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 912/1826] 10.222.0.77 () {54 vars in 921 bytes} [Tue Aug 23 22:28:39 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:28:40.005454 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-b4769922-5833-4a99-abb1-7619d5976bc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '929e36d97bc14eb8a3a69769476e832b', 'request_id': 'req-b4769922-5833-4a99-abb1-7619d5976bc8'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:40.047453 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-b4769922-5833-4a99-abb1-7619d5976bc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '929e36d97bc14eb8a3a69769476e832b', 'request_id': 'req-b4769922-5833-4a99-abb1-7619d5976bc8'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:40.084103 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-b4769922-5833-4a99-abb1-7619d5976bc8 admin admin] The token cache is being invalidate because project 929e36d97bc14eb8a3a69769476e832b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:28:40.086311 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-b4769922-5833-4a99-abb1-7619d5976bc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:40.089194 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-b4769922-5833-4a99-abb1-7619d5976bc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:40.096944 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 915/1827] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:28:39 2022] DELETE /identity/v3/projects/929e36d97bc14eb8a3a69769476e832b => generated 0 bytes in 843 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:40.103980 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be601cd8-b6b8-4c04-9484-3feb086534ea None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:40.109164 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-be601cd8-b6b8-4c04-9484-3feb086534ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:40.140499 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155132f-76f5-4848-9840-81534c59b550 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:40.140895 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155132f-76f5-4848-9840-81534c59b550 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:40.143125 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155132f-76f5-4848-9840-81534c59b550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:40.223626 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-5155132f-76f5-4848-9840-81534c59b550 None None] MFA Rules not processed for user `1a0af5bf009b48a8915c7320b16d08dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:40.225761 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-5155132f-76f5-4848-9840-81534c59b550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:40.540127 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 916/1828] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Aug 23 22:28:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:40.552609 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be601cd8-b6b8-4c04-9484-3feb086534ea None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:40.572467 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38166aa3-dd33-4159-8e82-94c25f02f4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:40.573538 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38166aa3-dd33-4159-8e82-94c25f02f4d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:40.574019 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38166aa3-dd33-4159-8e82-94c25f02f4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:40.574556 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38166aa3-dd33-4159-8e82-94c25f02f4d8 admin admin] PATH_INFO: `/v3/users/a36d940c85b64023a483c39017834d2d` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:40.576226 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38166aa3-dd33-4159-8e82-94c25f02f4d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a36d940c85b64023a483c39017834d2d)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:40.578787 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38166aa3-dd33-4159-8e82-94c25f02f4d8 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:40.693670 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-38166aa3-dd33-4159-8e82-94c25f02f4d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a36d940c85b64023a483c39017834d2d'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:40.694713 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-38166aa3-dd33-4159-8e82-94c25f02f4d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a36d940c85b64023a483c39017834d2d'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:40.709441 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-38166aa3-dd33-4159-8e82-94c25f02f4d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a36d940c85b64023a483c39017834d2d'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:40.723653 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-38166aa3-dd33-4159-8e82-94c25f02f4d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a36d940c85b64023a483c39017834d2d'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:40.736677 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:40.760408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-38166aa3-dd33-4159-8e82-94c25f02f4d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a36d940c85b64023a483c39017834d2d'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:40.785682 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 913/1829] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:28:40 2022] DELETE /identity/v3/users/a36d940c85b64023a483c39017834d2d => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:41.565499 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155132f-76f5-4848-9840-81534c59b550 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:41.568568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-5155132f-76f5-4848-9840-81534c59b550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:41.608550 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155132f-76f5-4848-9840-81534c59b550 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:41.858460 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d854b0-5593-4afa-87ea-0c24682b6a88 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:41.859354 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d854b0-5593-4afa-87ea-0c24682b6a88 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:41.860589 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d854b0-5593-4afa-87ea-0c24682b6a88 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:41.863700 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 914/1830] 10.222.0.77 () {54 vars in 921 bytes} [Tue Aug 23 22:28:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:28:41.915171 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a004a-3e24-4466-b6d3-196b0caa9f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:41.917931 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea203c9-8247-4c8f-9523-78591af2f66e None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:41.918578 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea203c9-8247-4c8f-9523-78591af2f66e None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:41.919045 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea203c9-8247-4c8f-9523-78591af2f66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:41.921132 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a004a-3e24-4466-b6d3-196b0caa9f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:41.924329 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a004a-3e24-4466-b6d3-196b0caa9f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:41.925844 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a004a-3e24-4466-b6d3-196b0caa9f77 admin admin] PATH_INFO: `/v3/projects/c10ad9a154a64487b66adcc60f37268a` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:41.930629 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a004a-3e24-4466-b6d3-196b0caa9f77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c10ad9a154a64487b66adcc60f37268a)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:41.952803 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a004a-3e24-4466-b6d3-196b0caa9f77 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:42.062824 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-2ea203c9-8247-4c8f-9523-78591af2f66e None None] MFA Rules not processed for user `1a0af5bf009b48a8915c7320b16d08dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:42.067540 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-2ea203c9-8247-4c8f-9523-78591af2f66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:42.127415 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:42.214796 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-fc8a004a-3e24-4466-b6d3-196b0caa9f77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c10ad9a154a64487b66adcc60f37268a', 'request_id': 'req-fc8a004a-3e24-4466-b6d3-196b0caa9f77'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:42.255063 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-fc8a004a-3e24-4466-b6d3-196b0caa9f77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c10ad9a154a64487b66adcc60f37268a', 'request_id': 'req-fc8a004a-3e24-4466-b6d3-196b0caa9f77'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:42.300538 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-fc8a004a-3e24-4466-b6d3-196b0caa9f77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c10ad9a154a64487b66adcc60f37268a', 'request_id': 'req-fc8a004a-3e24-4466-b6d3-196b0caa9f77'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:42.343511 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-fc8a004a-3e24-4466-b6d3-196b0caa9f77 admin admin] The token cache is being invalidate because project c10ad9a154a64487b66adcc60f37268a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:28:42.344990 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-fc8a004a-3e24-4466-b6d3-196b0caa9f77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:42.348417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-fc8a004a-3e24-4466-b6d3-196b0caa9f77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:42.354570 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 917/1831] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:28:41 2022] DELETE /identity/v3/projects/c10ad9a154a64487b66adcc60f37268a => generated 0 bytes in 790 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:42.361351 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a004a-3e24-4466-b6d3-196b0caa9f77 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:42.363713 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-fc8a004a-3e24-4466-b6d3-196b0caa9f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:42.429437 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 915/1832] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Aug 23 22:28:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 513 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:28:42.676281 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a004a-3e24-4466-b6d3-196b0caa9f77 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:42.692597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bc761-8b0c-47f9-af67-4d57b288a3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:42.693487 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bc761-8b0c-47f9-af67-4d57b288a3b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:42.693782 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bc761-8b0c-47f9-af67-4d57b288a3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:42.694100 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bc761-8b0c-47f9-af67-4d57b288a3b4 admin admin] PATH_INFO: `/v3/users/9e232c00305846278e0a9a2c18bf97b2` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:42.697565 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9bc761-8b0c-47f9-af67-4d57b288a3b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e232c00305846278e0a9a2c18bf97b2)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:42.699741 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9bc761-8b0c-47f9-af67-4d57b288a3b4 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:42.825768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-ad9bc761-8b0c-47f9-af67-4d57b288a3b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e232c00305846278e0a9a2c18bf97b2'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:42.832625 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea203c9-8247-4c8f-9523-78591af2f66e None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:42.835425 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-2ea203c9-8247-4c8f-9523-78591af2f66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:42.844694 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-ad9bc761-8b0c-47f9-af67-4d57b288a3b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e232c00305846278e0a9a2c18bf97b2'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:42.870328 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-ad9bc761-8b0c-47f9-af67-4d57b288a3b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e232c00305846278e0a9a2c18bf97b2'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:42.885037 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea203c9-8247-4c8f-9523-78591af2f66e None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:42.887962 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-ad9bc761-8b0c-47f9-af67-4d57b288a3b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e232c00305846278e0a9a2c18bf97b2'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:42.888939 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-ad9bc761-8b0c-47f9-af67-4d57b288a3b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e232c00305846278e0a9a2c18bf97b2'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:42.900562 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a7d88-5132-46af-b793-36488736d32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:42.903067 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a7d88-5132-46af-b793-36488736d32c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:42.904718 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a7d88-5132-46af-b793-36488736d32c admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:42.905699 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a7d88-5132-46af-b793-36488736d32c admin admin] PATH_INFO: `/v3/users/18f109c52ebd4697a0dbfab5214e236a` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:42.910273 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a7d88-5132-46af-b793-36488736d32c admin admin] RBAC: Authorizing `identity:delete_user(user_id=18f109c52ebd4697a0dbfab5214e236a)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:42.916498 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a7d88-5132-46af-b793-36488736d32c admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:42.931705 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 918/1833] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:28:42 2022] DELETE /identity/v3/users/9e232c00305846278e0a9a2c18bf97b2 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:43.076824 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-b04a7d88-5132-46af-b793-36488736d32c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18f109c52ebd4697a0dbfab5214e236a'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:43.077619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-b04a7d88-5132-46af-b793-36488736d32c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18f109c52ebd4697a0dbfab5214e236a'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:43.087994 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-b04a7d88-5132-46af-b793-36488736d32c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18f109c52ebd4697a0dbfab5214e236a'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:43.101640 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-b04a7d88-5132-46af-b793-36488736d32c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18f109c52ebd4697a0dbfab5214e236a'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:43.131869 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-b04a7d88-5132-46af-b793-36488736d32c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18f109c52ebd4697a0dbfab5214e236a'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:43.147230 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 916/1834] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:28:42 2022] DELETE /identity/v3/users/18f109c52ebd4697a0dbfab5214e236a => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:43.152939 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd773edc-b9aa-4819-bca4-9fb483b9886e None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:43.153452 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd773edc-b9aa-4819-bca4-9fb483b9886e None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:43.154171 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd773edc-b9aa-4819-bca4-9fb483b9886e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:43.206142 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-dd773edc-b9aa-4819-bca4-9fb483b9886e None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:43.209434 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-dd773edc-b9aa-4819-bca4-9fb483b9886e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:43.290794 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:43.344191 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 919/1835] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:43.377353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a7d88-5132-46af-b793-36488736d32c admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:43.378922 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-b04a7d88-5132-46af-b793-36488736d32c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:43.490347 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:43.500053 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a7d88-5132-46af-b793-36488736d32c admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:43.536133 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0c61c-efab-4a00-9f5f-59e041986c04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:43.538919 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0c61c-efab-4a00-9f5f-59e041986c04 service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:43.539411 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0c61c-efab-4a00-9f5f-59e041986c04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:43.544640 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0c61c-efab-4a00-9f5f-59e041986c04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:43.589233 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0c61c-efab-4a00-9f5f-59e041986c04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:43.598879 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0c61c-efab-4a00-9f5f-59e041986c04 service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:43.622665 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 917/1836] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:43.746191 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd773edc-b9aa-4819-bca4-9fb483b9886e None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:43.750510 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-dd773edc-b9aa-4819-bca4-9fb483b9886e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:43.959701 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0c61c-efab-4a00-9f5f-59e041986c04 service neutron] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:43.962856 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-bde0c61c-efab-4a00-9f5f-59e041986c04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:44.028105 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0c61c-efab-4a00-9f5f-59e041986c04 service neutron] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:44.034497 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd773edc-b9aa-4819-bca4-9fb483b9886e None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:44.040419 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f035b-3cb5-4d07-aa53-f00eda41e7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:44.041922 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f035b-3cb5-4d07-aa53-f00eda41e7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:44.042693 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f035b-3cb5-4d07-aa53-f00eda41e7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:44.043120 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f035b-3cb5-4d07-aa53-f00eda41e7d3 admin admin] PATH_INFO: `/v3/projects/c467c80b371b45c99e841839ccc494af` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:44.044844 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f035b-3cb5-4d07-aa53-f00eda41e7d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c467c80b371b45c99e841839ccc494af)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:44.055383 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5e932-1a38-4ea8-8e15-a7d463b2366f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:44.057014 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5e932-1a38-4ea8-8e15-a7d463b2366f service nova] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:44.057618 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5e932-1a38-4ea8-8e15-a7d463b2366f service nova] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:44.058134 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5e932-1a38-4ea8-8e15-a7d463b2366f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:44.060341 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-96a5e932-1a38-4ea8-8e15-a7d463b2366f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:44.072909 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f035b-3cb5-4d07-aa53-f00eda41e7d3 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:44.101327 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5e932-1a38-4ea8-8e15-a7d463b2366f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:44.111201 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5e932-1a38-4ea8-8e15-a7d463b2366f service nova] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:44.151263 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 920/1837] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:28:44.221811 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-a87f035b-3cb5-4d07-aa53-f00eda41e7d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c467c80b371b45c99e841839ccc494af', 'request_id': 'req-a87f035b-3cb5-4d07-aa53-f00eda41e7d3'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:44.231410 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-a87f035b-3cb5-4d07-aa53-f00eda41e7d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c467c80b371b45c99e841839ccc494af', 'request_id': 'req-a87f035b-3cb5-4d07-aa53-f00eda41e7d3'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:44.257291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-a87f035b-3cb5-4d07-aa53-f00eda41e7d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c467c80b371b45c99e841839ccc494af', 'request_id': 'req-a87f035b-3cb5-4d07-aa53-f00eda41e7d3'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:44.291062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-a87f035b-3cb5-4d07-aa53-f00eda41e7d3 admin admin] The token cache is being invalidate because project c467c80b371b45c99e841839ccc494af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:28:44.291532 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-a87f035b-3cb5-4d07-aa53-f00eda41e7d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:44.292389 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-a87f035b-3cb5-4d07-aa53-f00eda41e7d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:44.294531 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 918/1838] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:28:43 2022] DELETE /identity/v3/projects/c467c80b371b45c99e841839ccc494af => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:44.302194 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc849088-2220-4a82-b453-3fa6cbbdf0a7 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:44.302442 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc849088-2220-4a82-b453-3fa6cbbdf0a7 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:44.302675 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc849088-2220-4a82-b453-3fa6cbbdf0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:44.309051 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f035b-3cb5-4d07-aa53-f00eda41e7d3 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:44.321041 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-a87f035b-3cb5-4d07-aa53-f00eda41e7d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:44.336492 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-cc849088-2220-4a82-b453-3fa6cbbdf0a7 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:44.338328 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-cc849088-2220-4a82-b453-3fa6cbbdf0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:44.471691 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f035b-3cb5-4d07-aa53-f00eda41e7d3 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:44.480531 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc086cf-e532-4c74-a42b-f4eb6c2716ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:44.481200 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc086cf-e532-4c74-a42b-f4eb6c2716ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:44.481512 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc086cf-e532-4c74-a42b-f4eb6c2716ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:44.482040 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc086cf-e532-4c74-a42b-f4eb6c2716ea admin admin] PATH_INFO: `/v3/projects/1655f07b44814a77ab99095d9745a27f` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:44.485483 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc086cf-e532-4c74-a42b-f4eb6c2716ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=1655f07b44814a77ab99095d9745a27f)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:44.489575 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc086cf-e532-4c74-a42b-f4eb6c2716ea admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:44.602600 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 921/1839] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:28:44.606914 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc849088-2220-4a82-b453-3fa6cbbdf0a7 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:44.611846 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-cc849088-2220-4a82-b453-3fa6cbbdf0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:44.691175 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-afc086cf-e532-4c74-a42b-f4eb6c2716ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1655f07b44814a77ab99095d9745a27f', 'request_id': 'req-afc086cf-e532-4c74-a42b-f4eb6c2716ea'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:44.706104 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-afc086cf-e532-4c74-a42b-f4eb6c2716ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1655f07b44814a77ab99095d9745a27f', 'request_id': 'req-afc086cf-e532-4c74-a42b-f4eb6c2716ea'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:44.726229 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-afc086cf-e532-4c74-a42b-f4eb6c2716ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1655f07b44814a77ab99095d9745a27f', 'request_id': 'req-afc086cf-e532-4c74-a42b-f4eb6c2716ea'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:44.757118 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-afc086cf-e532-4c74-a42b-f4eb6c2716ea admin admin] The token cache is being invalidate because project 1655f07b44814a77ab99095d9745a27f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:28:44.757809 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-afc086cf-e532-4c74-a42b-f4eb6c2716ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:44.758990 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-afc086cf-e532-4c74-a42b-f4eb6c2716ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:44.765277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 919/1840] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:28:44 2022] DELETE /identity/v3/projects/1655f07b44814a77ab99095d9745a27f => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:44.765277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1861d-0833-411b-8f2b-d8c9a0853dfd None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:44.765277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1861d-0833-411b-8f2b-d8c9a0853dfd None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:44.765277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1861d-0833-411b-8f2b-d8c9a0853dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:44.772612 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:44.776674 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:44.791143 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc849088-2220-4a82-b453-3fa6cbbdf0a7 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:44.799561 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-bae1861d-0833-411b-8f2b-d8c9a0853dfd None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:44.801191 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-bae1861d-0833-411b-8f2b-d8c9a0853dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:44.930353 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c349d2a-9d4f-4805-9ac7-218ced2c5827 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:44.944677 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c349d2a-9d4f-4805-9ac7-218ced2c5827 service nova] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:44.945201 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c349d2a-9d4f-4805-9ac7-218ced2c5827 service nova] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:44.946531 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c349d2a-9d4f-4805-9ac7-218ced2c5827 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:44.972746 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-2c349d2a-9d4f-4805-9ac7-218ced2c5827 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:45.018236 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c349d2a-9d4f-4805-9ac7-218ced2c5827 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:45.020940 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c349d2a-9d4f-4805-9ac7-218ced2c5827 service nova] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:45.038114 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 922/1841] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:45.039864 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30907f2d-207e-4884-ba80-9a34b60082be None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:45.040255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30907f2d-207e-4884-ba80-9a34b60082be None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:45.040610 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30907f2d-207e-4884-ba80-9a34b60082be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:45.056717 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 920/1842] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:45.057784 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1861d-0833-411b-8f2b-d8c9a0853dfd None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:45.063365 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-bae1861d-0833-411b-8f2b-d8c9a0853dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:45.079962 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-30907f2d-207e-4884-ba80-9a34b60082be None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:45.082900 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-30907f2d-207e-4884-ba80-9a34b60082be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:45.098818 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1861d-0833-411b-8f2b-d8c9a0853dfd None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:45.099660 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 923/1843] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:45.101037 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30907f2d-207e-4884-ba80-9a34b60082be None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:45.115451 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30907f2d-207e-4884-ba80-9a34b60082be None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:45.117515 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b0bec-ae5d-4949-b6c1-b6dc0fe4620a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:45.118370 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b0bec-ae5d-4949-b6c1-b6dc0fe4620a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:45.118984 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b0bec-ae5d-4949-b6c1-b6dc0fe4620a admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:45.118984 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b0bec-ae5d-4949-b6c1-b6dc0fe4620a admin admin] PATH_INFO: `/v3/projects/7596a990f9dd4b74ae5f84d52a5ba7a0` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:45.121795 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b0bec-ae5d-4949-b6c1-b6dc0fe4620a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7596a990f9dd4b74ae5f84d52a5ba7a0)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:45.125096 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b0bec-ae5d-4949-b6c1-b6dc0fe4620a admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:45.136226 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5ec10-036b-4164-91e2-125450236bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:45.137690 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5ec10-036b-4164-91e2-125450236bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:45.138229 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5ec10-036b-4164-91e2-125450236bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:45.139325 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5ec10-036b-4164-91e2-125450236bd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:45.140742 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5ec10-036b-4164-91e2-125450236bd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:28:45.141132 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5ec10-036b-4164-91e2-125450236bd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:45.142872 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5ec10-036b-4164-91e2-125450236bd7 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:45.161861 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 924/1844] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:28:45.164473 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd8f71-327c-4214-a5bf-03bbfb9dc2e9 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:45.164857 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd8f71-327c-4214-a5bf-03bbfb9dc2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:45.165260 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd8f71-327c-4214-a5bf-03bbfb9dc2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:45.194169 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-a3fd8f71-327c-4214-a5bf-03bbfb9dc2e9 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:45.195647 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-a3fd8f71-327c-4214-a5bf-03bbfb9dc2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:45.210523 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 925/1845] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:45.211827 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd8f71-327c-4214-a5bf-03bbfb9dc2e9 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:45.227416 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd8f71-327c-4214-a5bf-03bbfb9dc2e9 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:45.236994 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6e726-d063-45e3-bb32-f129d715dea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:45.237825 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6e726-d063-45e3-bb32-f129d715dea6 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:45.238211 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6e726-d063-45e3-bb32-f129d715dea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:45.238593 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6e726-d063-45e3-bb32-f129d715dea6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:45.239599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6e726-d063-45e3-bb32-f129d715dea6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:45.242225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6e726-d063-45e3-bb32-f129d715dea6 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:45.282118 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-095b0bec-ae5d-4949-b6c1-b6dc0fe4620a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7596a990f9dd4b74ae5f84d52a5ba7a0', 'request_id': 'req-095b0bec-ae5d-4949-b6c1-b6dc0fe4620a'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:45.298452 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-095b0bec-ae5d-4949-b6c1-b6dc0fe4620a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7596a990f9dd4b74ae5f84d52a5ba7a0', 'request_id': 'req-095b0bec-ae5d-4949-b6c1-b6dc0fe4620a'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:45.314951 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-095b0bec-ae5d-4949-b6c1-b6dc0fe4620a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7596a990f9dd4b74ae5f84d52a5ba7a0', 'request_id': 'req-095b0bec-ae5d-4949-b6c1-b6dc0fe4620a'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:45.317742 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 926/1846] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:28:45 2022] POST /identity/v3/projects => generated 409 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:28:45.318997 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6e726-d063-45e3-bb32-f129d715dea6 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:45.352961 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-095b0bec-ae5d-4949-b6c1-b6dc0fe4620a admin admin] The token cache is being invalidate because project 7596a990f9dd4b74ae5f84d52a5ba7a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:28:45.353271 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-095b0bec-ae5d-4949-b6c1-b6dc0fe4620a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:45.354105 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-095b0bec-ae5d-4949-b6c1-b6dc0fe4620a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:45.356154 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 921/1847] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:28:45 2022] DELETE /identity/v3/projects/7596a990f9dd4b74ae5f84d52a5ba7a0 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:45.357131 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b0bec-ae5d-4949-b6c1-b6dc0fe4620a admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:45.363429 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-095b0bec-ae5d-4949-b6c1-b6dc0fe4620a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:45.468444 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6e726-d063-45e3-bb32-f129d715dea6 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:45.474931 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd128a2-674b-4720-aeca-7ae068f211b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:45.475765 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd128a2-674b-4720-aeca-7ae068f211b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:45.476323 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd128a2-674b-4720-aeca-7ae068f211b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:45.477017 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd128a2-674b-4720-aeca-7ae068f211b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:45.478051 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd128a2-674b-4720-aeca-7ae068f211b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:28:45.478403 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd128a2-674b-4720-aeca-7ae068f211b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:45.481572 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd128a2-674b-4720-aeca-7ae068f211b7 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:45.504279 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 927/1848] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:28:45.505615 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd128a2-674b-4720-aeca-7ae068f211b7 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:45.507666 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-fcd128a2-674b-4720-aeca-7ae068f211b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:45.524757 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd128a2-674b-4720-aeca-7ae068f211b7 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:45.533512 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8b729-769f-4d93-8f83-cea88179dc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:45.534372 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8b729-769f-4d93-8f83-cea88179dc14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:45.534713 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8b729-769f-4d93-8f83-cea88179dc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:45.535052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8b729-769f-4d93-8f83-cea88179dc14 admin admin] PATH_INFO: `/v3/users/2716972d727c43839c4c1b2470532a89` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:45.536696 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b8b729-769f-4d93-8f83-cea88179dc14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2716972d727c43839c4c1b2470532a89)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:45.542268 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b8b729-769f-4d93-8f83-cea88179dc14 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:45.575032 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b0bec-ae5d-4949-b6c1-b6dc0fe4620a admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:45.588236 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b724bc-3548-42ba-8ca3-b1dbf91f3ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:45.589667 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b724bc-3548-42ba-8ca3-b1dbf91f3ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:45.590825 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b724bc-3548-42ba-8ca3-b1dbf91f3ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:45.592729 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b724bc-3548-42ba-8ca3-b1dbf91f3ae7 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:45.594597 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b724bc-3548-42ba-8ca3-b1dbf91f3ae7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:45.599277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b724bc-3548-42ba-8ca3-b1dbf91f3ae7 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:45.619496 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:45.662731 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 922/1849] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:28:45 2022] POST /identity/v3/users => generated 305 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:28:45.662731 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b724bc-3548-42ba-8ca3-b1dbf91f3ae7 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:45.662731 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-99b724bc-3548-42ba-8ca3-b1dbf91f3ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:45.663095 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-64b8b729-769f-4d93-8f83-cea88179dc14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2716972d727c43839c4c1b2470532a89'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:45.663550 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-64b8b729-769f-4d93-8f83-cea88179dc14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2716972d727c43839c4c1b2470532a89'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:45.691516 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-64b8b729-769f-4d93-8f83-cea88179dc14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2716972d727c43839c4c1b2470532a89'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:45.703814 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b724bc-3548-42ba-8ca3-b1dbf91f3ae7 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:45.709635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-64b8b729-769f-4d93-8f83-cea88179dc14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2716972d727c43839c4c1b2470532a89'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:45.711238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-64b8b729-769f-4d93-8f83-cea88179dc14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2716972d727c43839c4c1b2470532a89'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:45.722220 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e025c0-8dba-4eb1-a766-cf13bb03fe22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:45.723647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e025c0-8dba-4eb1-a766-cf13bb03fe22 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:45.724003 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e025c0-8dba-4eb1-a766-cf13bb03fe22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:45.724362 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e025c0-8dba-4eb1-a766-cf13bb03fe22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:45.725179 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e025c0-8dba-4eb1-a766-cf13bb03fe22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:45.727637 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e025c0-8dba-4eb1-a766-cf13bb03fe22 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:45.756637 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 928/1850] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:28:45 2022] DELETE /identity/v3/users/2716972d727c43839c4c1b2470532a89 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:45.757464 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8b729-769f-4d93-8f83-cea88179dc14 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:45.778392 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-64b8b729-769f-4d93-8f83-cea88179dc14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:45.785886 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:45.820904 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 923/1851] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:28:45 2022] POST /identity/v3/projects => generated 399 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:28:45.825601 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e025c0-8dba-4eb1-a766-cf13bb03fe22 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:45.834241 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-86e025c0-8dba-4eb1-a766-cf13bb03fe22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:45.981973 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8b729-769f-4d93-8f83-cea88179dc14 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:46.000141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8240f2-395a-4a2f-b2c1-311f2b97634a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:46.001027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8240f2-395a-4a2f-b2c1-311f2b97634a admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:46.001501 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8240f2-395a-4a2f-b2c1-311f2b97634a admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:46.001962 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8240f2-395a-4a2f-b2c1-311f2b97634a admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:46.004543 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8240f2-395a-4a2f-b2c1-311f2b97634a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:46.006737 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8240f2-395a-4a2f-b2c1-311f2b97634a admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:46.016357 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e025c0-8dba-4eb1-a766-cf13bb03fe22 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:46.033145 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cb163-a90c-4a16-9bb8-9f0e456c2434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:46.033798 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cb163-a90c-4a16-9bb8-9f0e456c2434 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:46.034181 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cb163-a90c-4a16-9bb8-9f0e456c2434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:46.034576 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cb163-a90c-4a16-9bb8-9f0e456c2434 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:46.035435 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7cb163-a90c-4a16-9bb8-9f0e456c2434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:46.038295 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7cb163-a90c-4a16-9bb8-9f0e456c2434 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:46.043910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 929/1852] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:28:46.045816 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8240f2-395a-4a2f-b2c1-311f2b97634a admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:46.070990 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8240f2-395a-4a2f-b2c1-311f2b97634a admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:46.086846 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571bfde-dbe1-4d91-a37a-ec63078e778b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:46.087658 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571bfde-dbe1-4d91-a37a-ec63078e778b admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:46.088037 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571bfde-dbe1-4d91-a37a-ec63078e778b admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:46.088426 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 924/1853] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:28:45 2022] POST /identity/v3/users => generated 300 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:28:46.088939 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571bfde-dbe1-4d91-a37a-ec63078e778b admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:46.089825 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571bfde-dbe1-4d91-a37a-ec63078e778b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:46.092463 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571bfde-dbe1-4d91-a37a-ec63078e778b admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:46.104027 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cb163-a90c-4a16-9bb8-9f0e456c2434 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:46.105208 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 930/1854] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:28:46.123643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571bfde-dbe1-4d91-a37a-ec63078e778b admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:46.159548 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cb163-a90c-4a16-9bb8-9f0e456c2434 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:46.171373 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571bfde-dbe1-4d91-a37a-ec63078e778b admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:46.186609 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f575273d-190b-4aef-9e0f-8f8a6bebcb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:46.188066 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575273d-190b-4aef-9e0f-8f8a6bebcb9a admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:46.188389 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575273d-190b-4aef-9e0f-8f8a6bebcb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:46.188667 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575273d-190b-4aef-9e0f-8f8a6bebcb9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:46.192160 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f575273d-190b-4aef-9e0f-8f8a6bebcb9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:46.194242 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f575273d-190b-4aef-9e0f-8f8a6bebcb9a admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:46.211390 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebe303-f865-4911-816a-82b1fc115193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:46.212839 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebe303-f865-4911-816a-82b1fc115193 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:46.213431 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebe303-f865-4911-816a-82b1fc115193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:46.213865 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebe303-f865-4911-816a-82b1fc115193 admin admin] PATH_INFO: `/v3/projects/ca92a6e636c84840b1a701fe6beab00b/users/b39902badc32447bb3be3ed4e40b8c8a/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:46.236547 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 925/1855] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:28:46.241683 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f575273d-190b-4aef-9e0f-8f8a6bebcb9a admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:46.251024 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acebe303-f865-4911-816a-82b1fc115193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca92a6e636c84840b1a701fe6beab00b, user_id=b39902badc32447bb3be3ed4e40b8c8a, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:46.257254 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acebe303-f865-4911-816a-82b1fc115193 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:46.276787 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f575273d-190b-4aef-9e0f-8f8a6bebcb9a admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:46.292286 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 931/1856] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:28:46 2022] PUT /identity/v3/projects/ca92a6e636c84840b1a701fe6beab00b/users/b39902badc32447bb3be3ed4e40b8c8a/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:46.298466 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf589a3-4e4f-4457-8277-5f72ffdbe6d8 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:46.298755 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf589a3-4e4f-4457-8277-5f72ffdbe6d8 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:46.299744 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf589a3-4e4f-4457-8277-5f72ffdbe6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:46.401953 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-6bf589a3-4e4f-4457-8277-5f72ffdbe6d8 None None] MFA Rules not processed for user `b39902badc32447bb3be3ed4e40b8c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:46.406153 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-6bf589a3-4e4f-4457-8277-5f72ffdbe6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:46.492106 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76b036-8610-4250-a891-07af56ccf83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:46.492899 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76b036-8610-4250-a891-07af56ccf83e admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:46.493189 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76b036-8610-4250-a891-07af56ccf83e admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:46.493532 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76b036-8610-4250-a891-07af56ccf83e admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:46.494205 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b76b036-8610-4250-a891-07af56ccf83e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:46.496260 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b76b036-8610-4250-a891-07af56ccf83e admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:46.517484 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 926/1857] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:28:46.518532 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76b036-8610-4250-a891-07af56ccf83e admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:46.549114 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76b036-8610-4250-a891-07af56ccf83e admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:46.559297 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd2ca4-e2fa-4d9e-ab2b-10fac4829f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:46.562941 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:46.563853 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd2ca4-e2fa-4d9e-ab2b-10fac4829f44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:46.567922 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd2ca4-e2fa-4d9e-ab2b-10fac4829f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:46.569496 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd2ca4-e2fa-4d9e-ab2b-10fac4829f44 admin admin] PATH_INFO: `/v3/projects/1a48294963d247d3959ccbd9f6c8a4e7/users/aae083bb7b0e456f9a7bc052ba1b47b1/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:46.585077 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 932/1858] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:46 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:46.591545 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf589a3-4e4f-4457-8277-5f72ffdbe6d8 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:46.627852 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf589a3-4e4f-4457-8277-5f72ffdbe6d8 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:46.638120 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd2ca4-e2fa-4d9e-ab2b-10fac4829f44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a48294963d247d3959ccbd9f6c8a4e7, user_id=aae083bb7b0e456f9a7bc052ba1b47b1, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:46.638785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a984c09-7a23-44e0-a469-ff67aae21891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:46.639691 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a984c09-7a23-44e0-a469-ff67aae21891 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:46.640404 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a984c09-7a23-44e0-a469-ff67aae21891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:46.641159 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a984c09-7a23-44e0-a469-ff67aae21891 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:46.641419 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd2ca4-e2fa-4d9e-ab2b-10fac4829f44 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:46.643459 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a984c09-7a23-44e0-a469-ff67aae21891 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:46.649497 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a984c09-7a23-44e0-a469-ff67aae21891 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:46.662955 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 927/1859] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:28:46 2022] PUT /identity/v3/projects/1a48294963d247d3959ccbd9f6c8a4e7/users/aae083bb7b0e456f9a7bc052ba1b47b1/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:46.677669 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d6e97-281c-4025-be6a-ea34f502b5ef None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:46.678247 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d6e97-281c-4025-be6a-ea34f502b5ef None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:46.678690 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d6e97-281c-4025-be6a-ea34f502b5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:46.714421 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 933/1860] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:28:46 2022] POST /identity/v3/projects => generated 409 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:28:46.727993 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a984c09-7a23-44e0-a469-ff67aae21891 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:46.729549 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-ba5d6e97-281c-4025-be6a-ea34f502b5ef None None] MFA Rules not processed for user `aae083bb7b0e456f9a7bc052ba1b47b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:46.731166 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-ba5d6e97-281c-4025-be6a-ea34f502b5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:46.815430 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:46.859177 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a984c09-7a23-44e0-a469-ff67aae21891 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:46.865113 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 928/1861] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:46 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:46.869144 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e251c-36ec-4014-b130-47c7911e7c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:46.869701 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d6e97-281c-4025-be6a-ea34f502b5ef None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:46.870153 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e251c-36ec-4014-b130-47c7911e7c06 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:46.870511 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e251c-36ec-4014-b130-47c7911e7c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:46.870896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e251c-36ec-4014-b130-47c7911e7c06 admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:46.871720 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e251c-36ec-4014-b130-47c7911e7c06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:46.875728 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e251c-36ec-4014-b130-47c7911e7c06 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:46.887004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d6e97-281c-4025-be6a-ea34f502b5ef None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:46.901206 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2d9f0-fc33-40d8-be57-a09b74ffe6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:46.903124 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2d9f0-fc33-40d8-be57-a09b74ffe6da admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:46.903595 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2d9f0-fc33-40d8-be57-a09b74ffe6da admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:46.904042 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2d9f0-fc33-40d8-be57-a09b74ffe6da admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:46.905033 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2d9f0-fc33-40d8-be57-a09b74ffe6da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:46.906125 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 934/1862] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:28:46 2022] POST /identity/v3/users => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:28:46.907492 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2d9f0-fc33-40d8-be57-a09b74ffe6da admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:46.910052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e251c-36ec-4014-b130-47c7911e7c06 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:46.921699 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e251c-36ec-4014-b130-47c7911e7c06 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:46.929949 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83c525-665c-456d-9e14-d68af72db6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:46.930580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83c525-665c-456d-9e14-d68af72db6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:46.931427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83c525-665c-456d-9e14-d68af72db6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:46.931427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83c525-665c-456d-9e14-d68af72db6a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:46.932139 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83c525-665c-456d-9e14-d68af72db6a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:46.933989 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83c525-665c-456d-9e14-d68af72db6a0 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:46.946606 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 935/1863] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:28:46.950778 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83c525-665c-456d-9e14-d68af72db6a0 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:46.954849 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 929/1864] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:28:46 2022] POST /identity/v3/projects => generated 401 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:28:46.959483 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2d9f0-fc33-40d8-be57-a09b74ffe6da admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:46.973493 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83c525-665c-456d-9e14-d68af72db6a0 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:47.048334 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2d9f0-fc33-40d8-be57-a09b74ffe6da admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:47.057884 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc7b64-fa78-4ddc-9e2c-c3000202c1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:47.058619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc7b64-fa78-4ddc-9e2c-c3000202c1a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:47.058976 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc7b64-fa78-4ddc-9e2c-c3000202c1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:47.059569 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc7b64-fa78-4ddc-9e2c-c3000202c1a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:47.060234 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc7b64-fa78-4ddc-9e2c-c3000202c1a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:47.064182 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc7b64-fa78-4ddc-9e2c-c3000202c1a7 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:47.064883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfed21-0535-4c14-9736-9df538cfbc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:47.065425 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfed21-0535-4c14-9736-9df538cfbc67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:47.065814 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfed21-0535-4c14-9736-9df538cfbc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:47.066135 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfed21-0535-4c14-9736-9df538cfbc67 admin admin] PATH_INFO: `/v3/projects/8591f24d061c45ce8315f3263af8f4ae/users/6df4524bc62d43ec856d4543ccf4ed30/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:47.086470 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bfed21-0535-4c14-9736-9df538cfbc67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8591f24d061c45ce8315f3263af8f4ae, user_id=6df4524bc62d43ec856d4543ccf4ed30, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:47.087760 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 930/1865] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:28:46 2022] POST /identity/v3/users => generated 307 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:28:47.089349 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bfed21-0535-4c14-9736-9df538cfbc67 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:47.091285 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc7b64-fa78-4ddc-9e2c-c3000202c1a7 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:47.093109 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-9efc7b64-fa78-4ddc-9e2c-c3000202c1a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:47.106045 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc7b64-fa78-4ddc-9e2c-c3000202c1a7 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:47.109245 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 936/1866] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:28:46 2022] PUT /identity/v3/projects/8591f24d061c45ce8315f3263af8f4ae/users/6df4524bc62d43ec856d4543ccf4ed30/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:47.110302 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfed21-0535-4c14-9736-9df538cfbc67 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:47.158681 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:47.192234 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8015b-7065-4e4d-9afc-f1e28a429fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:47.192784 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfed21-0535-4c14-9736-9df538cfbc67 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:47.192938 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8015b-7065-4e4d-9afc-f1e28a429fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:47.193276 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8015b-7065-4e4d-9afc-f1e28a429fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:47.193580 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8015b-7065-4e4d-9afc-f1e28a429fc0 admin admin] PATH_INFO: `/v3/projects/c04e39c7c4944c2ab1ee6b7940f3acee` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:47.197304 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8015b-7065-4e4d-9afc-f1e28a429fc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c04e39c7c4944c2ab1ee6b7940f3acee)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:47.198242 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948b6b5-7610-47f8-abbf-72318693aefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:47.198894 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948b6b5-7610-47f8-abbf-72318693aefe admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:47.199179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948b6b5-7610-47f8-abbf-72318693aefe admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:47.199807 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948b6b5-7610-47f8-abbf-72318693aefe admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:47.200519 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948b6b5-7610-47f8-abbf-72318693aefe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:47.203087 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948b6b5-7610-47f8-abbf-72318693aefe admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:47.203486 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8015b-7065-4e4d-9afc-f1e28a429fc0 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:47.228649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 937/1867] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:28:47.229648 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948b6b5-7610-47f8-abbf-72318693aefe admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:47.242309 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948b6b5-7610-47f8-abbf-72318693aefe admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:47.251470 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f7676-77b5-42b6-9bc7-e5e581425177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:47.251470 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f7676-77b5-42b6-9bc7-e5e581425177 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:47.251470 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f7676-77b5-42b6-9bc7-e5e581425177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:47.251470 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f7676-77b5-42b6-9bc7-e5e581425177 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:47.252155 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f7676-77b5-42b6-9bc7-e5e581425177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:47.253304 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f7676-77b5-42b6-9bc7-e5e581425177 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:47.267783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 938/1868] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:28:47.268866 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f7676-77b5-42b6-9bc7-e5e581425177 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:47.289227 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f7676-77b5-42b6-9bc7-e5e581425177 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:47.333290 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:47.358419 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-06f8015b-7065-4e4d-9afc-f1e28a429fc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c04e39c7c4944c2ab1ee6b7940f3acee', 'request_id': 'req-06f8015b-7065-4e4d-9afc-f1e28a429fc0'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:47.375763 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-06f8015b-7065-4e4d-9afc-f1e28a429fc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c04e39c7c4944c2ab1ee6b7940f3acee', 'request_id': 'req-06f8015b-7065-4e4d-9afc-f1e28a429fc0'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:47.388316 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70beb9-5bf8-44f4-8d88-e58ce3e9e954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:47.390358 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70beb9-5bf8-44f4-8d88-e58ce3e9e954 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:47.392248 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-06f8015b-7065-4e4d-9afc-f1e28a429fc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c04e39c7c4944c2ab1ee6b7940f3acee', 'request_id': 'req-06f8015b-7065-4e4d-9afc-f1e28a429fc0'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:47.394098 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70beb9-5bf8-44f4-8d88-e58ce3e9e954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:47.394464 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70beb9-5bf8-44f4-8d88-e58ce3e9e954 admin admin] PATH_INFO: `/v3/projects/0f61b2621778479bbe02f7f151f49e0c/users/7dcfb4348b354fe0801e72d5546c0e7f/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:47.431843 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c70beb9-5bf8-44f4-8d88-e58ce3e9e954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f61b2621778479bbe02f7f151f49e0c, user_id=7dcfb4348b354fe0801e72d5546c0e7f, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:47.436179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c70beb9-5bf8-44f4-8d88-e58ce3e9e954 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:47.439377 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-06f8015b-7065-4e4d-9afc-f1e28a429fc0 admin admin] The token cache is being invalidate because project c04e39c7c4944c2ab1ee6b7940f3acee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:28:47.440220 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-06f8015b-7065-4e4d-9afc-f1e28a429fc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:47.441152 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-06f8015b-7065-4e4d-9afc-f1e28a429fc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:47.446170 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 931/1869] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:28:47 2022] DELETE /identity/v3/projects/c04e39c7c4944c2ab1ee6b7940f3acee => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:47.446170 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8015b-7065-4e4d-9afc-f1e28a429fc0 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:47.448108 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-06f8015b-7065-4e4d-9afc-f1e28a429fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:47.470891 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8015b-7065-4e4d-9afc-f1e28a429fc0 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:47.477889 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 939/1870] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:28:47 2022] PUT /identity/v3/projects/0f61b2621778479bbe02f7f151f49e0c/users/7dcfb4348b354fe0801e72d5546c0e7f/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:47.479440 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded79e02-abd1-4b07-a264-1ed95025c10f None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:47.479760 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded79e02-abd1-4b07-a264-1ed95025c10f None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:47.481946 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded79e02-abd1-4b07-a264-1ed95025c10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:47.537457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-ded79e02-abd1-4b07-a264-1ed95025c10f None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:47.539592 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-ded79e02-abd1-4b07-a264-1ed95025c10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:47.630001 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129036e4-36e8-400f-888b-718f629eb68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:47.630785 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129036e4-36e8-400f-888b-718f629eb68d admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:47.631069 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129036e4-36e8-400f-888b-718f629eb68d admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:47.631343 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129036e4-36e8-400f-888b-718f629eb68d admin admin] PATH_INFO: `/v3/projects/8591f24d061c45ce8315f3263af8f4ae/users/6df4524bc62d43ec856d4543ccf4ed30/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:47.636797 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129036e4-36e8-400f-888b-718f629eb68d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8591f24d061c45ce8315f3263af8f4ae, user_id=6df4524bc62d43ec856d4543ccf4ed30, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:47.649953 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129036e4-36e8-400f-888b-718f629eb68d admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:47.666500 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 940/1871] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:47.674881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded79e02-abd1-4b07-a264-1ed95025c10f None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:47.676730 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-ded79e02-abd1-4b07-a264-1ed95025c10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:47.688318 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 932/1872] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:28:47 2022] PUT /identity/v3/projects/8591f24d061c45ce8315f3263af8f4ae/users/6df4524bc62d43ec856d4543ccf4ed30/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:47.690517 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfce955-5ee3-4239-b856-ab3c1e2b50e6 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:47.691078 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfce955-5ee3-4239-b856-ab3c1e2b50e6 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:47.691564 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfce955-5ee3-4239-b856-ab3c1e2b50e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:47.698265 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded79e02-abd1-4b07-a264-1ed95025c10f None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:47.750621 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-bbfce955-5ee3-4239-b856-ab3c1e2b50e6 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:47.752092 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-bbfce955-5ee3-4239-b856-ab3c1e2b50e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:47.856491 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:47.923240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88818e8b-747e-4e43-9ed1-9c495decfc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:47.924788 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88818e8b-747e-4e43-9ed1-9c495decfc94 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:47.926329 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88818e8b-747e-4e43-9ed1-9c495decfc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:47.927120 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88818e8b-747e-4e43-9ed1-9c495decfc94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:47.928636 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88818e8b-747e-4e43-9ed1-9c495decfc94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:47.933692 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88818e8b-747e-4e43-9ed1-9c495decfc94 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:47.933872 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 933/1873] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:47.935108 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd0e77-148b-489e-94b7-9339b461a06e None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:47.935924 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd0e77-148b-489e-94b7-9339b461a06e None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:47.936317 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd0e77-148b-489e-94b7-9339b461a06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:47.973477 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 941/1874] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:28:47.975527 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88818e8b-747e-4e43-9ed1-9c495decfc94 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:47.986086 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-53bd0e77-148b-489e-94b7-9339b461a06e None None] MFA Rules not processed for user `6df4524bc62d43ec856d4543ccf4ed30`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:47.987667 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-53bd0e77-148b-489e-94b7-9339b461a06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:47.996967 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88818e8b-747e-4e43-9ed1-9c495decfc94 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:48.005688 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3057e-9c35-44bb-b075-a0f2256fac24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:48.006400 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3057e-9c35-44bb-b075-a0f2256fac24 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:48.006685 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3057e-9c35-44bb-b075-a0f2256fac24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:48.006962 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3057e-9c35-44bb-b075-a0f2256fac24 admin admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:48.007637 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee3057e-9c35-44bb-b075-a0f2256fac24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:28:48.008613 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee3057e-9c35-44bb-b075-a0f2256fac24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:48.011339 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee3057e-9c35-44bb-b075-a0f2256fac24 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:48.039062 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 942/1875] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:28:48.040206 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3057e-9c35-44bb-b075-a0f2256fac24 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:48.058495 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3057e-9c35-44bb-b075-a0f2256fac24 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:48.067037 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ce193-7fd0-46c8-a1fd-e5c83da92917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:48.067870 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ce193-7fd0-46c8-a1fd-e5c83da92917 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:48.068205 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ce193-7fd0-46c8-a1fd-e5c83da92917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:48.068582 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ce193-7fd0-46c8-a1fd-e5c83da92917 admin admin] PATH_INFO: `/v3/projects/0f61b2621778479bbe02f7f151f49e0c/users/7dcfb4348b354fe0801e72d5546c0e7f/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:48.072386 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ce193-7fd0-46c8-a1fd-e5c83da92917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f61b2621778479bbe02f7f151f49e0c, user_id=7dcfb4348b354fe0801e72d5546c0e7f, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:48.077804 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ce193-7fd0-46c8-a1fd-e5c83da92917 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:48.095714 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 943/1876] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:28:48 2022] PUT /identity/v3/projects/0f61b2621778479bbe02f7f151f49e0c/users/7dcfb4348b354fe0801e72d5546c0e7f/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:48.096808 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ce193-7fd0-46c8-a1fd-e5c83da92917 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:48.118455 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:48.135066 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 934/1877] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:47 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:48.136514 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9966d-c996-4227-8f44-4f857223043e None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:48.136882 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9966d-c996-4227-8f44-4f857223043e None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:48.137568 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9966d-c996-4227-8f44-4f857223043e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:48.186709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-6ae9966d-c996-4227-8f44-4f857223043e None None] MFA Rules not processed for user `7dcfb4348b354fe0801e72d5546c0e7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:48.189405 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-6ae9966d-c996-4227-8f44-4f857223043e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:48.273642 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ce193-7fd0-46c8-a1fd-e5c83da92917 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:48.287199 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e5284-b660-438d-bfaa-ebe6804fe007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:48.289299 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 935/1878] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:48 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:48.289761 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e5284-b660-438d-bfaa-ebe6804fe007 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:48.290318 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e5284-b660-438d-bfaa-ebe6804fe007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:48.291223 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e5284-b660-438d-bfaa-ebe6804fe007 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:48.293021 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e5284-b660-438d-bfaa-ebe6804fe007 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:48.294065 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9966d-c996-4227-8f44-4f857223043e None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:48.296893 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-6ae9966d-c996-4227-8f44-4f857223043e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:48.300262 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e5284-b660-438d-bfaa-ebe6804fe007 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:48.355723 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 944/1879] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:28:48 2022] POST /identity/v3/projects => generated 393 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:28:48.356468 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e5284-b660-438d-bfaa-ebe6804fe007 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:48.359151 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-e42e5284-b660-438d-bfaa-ebe6804fe007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:48.403081 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9966d-c996-4227-8f44-4f857223043e None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:48.479527 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e5284-b660-438d-bfaa-ebe6804fe007 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:48.482546 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777023ad-ac11-4915-8b5c-641e88536778 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:48.483209 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777023ad-ac11-4915-8b5c-641e88536778 service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:48.483494 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777023ad-ac11-4915-8b5c-641e88536778 service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:48.483761 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777023ad-ac11-4915-8b5c-641e88536778 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:48.490284 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dbff79-ccfa-44c1-bc20-d758f83c0c55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:48.491423 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbff79-ccfa-44c1-bc20-d758f83c0c55 service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:48.491996 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbff79-ccfa-44c1-bc20-d758f83c0c55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:48.492597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbff79-ccfa-44c1-bc20-d758f83c0c55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:48.560990 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:48.594001 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777023ad-ac11-4915-8b5c-641e88536778 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:48.597165 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777023ad-ac11-4915-8b5c-641e88536778 service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:48.617592 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 936/1880] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:48 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:48.619322 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777023ad-ac11-4915-8b5c-641e88536778 service cinder] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:48.622702 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:48.664560 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dbff79-ccfa-44c1-bc20-d758f83c0c55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:48.666486 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dbff79-ccfa-44c1-bc20-d758f83c0c55 service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:48.702167 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 945/1881] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:48 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:48.756543 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777023ad-ac11-4915-8b5c-641e88536778 service cinder] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:48.777457 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556844c-96df-4072-8f92-45fa936edb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:48.780702 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556844c-96df-4072-8f92-45fa936edb65 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:48.785272 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556844c-96df-4072-8f92-45fa936edb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:48.786224 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556844c-96df-4072-8f92-45fa936edb65 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:48.787667 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556844c-96df-4072-8f92-45fa936edb65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:48.799059 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556844c-96df-4072-8f92-45fa936edb65 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:48.855004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 937/1882] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:28:48 2022] POST /identity/v3/users => generated 297 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:28:48.860336 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dbff79-ccfa-44c1-bc20-d758f83c0c55 service cinder] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:48.889529 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dbff79-ccfa-44c1-bc20-d758f83c0c55 service cinder] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:48.910203 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2299cf0-740c-440c-a7cf-195336924847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:48.911285 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2299cf0-740c-440c-a7cf-195336924847 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:48.912919 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2299cf0-740c-440c-a7cf-195336924847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:48.913528 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2299cf0-740c-440c-a7cf-195336924847 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:48.923364 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2299cf0-740c-440c-a7cf-195336924847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:48.941519 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2299cf0-740c-440c-a7cf-195336924847 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:48.957451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556844c-96df-4072-8f92-45fa936edb65 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:48.988760 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 946/1883] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:28:48.990251 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2299cf0-740c-440c-a7cf-195336924847 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:48.991148 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556844c-96df-4072-8f92-45fa936edb65 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:49.006473 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871bac47-03f3-4d69-a5f2-ad42c178d7a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:49.007429 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bac47-03f3-4d69-a5f2-ad42c178d7a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:49.007862 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bac47-03f3-4d69-a5f2-ad42c178d7a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:49.008277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bac47-03f3-4d69-a5f2-ad42c178d7a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:49.011318 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2299cf0-740c-440c-a7cf-195336924847 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:49.012308 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-871bac47-03f3-4d69-a5f2-ad42c178d7a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:49.024408 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f58a25-ccf3-488f-9f11-a811fbd80f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:49.025595 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f58a25-ccf3-488f-9f11-a811fbd80f80 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:49.025595 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f58a25-ccf3-488f-9f11-a811fbd80f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:49.025962 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f58a25-ccf3-488f-9f11-a811fbd80f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:49.026719 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f58a25-ccf3-488f-9f11-a811fbd80f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:49.032062 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f58a25-ccf3-488f-9f11-a811fbd80f80 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:49.084522 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 947/1884] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:28:49.086305 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f58a25-ccf3-488f-9f11-a811fbd80f80 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:49.119329 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f58a25-ccf3-488f-9f11-a811fbd80f80 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:49.139137 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd6f6d-9e42-4183-a828-cb066a46de86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:49.140167 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd6f6d-9e42-4183-a828-cb066a46de86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:49.140597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd6f6d-9e42-4183-a828-cb066a46de86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:49.141047 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd6f6d-9e42-4183-a828-cb066a46de86 admin admin] PATH_INFO: `/v3/projects/0bdf9de6d2694fdfa9d00bf2c99688fb/users/8322a88334d84732827851ee43537745/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:49.162610 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd6f6d-9e42-4183-a828-cb066a46de86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bdf9de6d2694fdfa9d00bf2c99688fb, user_id=8322a88334d84732827851ee43537745, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:49.166504 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd6f6d-9e42-4183-a828-cb066a46de86 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:49.170525 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871bac47-03f3-4d69-a5f2-ad42c178d7a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:49.172758 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871bac47-03f3-4d69-a5f2-ad42c178d7a0 service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:49.192833 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 938/1885] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:48 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:49.193971 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871bac47-03f3-4d69-a5f2-ad42c178d7a0 service cinder] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:49.213443 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871bac47-03f3-4d69-a5f2-ad42c178d7a0 service cinder] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:49.219935 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 948/1886] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:28:49 2022] PUT /identity/v3/projects/0bdf9de6d2694fdfa9d00bf2c99688fb/users/8322a88334d84732827851ee43537745/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:49.222026 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421a659-a95d-4f99-b116-6d0c89ba833e None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:49.222317 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421a659-a95d-4f99-b116-6d0c89ba833e None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:49.222594 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421a659-a95d-4f99-b116-6d0c89ba833e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:49.274344 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-b421a659-a95d-4f99-b116-6d0c89ba833e None None] MFA Rules not processed for user `8322a88334d84732827851ee43537745`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:49.275868 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-b421a659-a95d-4f99-b116-6d0c89ba833e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:49.324851 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c8ca1-f609-4c45-8314-caa358bc37ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:49.325894 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c8ca1-f609-4c45-8314-caa358bc37ec service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:49.328657 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c8ca1-f609-4c45-8314-caa358bc37ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:49.328657 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c8ca1-f609-4c45-8314-caa358bc37ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:49.332908 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-a30c8ca1-f609-4c45-8314-caa358bc37ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:49.387054 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:49.461879 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 949/1887] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:28:49.469010 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421a659-a95d-4f99-b116-6d0c89ba833e None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:49.471425 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c8ca1-f609-4c45-8314-caa358bc37ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:49.473511 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c8ca1-f609-4c45-8314-caa358bc37ec service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:49.490031 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 939/1888] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:49 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:49.658827 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421a659-a95d-4f99-b116-6d0c89ba833e None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:49.672579 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe4edf1-e559-4814-bcda-da69cea8c3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:49.682146 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4edf1-e559-4814-bcda-da69cea8c3e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:49.684031 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4edf1-e559-4814-bcda-da69cea8c3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:49.691582 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4edf1-e559-4814-bcda-da69cea8c3e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:49.692732 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe4edf1-e559-4814-bcda-da69cea8c3e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:49.740675 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe4edf1-e559-4814-bcda-da69cea8c3e3 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:49.820578 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 950/1889] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:28:49 2022] POST /identity/v3/projects => generated 391 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:28:49.825607 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c8ca1-f609-4c45-8314-caa358bc37ec service cinder] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:49.844288 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c8ca1-f609-4c45-8314-caa358bc37ec service cinder] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:50.018293 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd62931-6787-4c72-9664-46b9b97b9818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:50.021191 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd62931-6787-4c72-9664-46b9b97b9818 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:50.022594 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd62931-6787-4c72-9664-46b9b97b9818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:50.023010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd62931-6787-4c72-9664-46b9b97b9818 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:50.025048 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd62931-6787-4c72-9664-46b9b97b9818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:50.035642 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd62931-6787-4c72-9664-46b9b97b9818 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:50.094965 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe4edf1-e559-4814-bcda-da69cea8c3e3 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:50.103192 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 940/1890] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:28:49 2022] POST /identity/v3/users => generated 302 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:28:50.111795 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe4edf1-e559-4814-bcda-da69cea8c3e3 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:50.124081 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d68a9-1859-49e2-8cae-bda3348951b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:50.125026 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d68a9-1859-49e2-8cae-bda3348951b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:50.125546 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d68a9-1859-49e2-8cae-bda3348951b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:50.125810 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d68a9-1859-49e2-8cae-bda3348951b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:50.146798 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d68a9-1859-49e2-8cae-bda3348951b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:50.151506 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d68a9-1859-49e2-8cae-bda3348951b2 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:50.208430 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd62931-6787-4c72-9664-46b9b97b9818 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:50.216778 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 951/1891] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:28:50.224480 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd62931-6787-4c72-9664-46b9b97b9818 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:50.242139 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558577a-92b4-425e-a624-5f7ef29402b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:50.243813 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558577a-92b4-425e-a624-5f7ef29402b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:50.244297 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558577a-92b4-425e-a624-5f7ef29402b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:50.244747 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558577a-92b4-425e-a624-5f7ef29402b7 admin admin] PATH_INFO: `/v3/projects/555fe97f44bf449383483824ab2f90b6/users/49ad951188284f18a9cc34ddbe4e34d4/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:50.302616 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558577a-92b4-425e-a624-5f7ef29402b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=555fe97f44bf449383483824ab2f90b6, user_id=49ad951188284f18a9cc34ddbe4e34d4, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:50.308499 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558577a-92b4-425e-a624-5f7ef29402b7 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:50.334705 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 941/1892] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:28:50 2022] PUT /identity/v3/projects/555fe97f44bf449383483824ab2f90b6/users/49ad951188284f18a9cc34ddbe4e34d4/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:50.336319 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d68a9-1859-49e2-8cae-bda3348951b2 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:50.359866 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d68a9-1859-49e2-8cae-bda3348951b2 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:50.372392 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:50.411594 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558577a-92b4-425e-a624-5f7ef29402b7 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:50.413560 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-3558577a-92b4-425e-a624-5f7ef29402b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:50.553017 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec4ead-c75c-45d7-aeca-5bba97939167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:50.553845 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec4ead-c75c-45d7-aeca-5bba97939167 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:50.554138 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec4ead-c75c-45d7-aeca-5bba97939167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:50.554412 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec4ead-c75c-45d7-aeca-5bba97939167 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:50.556992 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec4ead-c75c-45d7-aeca-5bba97939167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:50.558782 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec4ead-c75c-45d7-aeca-5bba97939167 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:50.583156 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558577a-92b4-425e-a624-5f7ef29402b7 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:50.594865 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 952/1893] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:28:50.596181 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec4ead-c75c-45d7-aeca-5bba97939167 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:50.607044 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3672c-bcfe-4637-a226-8f7df783e4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:50.609788 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3672c-bcfe-4637-a226-8f7df783e4c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:50.610064 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3672c-bcfe-4637-a226-8f7df783e4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:50.610897 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3672c-bcfe-4637-a226-8f7df783e4c8 admin admin] PATH_INFO: `/v3/users/b240e53f64ba4c84a40077bfc4dc9229` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:50.613925 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3672c-bcfe-4637-a226-8f7df783e4c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b240e53f64ba4c84a40077bfc4dc9229)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:50.618594 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec4ead-c75c-45d7-aeca-5bba97939167 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:50.619995 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3672c-bcfe-4637-a226-8f7df783e4c8 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:50.632282 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dba11e-8989-4d73-991e-3fa99f00ac5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:50.632985 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dba11e-8989-4d73-991e-3fa99f00ac5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:50.633266 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dba11e-8989-4d73-991e-3fa99f00ac5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:50.633566 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dba11e-8989-4d73-991e-3fa99f00ac5b admin admin] PATH_INFO: `/v3/projects/555fe97f44bf449383483824ab2f90b6/users/49ad951188284f18a9cc34ddbe4e34d4/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:50.643891 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dba11e-8989-4d73-991e-3fa99f00ac5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=555fe97f44bf449383483824ab2f90b6, user_id=49ad951188284f18a9cc34ddbe4e34d4, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:50.647981 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dba11e-8989-4d73-991e-3fa99f00ac5b admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:50.677394 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 953/1894] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:28:50 2022] PUT /identity/v3/projects/555fe97f44bf449383483824ab2f90b6/users/49ad951188284f18a9cc34ddbe4e34d4/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:50.691334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b7c2e-fccd-484b-8bed-beeaf4aa6510 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:50.691628 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b7c2e-fccd-484b-8bed-beeaf4aa6510 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:50.691955 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b7c2e-fccd-484b-8bed-beeaf4aa6510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:50.716012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:50.752919 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-f4a3672c-bcfe-4637-a226-8f7df783e4c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b240e53f64ba4c84a40077bfc4dc9229'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:50.754031 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-f4a3672c-bcfe-4637-a226-8f7df783e4c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b240e53f64ba4c84a40077bfc4dc9229'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:50.785332 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-f4a3672c-bcfe-4637-a226-8f7df783e4c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b240e53f64ba4c84a40077bfc4dc9229'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:50.797405 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-310b7c2e-fccd-484b-8bed-beeaf4aa6510 None None] MFA Rules not processed for user `49ad951188284f18a9cc34ddbe4e34d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:50.797948 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-f4a3672c-bcfe-4637-a226-8f7df783e4c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b240e53f64ba4c84a40077bfc4dc9229'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:50.799596 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-310b7c2e-fccd-484b-8bed-beeaf4aa6510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:50.816666 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-f4a3672c-bcfe-4637-a226-8f7df783e4c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b240e53f64ba4c84a40077bfc4dc9229'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:50.827206 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 942/1895] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:28:50 2022] DELETE /identity/v3/users/b240e53f64ba4c84a40077bfc4dc9229 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:28:50.833620 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fba6d-5dd8-4973-bc56-4f1e24fa71ea None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:50.834032 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fba6d-5dd8-4973-bc56-4f1e24fa71ea None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:50.834320 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fba6d-5dd8-4973-bc56-4f1e24fa71ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:50.894972 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-b86fba6d-5dd8-4973-bc56-4f1e24fa71ea None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:50.896155 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-b86fba6d-5dd8-4973-bc56-4f1e24fa71ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:51.007320 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 954/1896] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:50 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:51.027067 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 943/1897] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:51.033520 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b7c2e-fccd-484b-8bed-beeaf4aa6510 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:51.033520 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-310b7c2e-fccd-484b-8bed-beeaf4aa6510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:51.051398 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fba6d-5dd8-4973-bc56-4f1e24fa71ea None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:51.053167 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-b86fba6d-5dd8-4973-bc56-4f1e24fa71ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:51.205121 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b7c2e-fccd-484b-8bed-beeaf4aa6510 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:51.217330 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fba6d-5dd8-4973-bc56-4f1e24fa71ea None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:51.231417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ffcf2-8850-4d68-977c-26324127d8e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:51.234994 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ffcf2-8850-4d68-977c-26324127d8e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:51.234994 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ffcf2-8850-4d68-977c-26324127d8e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:51.235406 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ffcf2-8850-4d68-977c-26324127d8e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:51.263594 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ffcf2-8850-4d68-977c-26324127d8e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:51.269753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ffcf2-8850-4d68-977c-26324127d8e5 service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:51.287569 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:51.297133 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 944/1898] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:28:51.299313 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb106e-cac6-4fd9-8ce1-c08be2425182 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:51.299741 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb106e-cac6-4fd9-8ce1-c08be2425182 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:51.300014 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb106e-cac6-4fd9-8ce1-c08be2425182 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:51.308130 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 945/1899] 10.222.0.77 () {54 vars in 921 bytes} [Tue Aug 23 22:28:51 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:28:51.324110 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7c53a-f0d5-4174-b25b-a17e13182160 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:51.324727 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7c53a-f0d5-4174-b25b-a17e13182160 service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:51.325017 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7c53a-f0d5-4174-b25b-a17e13182160 service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:51.325295 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7c53a-f0d5-4174-b25b-a17e13182160 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:51.336129 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb1443-9620-4941-8839-5493836e6aa2 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:51.336432 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb1443-9620-4941-8839-5493836e6aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:51.336781 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb1443-9620-4941-8839-5493836e6aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:51.414601 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-35cb1443-9620-4941-8839-5493836e6aa2 None None] MFA Rules not processed for user `1a0af5bf009b48a8915c7320b16d08dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:51.420697 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-35cb1443-9620-4941-8839-5493836e6aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:51.530288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7c53a-f0d5-4174-b25b-a17e13182160 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:51.533941 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7c53a-f0d5-4174-b25b-a17e13182160 service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:51.567642 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 955/1900] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:51 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:51.609200 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:51.677100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 946/1901] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Aug 23 22:28:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:51.700389 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7c53a-f0d5-4174-b25b-a17e13182160 service cinder] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:51.703489 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-0ba7c53a-f0d5-4174-b25b-a17e13182160 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:51.743897 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7c53a-f0d5-4174-b25b-a17e13182160 service cinder] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:51.760328 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee135636-8b30-4dce-93ea-fe487870e657 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:51.762046 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee135636-8b30-4dce-93ea-fe487870e657 service nova] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:51.762343 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee135636-8b30-4dce-93ea-fe487870e657 service nova] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:51.762642 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee135636-8b30-4dce-93ea-fe487870e657 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:51.791395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee135636-8b30-4dce-93ea-fe487870e657 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:51.796275 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee135636-8b30-4dce-93ea-fe487870e657 service nova] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:51.829102 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 956/1902] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:28:51.930653 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb1443-9620-4941-8839-5493836e6aa2 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:51.940927 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-35cb1443-9620-4941-8839-5493836e6aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:51.969144 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb1443-9620-4941-8839-5493836e6aa2 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:51.990704 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847618d8-b6fc-4cfd-ad23-689714a84bb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:51.994252 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847618d8-b6fc-4cfd-ad23-689714a84bb3 service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:51.995159 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847618d8-b6fc-4cfd-ad23-689714a84bb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:52.001749 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847618d8-b6fc-4cfd-ad23-689714a84bb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:52.010037 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-847618d8-b6fc-4cfd-ad23-689714a84bb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:52.198792 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847618d8-b6fc-4cfd-ad23-689714a84bb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:52.200484 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847618d8-b6fc-4cfd-ad23-689714a84bb3 service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:52.234932 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 947/1903] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:51 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:28:53.229886 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee135636-8b30-4dce-93ea-fe487870e657 service nova] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:53.231782 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-ee135636-8b30-4dce-93ea-fe487870e657 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:53.249121 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee135636-8b30-4dce-93ea-fe487870e657 service nova] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:53.255849 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6897ab0-d64c-4ddb-be57-1e30c4603bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:53.256115 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6897ab0-d64c-4ddb-be57-1e30c4603bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:53.256397 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6897ab0-d64c-4ddb-be57-1e30c4603bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:53.256663 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6897ab0-d64c-4ddb-be57-1e30c4603bd1 admin admin] PATH_INFO: `/v3/projects/0585a5ba629e45f3928c5ea88ee605d2` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:53.258168 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6897ab0-d64c-4ddb-be57-1e30c4603bd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0585a5ba629e45f3928c5ea88ee605d2)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:53.260261 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6897ab0-d64c-4ddb-be57-1e30c4603bd1 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:53.373565 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-c6897ab0-d64c-4ddb-be57-1e30c4603bd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0585a5ba629e45f3928c5ea88ee605d2', 'request_id': 'req-c6897ab0-d64c-4ddb-be57-1e30c4603bd1'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:53.392964 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-c6897ab0-d64c-4ddb-be57-1e30c4603bd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0585a5ba629e45f3928c5ea88ee605d2', 'request_id': 'req-c6897ab0-d64c-4ddb-be57-1e30c4603bd1'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:53.413985 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-c6897ab0-d64c-4ddb-be57-1e30c4603bd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0585a5ba629e45f3928c5ea88ee605d2', 'request_id': 'req-c6897ab0-d64c-4ddb-be57-1e30c4603bd1'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:53.452201 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-c6897ab0-d64c-4ddb-be57-1e30c4603bd1 admin admin] The token cache is being invalidate because project 0585a5ba629e45f3928c5ea88ee605d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:28:53.453960 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-c6897ab0-d64c-4ddb-be57-1e30c4603bd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:53.456173 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-c6897ab0-d64c-4ddb-be57-1e30c4603bd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:53.463303 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 957/1904] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:28:53 2022] DELETE /identity/v3/projects/0585a5ba629e45f3928c5ea88ee605d2 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:53.469207 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847618d8-b6fc-4cfd-ad23-689714a84bb3 service cinder] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:53.484349 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847618d8-b6fc-4cfd-ad23-689714a84bb3 service cinder] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:53.598071 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5429307-8030-4b68-994d-062ea99ce38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:53.598799 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5429307-8030-4b68-994d-062ea99ce38a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:53.600858 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5429307-8030-4b68-994d-062ea99ce38a admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:53.602686 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5429307-8030-4b68-994d-062ea99ce38a admin admin] PATH_INFO: `/v3/users/05797ac1a16b472ea0224af53a286068` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:53.604867 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5429307-8030-4b68-994d-062ea99ce38a admin admin] RBAC: Authorizing `identity:delete_user(user_id=05797ac1a16b472ea0224af53a286068)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:53.607723 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5429307-8030-4b68-994d-062ea99ce38a admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:53.685067 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-d5429307-8030-4b68-994d-062ea99ce38a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05797ac1a16b472ea0224af53a286068'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:53.687429 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-d5429307-8030-4b68-994d-062ea99ce38a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05797ac1a16b472ea0224af53a286068'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:53.706466 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-d5429307-8030-4b68-994d-062ea99ce38a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05797ac1a16b472ea0224af53a286068'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:53.725858 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-d5429307-8030-4b68-994d-062ea99ce38a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05797ac1a16b472ea0224af53a286068'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:53.778403 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-d5429307-8030-4b68-994d-062ea99ce38a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05797ac1a16b472ea0224af53a286068'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:53.807019 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 948/1905] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:28:53 2022] DELETE /identity/v3/users/05797ac1a16b472ea0224af53a286068 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:28:54.071922 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6897ab0-d64c-4ddb-be57-1e30c4603bd1 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:54.073789 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-c6897ab0-d64c-4ddb-be57-1e30c4603bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:54.110580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6897ab0-d64c-4ddb-be57-1e30c4603bd1 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:54.220155 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:54.266790 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4629970-e467-45c4-b54a-9f29decf5cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:54.268684 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4629970-e467-45c4-b54a-9f29decf5cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:54.269233 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4629970-e467-45c4-b54a-9f29decf5cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:54.270157 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4629970-e467-45c4-b54a-9f29decf5cfc admin admin] PATH_INFO: `/v3/users/aae083bb7b0e456f9a7bc052ba1b47b1` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:54.282594 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4629970-e467-45c4-b54a-9f29decf5cfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=aae083bb7b0e456f9a7bc052ba1b47b1)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:54.286452 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4629970-e467-45c4-b54a-9f29decf5cfc admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:54.396933 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-a4629970-e467-45c4-b54a-9f29decf5cfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aae083bb7b0e456f9a7bc052ba1b47b1'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:54.399533 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-a4629970-e467-45c4-b54a-9f29decf5cfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aae083bb7b0e456f9a7bc052ba1b47b1'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:54.446754 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-a4629970-e467-45c4-b54a-9f29decf5cfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aae083bb7b0e456f9a7bc052ba1b47b1'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:54.459099 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-a4629970-e467-45c4-b54a-9f29decf5cfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aae083bb7b0e456f9a7bc052ba1b47b1'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:54.459862 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-a4629970-e467-45c4-b54a-9f29decf5cfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aae083bb7b0e456f9a7bc052ba1b47b1'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:54.507745 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 958/1906] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:28:54 2022] DELETE /identity/v3/users/aae083bb7b0e456f9a7bc052ba1b47b1 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:54.516361 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba60a1-ac41-4fe1-8da3-d505437ce6d4 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:54.517235 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba60a1-ac41-4fe1-8da3-d505437ce6d4 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:54.517235 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba60a1-ac41-4fe1-8da3-d505437ce6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:54.528566 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4629970-e467-45c4-b54a-9f29decf5cfc admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:54.531273 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-a4629970-e467-45c4-b54a-9f29decf5cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:54.536042 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:54.577855 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-85ba60a1-ac41-4fe1-8da3-d505437ce6d4 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:54.581566 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-85ba60a1-ac41-4fe1-8da3-d505437ce6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:54.633396 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4629970-e467-45c4-b54a-9f29decf5cfc admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:54.639686 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eed936-5c78-4dda-870e-4134a4c88132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:54.640644 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eed936-5c78-4dda-870e-4134a4c88132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:54.641099 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eed936-5c78-4dda-870e-4134a4c88132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:54.641505 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eed936-5c78-4dda-870e-4134a4c88132 admin admin] PATH_INFO: `/v3/projects/5367bd5a55d74a74bdf2073377133aa5` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:54.643129 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eed936-5c78-4dda-870e-4134a4c88132 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5367bd5a55d74a74bdf2073377133aa5)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:54.645761 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eed936-5c78-4dda-870e-4134a4c88132 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:54.728273 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 949/1907] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:54.750373 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-b8eed936-5c78-4dda-870e-4134a4c88132 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5367bd5a55d74a74bdf2073377133aa5', 'request_id': 'req-b8eed936-5c78-4dda-870e-4134a4c88132'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:54.761071 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-b8eed936-5c78-4dda-870e-4134a4c88132 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5367bd5a55d74a74bdf2073377133aa5', 'request_id': 'req-b8eed936-5c78-4dda-870e-4134a4c88132'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:54.767874 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba60a1-ac41-4fe1-8da3-d505437ce6d4 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:54.769649 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-85ba60a1-ac41-4fe1-8da3-d505437ce6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:54.776959 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-b8eed936-5c78-4dda-870e-4134a4c88132 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5367bd5a55d74a74bdf2073377133aa5', 'request_id': 'req-b8eed936-5c78-4dda-870e-4134a4c88132'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:54.796720 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:54.809623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-b8eed936-5c78-4dda-870e-4134a4c88132 admin admin] The token cache is being invalidate because project 5367bd5a55d74a74bdf2073377133aa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:28:54.811105 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-b8eed936-5c78-4dda-870e-4134a4c88132 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:54.813392 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-b8eed936-5c78-4dda-870e-4134a4c88132 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:54.823574 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 959/1908] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:28:54 2022] DELETE /identity/v3/projects/5367bd5a55d74a74bdf2073377133aa5 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:28:54.828352 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3139190-3689-4303-a7d1-816897726ab9 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:54.828853 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3139190-3689-4303-a7d1-816897726ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:54.829341 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3139190-3689-4303-a7d1-816897726ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:54.870612 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-e3139190-3689-4303-a7d1-816897726ab9 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:54.872629 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-e3139190-3689-4303-a7d1-816897726ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:54.875317 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba60a1-ac41-4fe1-8da3-d505437ce6d4 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:54.969773 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 960/1909] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:54.970723 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ba822-5147-4e8d-afa3-0db76157efac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:54.971517 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ba822-5147-4e8d-afa3-0db76157efac service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:54.971800 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ba822-5147-4e8d-afa3-0db76157efac service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:54.972100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ba822-5147-4e8d-afa3-0db76157efac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:54.978697 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99ed46-f364-4c3f-9120-f805fdd5286d None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:54.979157 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99ed46-f364-4c3f-9120-f805fdd5286d None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:54.979352 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99ed46-f364-4c3f-9120-f805fdd5286d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:54.980052 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-771ba822-5147-4e8d-afa3-0db76157efac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:55.002737 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ba822-5147-4e8d-afa3-0db76157efac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:55.004310 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ba822-5147-4e8d-afa3-0db76157efac service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:55.008865 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-7d99ed46-f364-4c3f-9120-f805fdd5286d None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:55.011164 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-7d99ed46-f364-4c3f-9120-f805fdd5286d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:55.027261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 950/1910] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:55.028011 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 961/1911] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:28:55.033500 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ba822-5147-4e8d-afa3-0db76157efac service neutron] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:55.046653 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ba822-5147-4e8d-afa3-0db76157efac service neutron] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:55.054196 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c71e5c-1989-4060-824c-b80cead5787b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:55.054992 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c71e5c-1989-4060-824c-b80cead5787b admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:55.055338 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c71e5c-1989-4060-824c-b80cead5787b admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:55.055711 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c71e5c-1989-4060-824c-b80cead5787b admin admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:55.056474 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c71e5c-1989-4060-824c-b80cead5787b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:28:55.056803 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c71e5c-1989-4060-824c-b80cead5787b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:55.058891 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c71e5c-1989-4060-824c-b80cead5787b admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:55.085994 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 951/1912] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:28:55.088896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99ed46-f364-4c3f-9120-f805fdd5286d None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:55.106382 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99ed46-f364-4c3f-9120-f805fdd5286d None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:55.112575 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7923df5-8960-4227-bf18-d8b0c20f4e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:55.113205 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7923df5-8960-4227-bf18-d8b0c20f4e19 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:55.113533 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7923df5-8960-4227-bf18-d8b0c20f4e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:55.113937 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7923df5-8960-4227-bf18-d8b0c20f4e19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:55.114471 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7923df5-8960-4227-bf18-d8b0c20f4e19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:55.116678 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7923df5-8960-4227-bf18-d8b0c20f4e19 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:55.191535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 962/1913] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:28:55 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:28:55.196625 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c71e5c-1989-4060-824c-b80cead5787b admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:55.226697 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c71e5c-1989-4060-824c-b80cead5787b admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:55.297616 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:55.307014 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b81295-80f8-4153-a0b5-81841e5c7292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:55.307471 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b81295-80f8-4153-a0b5-81841e5c7292 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:55.307749 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b81295-80f8-4153-a0b5-81841e5c7292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:55.308020 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b81295-80f8-4153-a0b5-81841e5c7292 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:55.308671 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b81295-80f8-4153-a0b5-81841e5c7292 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:55.310841 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b81295-80f8-4153-a0b5-81841e5c7292 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:55.340606 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 952/1914] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:28:55 2022] POST /identity/v3/users => generated 291 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:28:55.346534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7923df5-8960-4227-bf18-d8b0c20f4e19 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:55.362149 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7923df5-8960-4227-bf18-d8b0c20f4e19 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:55.372202 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fc6a4-9ced-41be-b467-bb361a1a0029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:55.373490 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fc6a4-9ced-41be-b467-bb361a1a0029 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:55.373867 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fc6a4-9ced-41be-b467-bb361a1a0029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:55.374209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fc6a4-9ced-41be-b467-bb361a1a0029 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:55.374880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649fc6a4-9ced-41be-b467-bb361a1a0029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:55.377768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649fc6a4-9ced-41be-b467-bb361a1a0029 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:55.410592 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 963/1915] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:28:55.412058 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b81295-80f8-4153-a0b5-81841e5c7292 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:55.437706 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b81295-80f8-4153-a0b5-81841e5c7292 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:55.452044 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b1f45-3e54-4092-bcf1-20d44751589f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:55.452767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b1f45-3e54-4092-bcf1-20d44751589f admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:55.453168 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b1f45-3e54-4092-bcf1-20d44751589f admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:55.453516 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b1f45-3e54-4092-bcf1-20d44751589f admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:55.454639 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b1f45-3e54-4092-bcf1-20d44751589f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:55.456550 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b1f45-3e54-4092-bcf1-20d44751589f admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:55.496937 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 953/1916] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:28:55.499721 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fc6a4-9ced-41be-b467-bb361a1a0029 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:55.511648 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fc6a4-9ced-41be-b467-bb361a1a0029 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:55.519274 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c1edb-e510-4bec-8581-c8543d1b8454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:55.519993 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c1edb-e510-4bec-8581-c8543d1b8454 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:55.520311 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c1edb-e510-4bec-8581-c8543d1b8454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:55.520734 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c1edb-e510-4bec-8581-c8543d1b8454 admin admin] PATH_INFO: `/v3/projects/bc5e8eff96524fcba91bf0f929040096/users/ab41e0b1350e45b3b68d9471ccd253f0/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:55.558352 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c1edb-e510-4bec-8581-c8543d1b8454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc5e8eff96524fcba91bf0f929040096, user_id=ab41e0b1350e45b3b68d9471ccd253f0, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:55.563816 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c1edb-e510-4bec-8581-c8543d1b8454 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:55.596315 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 964/1917] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:28:55 2022] PUT /identity/v3/projects/bc5e8eff96524fcba91bf0f929040096/users/ab41e0b1350e45b3b68d9471ccd253f0/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:55.612179 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39126064-db0d-40f3-bbea-a2e0ac4a94fb None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:55.613506 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39126064-db0d-40f3-bbea-a2e0ac4a94fb None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:55.614129 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39126064-db0d-40f3-bbea-a2e0ac4a94fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:55.663530 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-39126064-db0d-40f3-bbea-a2e0ac4a94fb None None] MFA Rules not processed for user `ab41e0b1350e45b3b68d9471ccd253f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:55.665424 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-39126064-db0d-40f3-bbea-a2e0ac4a94fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:55.758220 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c1edb-e510-4bec-8581-c8543d1b8454 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:55.761350 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-687c1edb-e510-4bec-8581-c8543d1b8454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:55.867682 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 954/1918] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:55.871389 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39126064-db0d-40f3-bbea-a2e0ac4a94fb None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:56.028454 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c1edb-e510-4bec-8581-c8543d1b8454 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:56.044434 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ed4ea-c9dd-419a-9a77-42f97a6c5b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:56.045326 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ed4ea-c9dd-419a-9a77-42f97a6c5b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:56.047270 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ed4ea-c9dd-419a-9a77-42f97a6c5b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:56.048077 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ed4ea-c9dd-419a-9a77-42f97a6c5b18 admin admin] PATH_INFO: `/v3/projects/1a48294963d247d3959ccbd9f6c8a4e7` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:56.049992 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ed4ea-c9dd-419a-9a77-42f97a6c5b18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a48294963d247d3959ccbd9f6c8a4e7)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:56.055505 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ed4ea-c9dd-419a-9a77-42f97a6c5b18 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:56.111198 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39126064-db0d-40f3-bbea-a2e0ac4a94fb None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:56.122249 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6ddbe-057a-497a-81eb-399450a18dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:56.124796 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6ddbe-057a-497a-81eb-399450a18dde admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:56.125167 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6ddbe-057a-497a-81eb-399450a18dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:56.127307 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6ddbe-057a-497a-81eb-399450a18dde admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:56.128451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6ddbe-057a-497a-81eb-399450a18dde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:56.133944 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6ddbe-057a-497a-81eb-399450a18dde admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:56.162942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:56.196056 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-d65ed4ea-c9dd-419a-9a77-42f97a6c5b18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a48294963d247d3959ccbd9f6c8a4e7', 'request_id': 'req-d65ed4ea-c9dd-419a-9a77-42f97a6c5b18'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:56.209961 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-d65ed4ea-c9dd-419a-9a77-42f97a6c5b18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a48294963d247d3959ccbd9f6c8a4e7', 'request_id': 'req-d65ed4ea-c9dd-419a-9a77-42f97a6c5b18'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:56.213779 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 955/1919] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:28:55 2022] POST /identity/v3/projects => generated 381 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:28:56.218553 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6ddbe-057a-497a-81eb-399450a18dde admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:56.223738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-d65ed4ea-c9dd-419a-9a77-42f97a6c5b18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a48294963d247d3959ccbd9f6c8a4e7', 'request_id': 'req-d65ed4ea-c9dd-419a-9a77-42f97a6c5b18'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:56.249261 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-d65ed4ea-c9dd-419a-9a77-42f97a6c5b18 admin admin] The token cache is being invalidate because project 1a48294963d247d3959ccbd9f6c8a4e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:28:56.249590 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-d65ed4ea-c9dd-419a-9a77-42f97a6c5b18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:56.251450 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-d65ed4ea-c9dd-419a-9a77-42f97a6c5b18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:56.256723 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 965/1920] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:28:55 2022] DELETE /identity/v3/projects/1a48294963d247d3959ccbd9f6c8a4e7 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:28:56.261420 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ed4ea-c9dd-419a-9a77-42f97a6c5b18 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:56.266840 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-d65ed4ea-c9dd-419a-9a77-42f97a6c5b18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:56.336900 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:56.383826 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6ddbe-057a-497a-81eb-399450a18dde admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:56.391001 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b896cc3-12d0-47d3-abc4-8e94ffea387e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:56.391898 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b896cc3-12d0-47d3-abc4-8e94ffea387e admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:56.392186 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b896cc3-12d0-47d3-abc4-8e94ffea387e admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:56.392488 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b896cc3-12d0-47d3-abc4-8e94ffea387e admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:56.393739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b896cc3-12d0-47d3-abc4-8e94ffea387e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:56.395282 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b896cc3-12d0-47d3-abc4-8e94ffea387e admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:56.432271 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 956/1921] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:28:56 2022] POST /identity/v3/users => generated 297 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:28:56.443092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ed4ea-c9dd-419a-9a77-42f97a6c5b18 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:56.448018 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b896cc3-12d0-47d3-abc4-8e94ffea387e admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:56.451668 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-1b896cc3-12d0-47d3-abc4-8e94ffea387e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:56.452989 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea58832-d327-43bb-a50f-e72ff5ec1162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:56.453881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea58832-d327-43bb-a50f-e72ff5ec1162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:56.454329 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea58832-d327-43bb-a50f-e72ff5ec1162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:56.454779 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea58832-d327-43bb-a50f-e72ff5ec1162 admin admin] PATH_INFO: `/v3/users/7dcfb4348b354fe0801e72d5546c0e7f` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:56.456102 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea58832-d327-43bb-a50f-e72ff5ec1162 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dcfb4348b354fe0801e72d5546c0e7f)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:56.458407 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea58832-d327-43bb-a50f-e72ff5ec1162 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:56.467953 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b896cc3-12d0-47d3-abc4-8e94ffea387e admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:56.473334 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b0a7a-442a-4af4-9920-78fcdd748ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:56.474153 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b0a7a-442a-4af4-9920-78fcdd748ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:56.474864 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b0a7a-442a-4af4-9920-78fcdd748ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:56.475313 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b0a7a-442a-4af4-9920-78fcdd748ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:56.476005 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b0a7a-442a-4af4-9920-78fcdd748ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:56.478338 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b0a7a-442a-4af4-9920-78fcdd748ae8 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:56.492362 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 957/1922] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:28:56.496380 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b0a7a-442a-4af4-9920-78fcdd748ae8 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:56.510772 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b0a7a-442a-4af4-9920-78fcdd748ae8 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:56.531568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-aea58832-d327-43bb-a50f-e72ff5ec1162 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dcfb4348b354fe0801e72d5546c0e7f'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:56.532493 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-aea58832-d327-43bb-a50f-e72ff5ec1162 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dcfb4348b354fe0801e72d5546c0e7f'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:56.534380 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fccdcd6-dbd8-427f-9a37-762774697492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:56.537234 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccdcd6-dbd8-427f-9a37-762774697492 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:56.539448 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccdcd6-dbd8-427f-9a37-762774697492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:56.539963 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccdcd6-dbd8-427f-9a37-762774697492 admin admin] PATH_INFO: `/v3/projects/f3bb4940f15d43df80488270562f1559/users/6586028d969a4e068d57801489c8715f/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:56.541038 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-aea58832-d327-43bb-a50f-e72ff5ec1162 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dcfb4348b354fe0801e72d5546c0e7f'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:56.554961 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-aea58832-d327-43bb-a50f-e72ff5ec1162 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dcfb4348b354fe0801e72d5546c0e7f'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:56.555726 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-aea58832-d327-43bb-a50f-e72ff5ec1162 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dcfb4348b354fe0801e72d5546c0e7f'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:56.582333 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fccdcd6-dbd8-427f-9a37-762774697492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3bb4940f15d43df80488270562f1559, user_id=6586028d969a4e068d57801489c8715f, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:56.594292 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fccdcd6-dbd8-427f-9a37-762774697492 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:56.608763 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 966/1923] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:28:56 2022] DELETE /identity/v3/users/7dcfb4348b354fe0801e72d5546c0e7f => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:28:56.620977 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea58832-d327-43bb-a50f-e72ff5ec1162 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:56.622057 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 958/1924] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:28:56 2022] PUT /identity/v3/projects/f3bb4940f15d43df80488270562f1559/users/6586028d969a4e068d57801489c8715f/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:28:56.624777 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-aea58832-d327-43bb-a50f-e72ff5ec1162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:56.762546 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fccdcd6-dbd8-427f-9a37-762774697492 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:56.765637 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-6fccdcd6-dbd8-427f-9a37-762774697492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:56.784480 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:56.825267 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea58832-d327-43bb-a50f-e72ff5ec1162 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:56.906621 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fccdcd6-dbd8-427f-9a37-762774697492 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:56.913277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a3b0d-eeab-4c61-8ad3-e0ec45a6d32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:56.914496 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a3b0d-eeab-4c61-8ad3-e0ec45a6d32d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:56.915059 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a3b0d-eeab-4c61-8ad3-e0ec45a6d32d admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:56.915582 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a3b0d-eeab-4c61-8ad3-e0ec45a6d32d admin admin] PATH_INFO: `/v3/users/b39902badc32447bb3be3ed4e40b8c8a` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:56.917102 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a3b0d-eeab-4c61-8ad3-e0ec45a6d32d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b39902badc32447bb3be3ed4e40b8c8a)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:56.920249 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a3b0d-eeab-4c61-8ad3-e0ec45a6d32d admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:56.955947 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19487f-2d27-49d9-9d83-cf6fdafcd6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:56.957123 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19487f-2d27-49d9-9d83-cf6fdafcd6bb admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:56.957404 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19487f-2d27-49d9-9d83-cf6fdafcd6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:56.957947 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19487f-2d27-49d9-9d83-cf6fdafcd6bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:56.959185 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19487f-2d27-49d9-9d83-cf6fdafcd6bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:56.962705 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19487f-2d27-49d9-9d83-cf6fdafcd6bb admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:56.986602 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 967/1925] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:28:56.994748 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19487f-2d27-49d9-9d83-cf6fdafcd6bb admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:57.015962 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-c74a3b0d-eeab-4c61-8ad3-e0ec45a6d32d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b39902badc32447bb3be3ed4e40b8c8a'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:57.017140 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-c74a3b0d-eeab-4c61-8ad3-e0ec45a6d32d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b39902badc32447bb3be3ed4e40b8c8a'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:57.022764 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19487f-2d27-49d9-9d83-cf6fdafcd6bb admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:57.030211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-c74a3b0d-eeab-4c61-8ad3-e0ec45a6d32d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b39902badc32447bb3be3ed4e40b8c8a'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:57.034008 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb62abd-0001-472e-acb6-4b7e6271a79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:57.034488 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb62abd-0001-472e-acb6-4b7e6271a79d admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:57.034817 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb62abd-0001-472e-acb6-4b7e6271a79d admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:57.035179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb62abd-0001-472e-acb6-4b7e6271a79d admin admin] PATH_INFO: `/v3/projects/f3bb4940f15d43df80488270562f1559/users/6586028d969a4e068d57801489c8715f/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:57.037997 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb62abd-0001-472e-acb6-4b7e6271a79d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3bb4940f15d43df80488270562f1559, user_id=6586028d969a4e068d57801489c8715f, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:57.039999 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-c74a3b0d-eeab-4c61-8ad3-e0ec45a6d32d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b39902badc32447bb3be3ed4e40b8c8a'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:57.041905 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb62abd-0001-472e-acb6-4b7e6271a79d admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:57.064542 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 968/1926] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:28:56 2022] PUT /identity/v3/projects/f3bb4940f15d43df80488270562f1559/users/6586028d969a4e068d57801489c8715f/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:57.067891 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-c74a3b0d-eeab-4c61-8ad3-e0ec45a6d32d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b39902badc32447bb3be3ed4e40b8c8a'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:57.072649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50011f-c939-40d4-ae6b-c4495692e280 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:57.073230 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50011f-c939-40d4-ae6b-c4495692e280 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:57.073716 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50011f-c939-40d4-ae6b-c4495692e280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:57.081484 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 959/1927] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:28:56 2022] DELETE /identity/v3/users/b39902badc32447bb3be3ed4e40b8c8a => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:57.093283 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d86369-1ec5-4975-a03b-433d76a46a17 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:57.093627 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d86369-1ec5-4975-a03b-433d76a46a17 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:57.093871 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d86369-1ec5-4975-a03b-433d76a46a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:57.127848 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-14d86369-1ec5-4975-a03b-433d76a46a17 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:57.129061 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-14d86369-1ec5-4975-a03b-433d76a46a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:57.139096 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-4b50011f-c939-40d4-ae6b-c4495692e280 None None] MFA Rules not processed for user `6586028d969a4e068d57801489c8715f`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:57.140591 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-4b50011f-c939-40d4-ae6b-c4495692e280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:57.151566 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:57.267722 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 960/1928] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:57.273396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d86369-1ec5-4975-a03b-433d76a46a17 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:57.274527 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-14d86369-1ec5-4975-a03b-433d76a46a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:57.290458 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 969/1929] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:28:57.294586 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50011f-c939-40d4-ae6b-c4495692e280 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:57.300810 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-4b50011f-c939-40d4-ae6b-c4495692e280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:57.303148 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d86369-1ec5-4975-a03b-433d76a46a17 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:57.308388 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c327d-106e-431c-96bb-77db77a78839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:57.309046 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c327d-106e-431c-96bb-77db77a78839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:57.309330 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c327d-106e-431c-96bb-77db77a78839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:57.309642 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c327d-106e-431c-96bb-77db77a78839 admin admin] PATH_INFO: `/v3/projects/0f61b2621778479bbe02f7f151f49e0c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:57.311876 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c327d-106e-431c-96bb-77db77a78839 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f61b2621778479bbe02f7f151f49e0c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:57.314406 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c327d-106e-431c-96bb-77db77a78839 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:57.386988 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50011f-c939-40d4-ae6b-c4495692e280 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:57.397191 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-6c0c327d-106e-431c-96bb-77db77a78839 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f61b2621778479bbe02f7f151f49e0c', 'request_id': 'req-6c0c327d-106e-431c-96bb-77db77a78839'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:57.402859 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:57.404595 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-6c0c327d-106e-431c-96bb-77db77a78839 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f61b2621778479bbe02f7f151f49e0c', 'request_id': 'req-6c0c327d-106e-431c-96bb-77db77a78839'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:57.415886 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-6c0c327d-106e-431c-96bb-77db77a78839 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f61b2621778479bbe02f7f151f49e0c', 'request_id': 'req-6c0c327d-106e-431c-96bb-77db77a78839'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:57.432283 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-6c0c327d-106e-431c-96bb-77db77a78839 admin admin] The token cache is being invalidate because project 0f61b2621778479bbe02f7f151f49e0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:28:57.432576 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-6c0c327d-106e-431c-96bb-77db77a78839 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:57.433254 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-6c0c327d-106e-431c-96bb-77db77a78839 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:57.434824 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 961/1930] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:28:57 2022] DELETE /identity/v3/projects/0f61b2621778479bbe02f7f151f49e0c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:57.436418 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c327d-106e-431c-96bb-77db77a78839 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:57.437829 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-6c0c327d-106e-431c-96bb-77db77a78839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:57.449066 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8d852-1a72-4dbd-93b3-d7e08409d8b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:57.450001 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8d852-1a72-4dbd-93b3-d7e08409d8b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:57.450344 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8d852-1a72-4dbd-93b3-d7e08409d8b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:57.450622 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8d852-1a72-4dbd-93b3-d7e08409d8b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:57.454170 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-36f8d852-1a72-4dbd-93b3-d7e08409d8b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:57.534329 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c327d-106e-431c-96bb-77db77a78839 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:57.539676 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0054a76-2d82-44fe-85c1-6b6360696f1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:57.540314 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0054a76-2d82-44fe-85c1-6b6360696f1d service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:57.540602 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0054a76-2d82-44fe-85c1-6b6360696f1d service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:57.540875 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0054a76-2d82-44fe-85c1-6b6360696f1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:57.543300 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-f0054a76-2d82-44fe-85c1-6b6360696f1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:57.560133 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8d852-1a72-4dbd-93b3-d7e08409d8b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:57.562254 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8d852-1a72-4dbd-93b3-d7e08409d8b2 service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:57.575466 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 970/1931] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:57.578828 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8d852-1a72-4dbd-93b3-d7e08409d8b2 service neutron] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:57.580452 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-36f8d852-1a72-4dbd-93b3-d7e08409d8b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:57.596010 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8d852-1a72-4dbd-93b3-d7e08409d8b2 service neutron] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:57.601724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60153ba7-3ced-44df-a8ec-f8b3ce7c1b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:57.602835 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60153ba7-3ced-44df-a8ec-f8b3ce7c1b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:57.603180 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60153ba7-3ced-44df-a8ec-f8b3ce7c1b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:57.603523 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60153ba7-3ced-44df-a8ec-f8b3ce7c1b1c admin admin] PATH_INFO: `/v3/users/8322a88334d84732827851ee43537745` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:57.605147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60153ba7-3ced-44df-a8ec-f8b3ce7c1b1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8322a88334d84732827851ee43537745)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:57.609067 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60153ba7-3ced-44df-a8ec-f8b3ce7c1b1c admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:57.619135 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:57.636321 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0054a76-2d82-44fe-85c1-6b6360696f1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:57.638725 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0054a76-2d82-44fe-85c1-6b6360696f1d service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:57.665489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 962/1932] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:57 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:57.667498 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e1ac2-d863-448f-97cb-578f1da45d2e None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:57.668424 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e1ac2-d863-448f-97cb-578f1da45d2e None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:57.668859 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e1ac2-d863-448f-97cb-578f1da45d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:57.710852 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-60153ba7-3ced-44df-a8ec-f8b3ce7c1b1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8322a88334d84732827851ee43537745'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:57.712371 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-60153ba7-3ced-44df-a8ec-f8b3ce7c1b1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8322a88334d84732827851ee43537745'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:57.755612 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-60153ba7-3ced-44df-a8ec-f8b3ce7c1b1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8322a88334d84732827851ee43537745'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:57.762966 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-f62e1ac2-d863-448f-97cb-578f1da45d2e None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:57.772476 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-f62e1ac2-d863-448f-97cb-578f1da45d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:57.773269 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-60153ba7-3ced-44df-a8ec-f8b3ce7c1b1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8322a88334d84732827851ee43537745'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:57.774379 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-60153ba7-3ced-44df-a8ec-f8b3ce7c1b1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8322a88334d84732827851ee43537745'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:57.806519 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 971/1933] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:28:57 2022] DELETE /identity/v3/users/8322a88334d84732827851ee43537745 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:57.812809 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 963/1934] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:57.813493 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803a3e0-dd4f-4b67-8ebd-6624c4352841 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:57.813944 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803a3e0-dd4f-4b67-8ebd-6624c4352841 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:57.814357 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803a3e0-dd4f-4b67-8ebd-6624c4352841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:57.822372 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea16be-f75d-4f27-a7e1-fb8b8d9cb829 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:57.823255 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea16be-f75d-4f27-a7e1-fb8b8d9cb829 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:57.823255 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea16be-f75d-4f27-a7e1-fb8b8d9cb829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:57.850979 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-b9ea16be-f75d-4f27-a7e1-fb8b8d9cb829 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:57.852095 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-b9ea16be-f75d-4f27-a7e1-fb8b8d9cb829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:57.885217 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-7803a3e0-dd4f-4b67-8ebd-6624c4352841 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:57.888906 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-7803a3e0-dd4f-4b67-8ebd-6624c4352841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:57.979135 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 964/1935] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:57.979135 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea16be-f75d-4f27-a7e1-fb8b8d9cb829 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:57.979135 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-b9ea16be-f75d-4f27-a7e1-fb8b8d9cb829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:57.982877 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:58.054715 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 972/1936] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:28:58.054715 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803a3e0-dd4f-4b67-8ebd-6624c4352841 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:58.068737 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803a3e0-dd4f-4b67-8ebd-6624c4352841 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:58.075512 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc40d9f-babc-4a2f-82ec-8d094e9f5d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:58.077347 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc40d9f-babc-4a2f-82ec-8d094e9f5d3e admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:58.078062 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc40d9f-babc-4a2f-82ec-8d094e9f5d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:58.078465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc40d9f-babc-4a2f-82ec-8d094e9f5d3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:58.079629 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc40d9f-babc-4a2f-82ec-8d094e9f5d3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:28:58.080089 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc40d9f-babc-4a2f-82ec-8d094e9f5d3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:58.082859 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc40d9f-babc-4a2f-82ec-8d094e9f5d3e admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:58.118285 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 973/1937] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:28:58.118285 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc40d9f-babc-4a2f-82ec-8d094e9f5d3e admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:58.120762 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-2fc40d9f-babc-4a2f-82ec-8d094e9f5d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:58.129124 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea16be-f75d-4f27-a7e1-fb8b8d9cb829 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:58.137323 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84da2be-0958-448a-baa0-7e3388be0721 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:58.138520 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84da2be-0958-448a-baa0-7e3388be0721 service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:58.139405 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84da2be-0958-448a-baa0-7e3388be0721 service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:58.139863 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84da2be-0958-448a-baa0-7e3388be0721 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:58.142741 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-a84da2be-0958-448a-baa0-7e3388be0721 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:58.283217 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc40d9f-babc-4a2f-82ec-8d094e9f5d3e admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:58.303012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e16b3-1c59-4ea1-a446-5d8bb0a61ff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:58.305540 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e16b3-1c59-4ea1-a446-5d8bb0a61ff5 service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:58.305949 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e16b3-1c59-4ea1-a446-5d8bb0a61ff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:58.306333 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e16b3-1c59-4ea1-a446-5d8bb0a61ff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:58.342507 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84da2be-0958-448a-baa0-7e3388be0721 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:58.349623 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84da2be-0958-448a-baa0-7e3388be0721 service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:58.351324 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e16b3-1c59-4ea1-a446-5d8bb0a61ff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:58.358810 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e16b3-1c59-4ea1-a446-5d8bb0a61ff5 service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:58.362830 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 965/1938] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:58.363909 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84da2be-0958-448a-baa0-7e3388be0721 service cinder] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:58.379369 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84da2be-0958-448a-baa0-7e3388be0721 service cinder] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:58.386237 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575357d-c4dc-42ae-8a65-be859be15256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:58.387250 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575357d-c4dc-42ae-8a65-be859be15256 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:58.387750 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575357d-c4dc-42ae-8a65-be859be15256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:58.389095 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575357d-c4dc-42ae-8a65-be859be15256 admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:58.392071 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e575357d-c4dc-42ae-8a65-be859be15256 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:58.394563 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e575357d-c4dc-42ae-8a65-be859be15256 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:58.410349 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 974/1939] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:58.412092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e16b3-1c59-4ea1-a446-5d8bb0a61ff5 service neutron] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:58.414307 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-252e16b3-1c59-4ea1-a446-5d8bb0a61ff5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:58.431684 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e16b3-1c59-4ea1-a446-5d8bb0a61ff5 service neutron] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:58.441336 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9cc4d-c91f-4b16-8cb0-0a790f36d6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:58.442638 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9cc4d-c91f-4b16-8cb0-0a790f36d6d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:58.443349 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9cc4d-c91f-4b16-8cb0-0a790f36d6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:58.444140 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9cc4d-c91f-4b16-8cb0-0a790f36d6d8 admin admin] PATH_INFO: `/v3/projects/ca92a6e636c84840b1a701fe6beab00b` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:58.449343 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9cc4d-c91f-4b16-8cb0-0a790f36d6d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca92a6e636c84840b1a701fe6beab00b)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:58.457070 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9cc4d-c91f-4b16-8cb0-0a790f36d6d8 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:58.517498 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 966/1940] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:28:58 2022] POST /identity/v3/projects => generated 381 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:28:58.522623 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575357d-c4dc-42ae-8a65-be859be15256 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:58.583200 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:58.632970 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-cea9cc4d-c91f-4b16-8cb0-0a790f36d6d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca92a6e636c84840b1a701fe6beab00b', 'request_id': 'req-cea9cc4d-c91f-4b16-8cb0-0a790f36d6d8'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:58.649252 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-cea9cc4d-c91f-4b16-8cb0-0a790f36d6d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca92a6e636c84840b1a701fe6beab00b', 'request_id': 'req-cea9cc4d-c91f-4b16-8cb0-0a790f36d6d8'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:58.666361 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-cea9cc4d-c91f-4b16-8cb0-0a790f36d6d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca92a6e636c84840b1a701fe6beab00b', 'request_id': 'req-cea9cc4d-c91f-4b16-8cb0-0a790f36d6d8'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:58.698547 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-cea9cc4d-c91f-4b16-8cb0-0a790f36d6d8 admin admin] The token cache is being invalidate because project ca92a6e636c84840b1a701fe6beab00b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:28:58.698776 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-cea9cc4d-c91f-4b16-8cb0-0a790f36d6d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:58.699752 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-cea9cc4d-c91f-4b16-8cb0-0a790f36d6d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:58.707988 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 975/1941] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:28:58 2022] DELETE /identity/v3/projects/ca92a6e636c84840b1a701fe6beab00b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:58.712023 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9cc4d-c91f-4b16-8cb0-0a790f36d6d8 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:58.713683 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-cea9cc4d-c91f-4b16-8cb0-0a790f36d6d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:58.762911 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575357d-c4dc-42ae-8a65-be859be15256 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:58.934658 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:58.980483 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9cc4d-c91f-4b16-8cb0-0a790f36d6d8 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:58.987619 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee165c-0c5b-413e-ac5b-9b53182af04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:58.988318 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee165c-0c5b-413e-ac5b-9b53182af04d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:58.988626 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee165c-0c5b-413e-ac5b-9b53182af04d admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:58.989225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee165c-0c5b-413e-ac5b-9b53182af04d admin admin] PATH_INFO: `/v3/users/6df4524bc62d43ec856d4543ccf4ed30` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:58.992255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee165c-0c5b-413e-ac5b-9b53182af04d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6df4524bc62d43ec856d4543ccf4ed30)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:58.996080 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee165c-0c5b-413e-ac5b-9b53182af04d admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:59.035384 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ed17f-4cb9-4362-afff-b18744b55ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:59.039528 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ed17f-4cb9-4362-afff-b18744b55ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:59.041627 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ed17f-4cb9-4362-afff-b18744b55ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:59.042206 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ed17f-4cb9-4362-afff-b18744b55ca7 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:59.045333 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ed17f-4cb9-4362-afff-b18744b55ca7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:59.049847 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ed17f-4cb9-4362-afff-b18744b55ca7 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:59.098450 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 967/1942] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:28:58 2022] POST /identity/v3/users => generated 291 bytes in 580 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:28:59.102256 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ed17f-4cb9-4362-afff-b18744b55ca7 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:59.106601 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-657ed17f-4cb9-4362-afff-b18744b55ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:59.144003 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ed17f-4cb9-4362-afff-b18744b55ca7 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:59.146900 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-d2ee165c-0c5b-413e-ac5b-9b53182af04d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6df4524bc62d43ec856d4543ccf4ed30'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:59.147850 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-d2ee165c-0c5b-413e-ac5b-9b53182af04d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6df4524bc62d43ec856d4543ccf4ed30'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:59.150867 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c449c28-6765-47fe-9849-6e170dd9b493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:59.152032 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c449c28-6765-47fe-9849-6e170dd9b493 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:59.152309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c449c28-6765-47fe-9849-6e170dd9b493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:59.152587 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c449c28-6765-47fe-9849-6e170dd9b493 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:59.153330 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c449c28-6765-47fe-9849-6e170dd9b493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:59.156876 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c449c28-6765-47fe-9849-6e170dd9b493 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:59.162713 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-d2ee165c-0c5b-413e-ac5b-9b53182af04d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6df4524bc62d43ec856d4543ccf4ed30'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:59.174454 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-d2ee165c-0c5b-413e-ac5b-9b53182af04d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6df4524bc62d43ec856d4543ccf4ed30'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:59.176397 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-d2ee165c-0c5b-413e-ac5b-9b53182af04d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6df4524bc62d43ec856d4543ccf4ed30'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:59.184227 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 968/1943] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:28:59.194785 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c449c28-6765-47fe-9849-6e170dd9b493 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:59.197456 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-3c449c28-6765-47fe-9849-6e170dd9b493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:59.213313 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 976/1944] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:28:58 2022] DELETE /identity/v3/users/6df4524bc62d43ec856d4543ccf4ed30 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:59.220437 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c449c28-6765-47fe-9849-6e170dd9b493 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:59.371045 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095700ea-b0ba-4595-ba48-4d72d79dbc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:59.372217 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095700ea-b0ba-4595-ba48-4d72d79dbc34 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:59.372786 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095700ea-b0ba-4595-ba48-4d72d79dbc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:59.373447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095700ea-b0ba-4595-ba48-4d72d79dbc34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:59.374260 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095700ea-b0ba-4595-ba48-4d72d79dbc34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:59.378885 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee165c-0c5b-413e-ac5b-9b53182af04d admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:59.380504 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-d2ee165c-0c5b-413e-ac5b-9b53182af04d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:59.380807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095700ea-b0ba-4595-ba48-4d72d79dbc34 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:59.399772 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee165c-0c5b-413e-ac5b-9b53182af04d admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:59.412792 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e539b-d54c-4fb6-b96e-7fa21813405b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:59.414291 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e539b-d54c-4fb6-b96e-7fa21813405b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:59.414785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e539b-d54c-4fb6-b96e-7fa21813405b admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:59.415355 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e539b-d54c-4fb6-b96e-7fa21813405b admin admin] PATH_INFO: `/v3/projects/0bdf9de6d2694fdfa9d00bf2c99688fb` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:59.417876 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e539b-d54c-4fb6-b96e-7fa21813405b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bdf9de6d2694fdfa9d00bf2c99688fb)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:59.424215 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e539b-d54c-4fb6-b96e-7fa21813405b admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:59.435513 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 969/1945] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:28:59.453420 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095700ea-b0ba-4595-ba48-4d72d79dbc34 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:59.480860 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095700ea-b0ba-4595-ba48-4d72d79dbc34 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:59.494932 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab89fe-e8aa-48be-a8ea-01bee4ffa1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:59.496510 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab89fe-e8aa-48be-a8ea-01bee4ffa1a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:59.497322 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab89fe-e8aa-48be-a8ea-01bee4ffa1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:59.499359 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab89fe-e8aa-48be-a8ea-01bee4ffa1a8 admin admin] PATH_INFO: `/v3/projects/0492e09f106249e3880c14ca111db9a8/users/7c0c0e2e24ad4a93b6c8a5e1a39ec563/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:59.539956 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab89fe-e8aa-48be-a8ea-01bee4ffa1a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0492e09f106249e3880c14ca111db9a8, user_id=7c0c0e2e24ad4a93b6c8a5e1a39ec563, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:59.549921 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab89fe-e8aa-48be-a8ea-01bee4ffa1a8 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:59.563745 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-8f9e539b-d54c-4fb6-b96e-7fa21813405b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bdf9de6d2694fdfa9d00bf2c99688fb', 'request_id': 'req-8f9e539b-d54c-4fb6-b96e-7fa21813405b'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:59.586767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 970/1946] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:28:59 2022] PUT /identity/v3/projects/0492e09f106249e3880c14ca111db9a8/users/7c0c0e2e24ad4a93b6c8a5e1a39ec563/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:59.590244 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-8f9e539b-d54c-4fb6-b96e-7fa21813405b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bdf9de6d2694fdfa9d00bf2c99688fb', 'request_id': 'req-8f9e539b-d54c-4fb6-b96e-7fa21813405b'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:59.594942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26616e70-76dd-478c-9d1e-3561039213d6 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:59.595282 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26616e70-76dd-478c-9d1e-3561039213d6 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:59.595795 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26616e70-76dd-478c-9d1e-3561039213d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:59.615226 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-8f9e539b-d54c-4fb6-b96e-7fa21813405b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bdf9de6d2694fdfa9d00bf2c99688fb', 'request_id': 'req-8f9e539b-d54c-4fb6-b96e-7fa21813405b'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:59.658148 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-8f9e539b-d54c-4fb6-b96e-7fa21813405b admin admin] The token cache is being invalidate because project 0bdf9de6d2694fdfa9d00bf2c99688fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:28:59.660465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-8f9e539b-d54c-4fb6-b96e-7fa21813405b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:59.661964 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-8f9e539b-d54c-4fb6-b96e-7fa21813405b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:59.667533 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 977/1947] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:28:59 2022] DELETE /identity/v3/projects/0bdf9de6d2694fdfa9d00bf2c99688fb => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:59.670293 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-26616e70-76dd-478c-9d1e-3561039213d6 None None] MFA Rules not processed for user `7c0c0e2e24ad4a93b6c8a5e1a39ec563`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:59.675739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-26616e70-76dd-478c-9d1e-3561039213d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:59.676040 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e539b-d54c-4fb6-b96e-7fa21813405b admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:59.680910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-8f9e539b-d54c-4fb6-b96e-7fa21813405b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:59.691962 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:59.861616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:59.882941 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e539b-d54c-4fb6-b96e-7fa21813405b admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:00.047726 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 971/1948] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:28:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:29:00.053087 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26616e70-76dd-478c-9d1e-3561039213d6 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:00.057322 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-26616e70-76dd-478c-9d1e-3561039213d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:00.104078 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c54aa-1a94-4bf2-b229-c4bcdbd5e170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:00.105294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c54aa-1a94-4bf2-b229-c4bcdbd5e170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:00.105860 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c54aa-1a94-4bf2-b229-c4bcdbd5e170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:00.106353 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c54aa-1a94-4bf2-b229-c4bcdbd5e170 admin admin] PATH_INFO: `/v3/users/49ad951188284f18a9cc34ddbe4e34d4` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:00.108991 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c54aa-1a94-4bf2-b229-c4bcdbd5e170 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49ad951188284f18a9cc34ddbe4e34d4)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:00.115101 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c54aa-1a94-4bf2-b229-c4bcdbd5e170 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:00.237554 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-796c54aa-1a94-4bf2-b229-c4bcdbd5e170 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49ad951188284f18a9cc34ddbe4e34d4'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:00.238302 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-796c54aa-1a94-4bf2-b229-c4bcdbd5e170 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49ad951188284f18a9cc34ddbe4e34d4'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:00.272127 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-796c54aa-1a94-4bf2-b229-c4bcdbd5e170 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49ad951188284f18a9cc34ddbe4e34d4'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:00.278256 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-796c54aa-1a94-4bf2-b229-c4bcdbd5e170 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49ad951188284f18a9cc34ddbe4e34d4'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:00.279638 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-796c54aa-1a94-4bf2-b229-c4bcdbd5e170 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49ad951188284f18a9cc34ddbe4e34d4'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:00.324492 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 978/1949] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:28:59 2022] DELETE /identity/v3/users/49ad951188284f18a9cc34ddbe4e34d4 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:00.353135 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26616e70-76dd-478c-9d1e-3561039213d6 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:00.586459 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c54aa-1a94-4bf2-b229-c4bcdbd5e170 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:00.588616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-796c54aa-1a94-4bf2-b229-c4bcdbd5e170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:00.658181 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42abdc9-9495-48c5-af2a-a5c73896d4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:00.659092 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42abdc9-9495-48c5-af2a-a5c73896d4d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:00.659554 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42abdc9-9495-48c5-af2a-a5c73896d4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:00.660027 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42abdc9-9495-48c5-af2a-a5c73896d4d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:00.662342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42abdc9-9495-48c5-af2a-a5c73896d4d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:00.673125 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42abdc9-9495-48c5-af2a-a5c73896d4d9 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:00.807621 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 972/1950] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:29:00 2022] POST /identity/v3/projects => generated 383 bytes in 756 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:29:00.816709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42abdc9-9495-48c5-af2a-a5c73896d4d9 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:00.826422 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-d42abdc9-9495-48c5-af2a-a5c73896d4d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:00.904958 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c54aa-1a94-4bf2-b229-c4bcdbd5e170 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:01.002652 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:01.009918 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:01.109279 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42abdc9-9495-48c5-af2a-a5c73896d4d9 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:01.115519 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96d78b-3445-4724-85fa-43011c391992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:01.116371 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96d78b-3445-4724-85fa-43011c391992 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:01.116603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96d78b-3445-4724-85fa-43011c391992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:01.116756 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96d78b-3445-4724-85fa-43011c391992 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:01.117355 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96d78b-3445-4724-85fa-43011c391992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:01.120379 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96d78b-3445-4724-85fa-43011c391992 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:01.129626 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed4a1e-dc2e-4804-aef9-9d219cdde36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:01.131156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed4a1e-dc2e-4804-aef9-9d219cdde36e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:01.132167 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed4a1e-dc2e-4804-aef9-9d219cdde36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:01.132920 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed4a1e-dc2e-4804-aef9-9d219cdde36e admin admin] PATH_INFO: `/v3/projects/8591f24d061c45ce8315f3263af8f4ae` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:01.135376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed4a1e-dc2e-4804-aef9-9d219cdde36e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8591f24d061c45ce8315f3263af8f4ae)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:01.138183 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed4a1e-dc2e-4804-aef9-9d219cdde36e admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:01.173779 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 973/1951] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:29:00 2022] POST /identity/v3/users => generated 298 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:29:01.178076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96d78b-3445-4724-85fa-43011c391992 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:01.228570 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96d78b-3445-4724-85fa-43011c391992 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:01.251523 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54b670-9810-4e25-8e01-8fc9e20ed89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:01.253021 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54b670-9810-4e25-8e01-8fc9e20ed89e admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:01.254053 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54b670-9810-4e25-8e01-8fc9e20ed89e admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:01.254761 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54b670-9810-4e25-8e01-8fc9e20ed89e admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:01.256240 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54b670-9810-4e25-8e01-8fc9e20ed89e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:01.259812 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54b670-9810-4e25-8e01-8fc9e20ed89e admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:01.273566 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-5bed4a1e-dc2e-4804-aef9-9d219cdde36e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8591f24d061c45ce8315f3263af8f4ae', 'request_id': 'req-5bed4a1e-dc2e-4804-aef9-9d219cdde36e'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:01.292421 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-5bed4a1e-dc2e-4804-aef9-9d219cdde36e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8591f24d061c45ce8315f3263af8f4ae', 'request_id': 'req-5bed4a1e-dc2e-4804-aef9-9d219cdde36e'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:01.313004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 974/1952] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:29:01.323067 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-5bed4a1e-dc2e-4804-aef9-9d219cdde36e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8591f24d061c45ce8315f3263af8f4ae', 'request_id': 'req-5bed4a1e-dc2e-4804-aef9-9d219cdde36e'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:01.330964 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54b670-9810-4e25-8e01-8fc9e20ed89e admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:01.339671 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-8e54b670-9810-4e25-8e01-8fc9e20ed89e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:01.367528 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-5bed4a1e-dc2e-4804-aef9-9d219cdde36e admin admin] The token cache is being invalidate because project 8591f24d061c45ce8315f3263af8f4ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:29:01.368258 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-5bed4a1e-dc2e-4804-aef9-9d219cdde36e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:01.374702 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-5bed4a1e-dc2e-4804-aef9-9d219cdde36e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:01.377838 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 979/1953] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:29:00 2022] DELETE /identity/v3/projects/8591f24d061c45ce8315f3263af8f4ae => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:01.379136 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed4a1e-dc2e-4804-aef9-9d219cdde36e admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:01.395332 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-5bed4a1e-dc2e-4804-aef9-9d219cdde36e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:01.411140 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54b670-9810-4e25-8e01-8fc9e20ed89e admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:01.592148 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840afe2-6d93-426d-8896-e2882001f85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:01.593551 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840afe2-6d93-426d-8896-e2882001f85a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:01.594161 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840afe2-6d93-426d-8896-e2882001f85a admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:01.594766 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840afe2-6d93-426d-8896-e2882001f85a admin admin] PATH_INFO: `/v3/projects/555fe97f44bf449383483824ab2f90b6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:01.598009 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840afe2-6d93-426d-8896-e2882001f85a admin admin] RBAC: Authorizing `identity:delete_project(project_id=555fe97f44bf449383483824ab2f90b6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:01.606267 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840afe2-6d93-426d-8896-e2882001f85a admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:01.610791 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed4a1e-dc2e-4804-aef9-9d219cdde36e admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:01.619728 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545004b4-1236-4bb6-822f-8be61acd5070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:01.621129 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545004b4-1236-4bb6-822f-8be61acd5070 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:01.621432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545004b4-1236-4bb6-822f-8be61acd5070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:01.622117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545004b4-1236-4bb6-822f-8be61acd5070 admin admin] PATH_INFO: `/v3/projects/33867fe2beca4f7991a66909bb831166/users/6a0e6556eb724d4bb2bf267e11a60696/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:01.656159 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545004b4-1236-4bb6-822f-8be61acd5070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33867fe2beca4f7991a66909bb831166, user_id=6a0e6556eb724d4bb2bf267e11a60696, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:01.662147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545004b4-1236-4bb6-822f-8be61acd5070 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:01.696740 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 980/1954] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:29:01 2022] PUT /identity/v3/projects/33867fe2beca4f7991a66909bb831166/users/6a0e6556eb724d4bb2bf267e11a60696/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:01.696740 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26265bb-6a57-4187-88da-eda73c17f2c8 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:01.696740 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26265bb-6a57-4187-88da-eda73c17f2c8 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:01.696740 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26265bb-6a57-4187-88da-eda73c17f2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:01.702688 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-c840afe2-6d93-426d-8896-e2882001f85a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '555fe97f44bf449383483824ab2f90b6', 'request_id': 'req-c840afe2-6d93-426d-8896-e2882001f85a'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:01.717925 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-c840afe2-6d93-426d-8896-e2882001f85a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '555fe97f44bf449383483824ab2f90b6', 'request_id': 'req-c840afe2-6d93-426d-8896-e2882001f85a'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:01.750581 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-c840afe2-6d93-426d-8896-e2882001f85a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '555fe97f44bf449383483824ab2f90b6', 'request_id': 'req-c840afe2-6d93-426d-8896-e2882001f85a'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:01.765925 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-c26265bb-6a57-4187-88da-eda73c17f2c8 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:01.768576 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-c26265bb-6a57-4187-88da-eda73c17f2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:01.783285 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-c840afe2-6d93-426d-8896-e2882001f85a admin admin] The token cache is being invalidate because project 555fe97f44bf449383483824ab2f90b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:29:01.783639 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-c840afe2-6d93-426d-8896-e2882001f85a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:01.784809 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-c840afe2-6d93-426d-8896-e2882001f85a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:01.787092 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 975/1955] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:29:01 2022] DELETE /identity/v3/projects/555fe97f44bf449383483824ab2f90b6 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:01.788369 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840afe2-6d93-426d-8896-e2882001f85a admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:01.795777 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-c840afe2-6d93-426d-8896-e2882001f85a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:01.879915 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:01.898426 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:01.924878 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 981/1956] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:01.926412 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e333c-b461-43ef-9e4b-33869c79a6d3 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:01.926778 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e333c-b461-43ef-9e4b-33869c79a6d3 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:01.927058 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e333c-b461-43ef-9e4b-33869c79a6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:01.928342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840afe2-6d93-426d-8896-e2882001f85a admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:01.934548 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f253dea-70a2-457b-b378-7ca7af3ab0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:01.935956 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f253dea-70a2-457b-b378-7ca7af3ab0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:01.936279 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f253dea-70a2-457b-b378-7ca7af3ab0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:01.936649 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f253dea-70a2-457b-b378-7ca7af3ab0f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:01.937427 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f253dea-70a2-457b-b378-7ca7af3ab0f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:01.940259 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f253dea-70a2-457b-b378-7ca7af3ab0f3 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:01.973486 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-472e333c-b461-43ef-9e4b-33869c79a6d3 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:01.973486 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-472e333c-b461-43ef-9e4b-33869c79a6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:01.975748 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 976/1957] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:29:01.978741 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beaceb8-ff9f-4522-826e-6b98a04c66cb None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:01.979183 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beaceb8-ff9f-4522-826e-6b98a04c66cb None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:01.979332 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beaceb8-ff9f-4522-826e-6b98a04c66cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:01.999804 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 982/1958] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:02.000439 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e333c-b461-43ef-9e4b-33869c79a6d3 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:02.015393 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e333c-b461-43ef-9e4b-33869c79a6d3 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:02.023266 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cd2aa-fe5f-4017-baca-37affb9fcf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:02.023951 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cd2aa-fe5f-4017-baca-37affb9fcf9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:02.024227 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cd2aa-fe5f-4017-baca-37affb9fcf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:02.024506 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cd2aa-fe5f-4017-baca-37affb9fcf9a admin admin] PATH_INFO: `/v3/projects/33867fe2beca4f7991a66909bb831166/users/6a0e6556eb724d4bb2bf267e11a60696/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:02.026665 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787cd2aa-fe5f-4017-baca-37affb9fcf9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=33867fe2beca4f7991a66909bb831166, user_id=6a0e6556eb724d4bb2bf267e11a60696, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:02.030571 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787cd2aa-fe5f-4017-baca-37affb9fcf9a admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:02.057483 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 983/1959] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:29:01 2022] PUT /identity/v3/projects/33867fe2beca4f7991a66909bb831166/users/6a0e6556eb724d4bb2bf267e11a60696/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:02.057483 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2f46e-aa82-43b7-b68f-16ce7d29e131 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:02.057483 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2f46e-aa82-43b7-b68f-16ce7d29e131 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:02.057483 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2f46e-aa82-43b7-b68f-16ce7d29e131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:02.068992 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-1beaceb8-ff9f-4522-826e-6b98a04c66cb None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:02.068992 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-1beaceb8-ff9f-4522-826e-6b98a04c66cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:02.096633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-06b2f46e-aa82-43b7-b68f-16ce7d29e131 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:02.098009 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-06b2f46e-aa82-43b7-b68f-16ce7d29e131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:02.188160 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 977/1960] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:02.189578 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7aa5e-d49c-4233-94bc-f1d278ac62e1 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:02.189869 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7aa5e-d49c-4233-94bc-f1d278ac62e1 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:02.190141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7aa5e-d49c-4233-94bc-f1d278ac62e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:02.228366 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-9eb7aa5e-d49c-4233-94bc-f1d278ac62e1 None None] MFA Rules not processed for user `6a0e6556eb724d4bb2bf267e11a60696`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:02.229885 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-9eb7aa5e-d49c-4233-94bc-f1d278ac62e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:02.240388 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 984/1961] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:02.241845 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2f46e-aa82-43b7-b68f-16ce7d29e131 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:02.244063 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-06b2f46e-aa82-43b7-b68f-16ce7d29e131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:02.267208 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2f46e-aa82-43b7-b68f-16ce7d29e131 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:02.277590 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8d0af-c735-4700-8650-c60a8b204859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:02.278532 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8d0af-c735-4700-8650-c60a8b204859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:02.279903 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8d0af-c735-4700-8650-c60a8b204859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:02.280263 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8d0af-c735-4700-8650-c60a8b204859 admin admin] PATH_INFO: `/v3/users/ab41e0b1350e45b3b68d9471ccd253f0` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:02.281782 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8d0af-c735-4700-8650-c60a8b204859 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab41e0b1350e45b3b68d9471ccd253f0)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:02.284231 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8d0af-c735-4700-8650-c60a8b204859 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:02.381598 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-29e8d0af-c735-4700-8650-c60a8b204859 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab41e0b1350e45b3b68d9471ccd253f0'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:02.383171 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-29e8d0af-c735-4700-8650-c60a8b204859 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab41e0b1350e45b3b68d9471ccd253f0'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:02.404149 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-29e8d0af-c735-4700-8650-c60a8b204859 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab41e0b1350e45b3b68d9471ccd253f0'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:02.409270 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 978/1962] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:02 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:02.413789 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7aa5e-d49c-4233-94bc-f1d278ac62e1 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:02.435533 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-29e8d0af-c735-4700-8650-c60a8b204859 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab41e0b1350e45b3b68d9471ccd253f0'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:02.435533 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-29e8d0af-c735-4700-8650-c60a8b204859 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab41e0b1350e45b3b68d9471ccd253f0'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:02.446963 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7aa5e-d49c-4233-94bc-f1d278ac62e1 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:02.472205 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ade98-4710-4d97-b423-d6ece34de003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:02.473833 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ade98-4710-4d97-b423-d6ece34de003 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:02.474294 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ade98-4710-4d97-b423-d6ece34de003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:02.474747 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ade98-4710-4d97-b423-d6ece34de003 admin admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:02.475877 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ade98-4710-4d97-b423-d6ece34de003 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:29:02.476393 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ade98-4710-4d97-b423-d6ece34de003 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:02.483047 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ade98-4710-4d97-b423-d6ece34de003 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:02.497879 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 985/1963] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:29:02 2022] DELETE /identity/v3/users/ab41e0b1350e45b3b68d9471ccd253f0 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:02.502625 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8d0af-c735-4700-8650-c60a8b204859 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:02.504173 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-29e8d0af-c735-4700-8650-c60a8b204859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:02.511472 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 979/1964] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:29:02.512466 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ade98-4710-4d97-b423-d6ece34de003 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:02.522684 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-8a6ade98-4710-4d97-b423-d6ece34de003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:02.608750 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:02.646129 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8d0af-c735-4700-8650-c60a8b204859 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:02.655397 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95a86d-cbe6-4adf-a0b2-7781e7b03cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:02.656219 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95a86d-cbe6-4adf-a0b2-7781e7b03cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:02.656570 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95a86d-cbe6-4adf-a0b2-7781e7b03cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:02.657233 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95a86d-cbe6-4adf-a0b2-7781e7b03cc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:02.658032 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be95a86d-cbe6-4adf-a0b2-7781e7b03cc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:29:02.658456 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be95a86d-cbe6-4adf-a0b2-7781e7b03cc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:02.660553 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be95a86d-cbe6-4adf-a0b2-7781e7b03cc5 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:02.666896 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ade98-4710-4d97-b423-d6ece34de003 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:02.687394 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 986/1965] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:29:02.687394 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cd47f-d965-4227-8683-9d87e7390edd None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:02.687394 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cd47f-d965-4227-8683-9d87e7390edd None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:02.687394 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cd47f-d965-4227-8683-9d87e7390edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:02.689607 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:02.722615 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-5d9cd47f-d965-4227-8683-9d87e7390edd None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:02.728474 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-5d9cd47f-d965-4227-8683-9d87e7390edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:02.753969 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 987/1966] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:02.753969 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9cd47f-d965-4227-8683-9d87e7390edd None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:02.758185 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410725d7-f362-4f1e-a760-d59f947bffe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:02.759257 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410725d7-f362-4f1e-a760-d59f947bffe5 service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:02.759779 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410725d7-f362-4f1e-a760-d59f947bffe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:02.760290 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410725d7-f362-4f1e-a760-d59f947bffe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:02.764847 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-410725d7-f362-4f1e-a760-d59f947bffe5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:02.766987 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-5d9cd47f-d965-4227-8683-9d87e7390edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:02.789335 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9cd47f-d965-4227-8683-9d87e7390edd None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:02.799457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be107fc-d9e6-43b6-9ab4-aa5aba0417f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:02.800664 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be107fc-d9e6-43b6-9ab4-aa5aba0417f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:02.801234 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be107fc-d9e6-43b6-9ab4-aa5aba0417f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:02.801867 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be107fc-d9e6-43b6-9ab4-aa5aba0417f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:02.803469 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be107fc-d9e6-43b6-9ab4-aa5aba0417f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:02.808165 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be107fc-d9e6-43b6-9ab4-aa5aba0417f0 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:02.869929 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 988/1967] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:29:02 2022] POST /identity/v3/projects => generated 367 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:29:02.871109 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be107fc-d9e6-43b6-9ab4-aa5aba0417f0 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:02.894513 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410725d7-f362-4f1e-a760-d59f947bffe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:02.896791 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410725d7-f362-4f1e-a760-d59f947bffe5 service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:02.911111 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 980/1968] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:02 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:02.922973 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410725d7-f362-4f1e-a760-d59f947bffe5 service cinder] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:02.927359 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-410725d7-f362-4f1e-a760-d59f947bffe5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:03.082024 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be107fc-d9e6-43b6-9ab4-aa5aba0417f0 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:03.117309 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b26da-cfa7-4315-9cfe-f7a36d89fdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:03.122021 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b26da-cfa7-4315-9cfe-f7a36d89fdac admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:03.136520 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b26da-cfa7-4315-9cfe-f7a36d89fdac admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:03.137068 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b26da-cfa7-4315-9cfe-f7a36d89fdac admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:03.138953 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b26da-cfa7-4315-9cfe-f7a36d89fdac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:03.141990 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b26da-cfa7-4315-9cfe-f7a36d89fdac admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:03.199656 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410725d7-f362-4f1e-a760-d59f947bffe5 service cinder] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:03.212786 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 989/1969] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:29:02 2022] POST /identity/v3/projects => generated 389 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:29:03.214159 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b26da-cfa7-4315-9cfe-f7a36d89fdac admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:03.306872 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520699e9-fa3a-4d91-b55c-0ffe3c2c87db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:03.307965 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520699e9-fa3a-4d91-b55c-0ffe3c2c87db service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:03.308343 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520699e9-fa3a-4d91-b55c-0ffe3c2c87db service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:03.308632 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520699e9-fa3a-4d91-b55c-0ffe3c2c87db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:03.314801 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b26da-cfa7-4315-9cfe-f7a36d89fdac admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:03.321402 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520699e9-fa3a-4d91-b55c-0ffe3c2c87db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:03.322928 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520699e9-fa3a-4d91-b55c-0ffe3c2c87db service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:03.326166 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3c232-1eaa-48b3-b388-4c84b95c9f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:03.327827 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3c232-1eaa-48b3-b388-4c84b95c9f19 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:03.328073 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3c232-1eaa-48b3-b388-4c84b95c9f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:03.328678 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3c232-1eaa-48b3-b388-4c84b95c9f19 admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:03.330331 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b3c232-1eaa-48b3-b388-4c84b95c9f19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:03.335187 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b3c232-1eaa-48b3-b388-4c84b95c9f19 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:03.337013 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 981/1970] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:03.337839 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520699e9-fa3a-4d91-b55c-0ffe3c2c87db service neutron] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:03.339514 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-520699e9-fa3a-4d91-b55c-0ffe3c2c87db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:03.383551 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 990/1971] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:29:03 2022] POST /identity/v3/users => generated 284 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:29:03.389847 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3c232-1eaa-48b3-b388-4c84b95c9f19 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:03.397976 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:03.409301 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3c232-1eaa-48b3-b388-4c84b95c9f19 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:03.425860 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a279917-0379-4bd1-9e58-d854270a67f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:03.426861 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a279917-0379-4bd1-9e58-d854270a67f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:03.427226 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a279917-0379-4bd1-9e58-d854270a67f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:03.429653 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a279917-0379-4bd1-9e58-d854270a67f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:03.430435 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a279917-0379-4bd1-9e58-d854270a67f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:03.437395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a279917-0379-4bd1-9e58-d854270a67f8 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:03.485588 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:03.517133 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 991/1972] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:29:03 2022] POST /identity/v3/users => generated 295 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:29:03.520666 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a279917-0379-4bd1-9e58-d854270a67f8 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:03.553704 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a279917-0379-4bd1-9e58-d854270a67f8 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:03.556314 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520699e9-fa3a-4d91-b55c-0ffe3c2c87db service neutron] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:03.568734 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb45cb1-4631-4e11-b8a6-fecc3d44d9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:03.569784 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb45cb1-4631-4e11-b8a6-fecc3d44d9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:03.570988 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb45cb1-4631-4e11-b8a6-fecc3d44d9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:03.571623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb45cb1-4631-4e11-b8a6-fecc3d44d9a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:03.572694 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb45cb1-4631-4e11-b8a6-fecc3d44d9a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:03.574898 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb45cb1-4631-4e11-b8a6-fecc3d44d9a8 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:03.588799 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 992/1973] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:29:03.591291 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb45cb1-4631-4e11-b8a6-fecc3d44d9a8 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:03.608825 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb45cb1-4631-4e11-b8a6-fecc3d44d9a8 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:03.620726 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7da5f1-64e9-4123-91b0-cf76b6293c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:03.621394 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7da5f1-64e9-4123-91b0-cf76b6293c1c admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:03.621718 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7da5f1-64e9-4123-91b0-cf76b6293c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:03.622009 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7da5f1-64e9-4123-91b0-cf76b6293c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:03.627465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7da5f1-64e9-4123-91b0-cf76b6293c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:03.630896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7da5f1-64e9-4123-91b0-cf76b6293c1c admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:03.646324 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 993/1974] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:29:03.647327 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7da5f1-64e9-4123-91b0-cf76b6293c1c admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:03.685710 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7da5f1-64e9-4123-91b0-cf76b6293c1c admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:03.697281 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb170029-52d5-4755-9438-c0e1e946e474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:03.699412 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb170029-52d5-4755-9438-c0e1e946e474 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:03.700266 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb170029-52d5-4755-9438-c0e1e946e474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:03.701705 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb170029-52d5-4755-9438-c0e1e946e474 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:03.704261 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb170029-52d5-4755-9438-c0e1e946e474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:03.709892 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb170029-52d5-4755-9438-c0e1e946e474 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:03.735089 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 994/1975] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:29:03.737352 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb170029-52d5-4755-9438-c0e1e946e474 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:03.768805 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb170029-52d5-4755-9438-c0e1e946e474 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:03.786942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da866d8c-0d9a-4ca9-b0d0-92edbbc10486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:03.790333 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da866d8c-0d9a-4ca9-b0d0-92edbbc10486 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:03.790779 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da866d8c-0d9a-4ca9-b0d0-92edbbc10486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:03.790980 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da866d8c-0d9a-4ca9-b0d0-92edbbc10486 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:03.791727 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da866d8c-0d9a-4ca9-b0d0-92edbbc10486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:03.797751 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da866d8c-0d9a-4ca9-b0d0-92edbbc10486 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:03.834292 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 995/1976] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:29:03.836958 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da866d8c-0d9a-4ca9-b0d0-92edbbc10486 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:03.845579 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff247572-4d67-4b92-a3d9-69bd5a7f1d0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:03.846508 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff247572-4d67-4b92-a3d9-69bd5a7f1d0b service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:03.846953 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff247572-4d67-4b92-a3d9-69bd5a7f1d0b service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:03.847399 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff247572-4d67-4b92-a3d9-69bd5a7f1d0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:03.850640 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-ff247572-4d67-4b92-a3d9-69bd5a7f1d0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:03.865334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da866d8c-0d9a-4ca9-b0d0-92edbbc10486 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:03.878520 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199ce48-6516-4187-aeb1-21d4e72f4f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:03.879877 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199ce48-6516-4187-aeb1-21d4e72f4f0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:03.880611 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199ce48-6516-4187-aeb1-21d4e72f4f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:03.881117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199ce48-6516-4187-aeb1-21d4e72f4f0d admin admin] PATH_INFO: `/v3/projects/b364d1c212124c7bbd09cd538086d324/users/aa22971f2ae048f48ad725a785a85eb3/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:03.935782 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199ce48-6516-4187-aeb1-21d4e72f4f0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b364d1c212124c7bbd09cd538086d324, user_id=aa22971f2ae048f48ad725a785a85eb3, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:03.944306 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199ce48-6516-4187-aeb1-21d4e72f4f0d admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:03.984341 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 996/1977] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:29:03 2022] PUT /identity/v3/projects/b364d1c212124c7bbd09cd538086d324/users/aa22971f2ae048f48ad725a785a85eb3/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:03.995622 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff247572-4d67-4b92-a3d9-69bd5a7f1d0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:03.998669 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff247572-4d67-4b92-a3d9-69bd5a7f1d0b service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:04.001070 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199ce48-6516-4187-aeb1-21d4e72f4f0d admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:04.027147 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 982/1978] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 688 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:04.033315 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc4054-a09c-47e9-8a89-2dbf19e2974e None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:04.035962 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc4054-a09c-47e9-8a89-2dbf19e2974e None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:04.037281 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc4054-a09c-47e9-8a89-2dbf19e2974e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:04.145079 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-36bc4054-a09c-47e9-8a89-2dbf19e2974e None None] MFA Rules not processed for user `aa22971f2ae048f48ad725a785a85eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:04.150103 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-36bc4054-a09c-47e9-8a89-2dbf19e2974e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:04.191053 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199ce48-6516-4187-aeb1-21d4e72f4f0d admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:04.201908 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e7c6f-6e4e-4333-8851-e75f68196c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:04.203927 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e7c6f-6e4e-4333-8851-e75f68196c37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:04.204396 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e7c6f-6e4e-4333-8851-e75f68196c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:04.204909 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e7c6f-6e4e-4333-8851-e75f68196c37 admin admin] PATH_INFO: `/v3/projects/bd397c910d844607870d442a81fd1cf7/users/cc344b405eb4410896f1553362549023/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:04.247167 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e7c6f-6e4e-4333-8851-e75f68196c37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd397c910d844607870d442a81fd1cf7, user_id=cc344b405eb4410896f1553362549023, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:04.255874 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e7c6f-6e4e-4333-8851-e75f68196c37 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:04.298816 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 997/1979] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:29:03 2022] PUT /identity/v3/projects/bd397c910d844607870d442a81fd1cf7/users/cc344b405eb4410896f1553362549023/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:04.323877 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7b09d-b668-4100-8c52-31749d6bb10f None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:04.323877 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7b09d-b668-4100-8c52-31749d6bb10f None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:04.323877 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7b09d-b668-4100-8c52-31749d6bb10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:04.427555 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-e4e7b09d-b668-4100-8c52-31749d6bb10f None None] MFA Rules not processed for user `cc344b405eb4410896f1553362549023`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:04.431633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-e4e7b09d-b668-4100-8c52-31749d6bb10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:04.464535 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 983/1980] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:04.474477 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc4054-a09c-47e9-8a89-2dbf19e2974e None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:04.513675 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc4054-a09c-47e9-8a89-2dbf19e2974e None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:04.605015 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:04.711725 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c84aa-e144-4cb0-a5d9-e89fca859562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:04.712952 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c84aa-e144-4cb0-a5d9-e89fca859562 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:04.714400 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c84aa-e144-4cb0-a5d9-e89fca859562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:04.715007 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c84aa-e144-4cb0-a5d9-e89fca859562 admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:04.717590 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c84aa-e144-4cb0-a5d9-e89fca859562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:04.721464 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c84aa-e144-4cb0-a5d9-e89fca859562 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:04.752130 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 998/1981] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:04.756737 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7b09d-b668-4100-8c52-31749d6bb10f None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:04.760591 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-e4e7b09d-b668-4100-8c52-31749d6bb10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:04.780807 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:04.808800 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 984/1982] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:29:04 2022] POST /identity/v3/projects => generated 363 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:29:04.808800 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c84aa-e144-4cb0-a5d9-e89fca859562 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:04.809192 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7b09d-b668-4100-8c52-31749d6bb10f None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:04.904350 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c84aa-e144-4cb0-a5d9-e89fca859562 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:04.910369 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47438ecf-4957-45f2-ab7a-30be9f47ca04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:04.911385 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47438ecf-4957-45f2-ab7a-30be9f47ca04 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:04.911694 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47438ecf-4957-45f2-ab7a-30be9f47ca04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:04.911976 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47438ecf-4957-45f2-ab7a-30be9f47ca04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:04.912667 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47438ecf-4957-45f2-ab7a-30be9f47ca04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:04.914717 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47438ecf-4957-45f2-ab7a-30be9f47ca04 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:04.924838 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d159048-d0a0-40a0-96c2-2d1c177f68ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:04.924838 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d159048-d0a0-40a0-96c2-2d1c177f68ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:04.924838 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d159048-d0a0-40a0-96c2-2d1c177f68ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:04.924838 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d159048-d0a0-40a0-96c2-2d1c177f68ef admin admin] PATH_INFO: `/v3/projects/bc5e8eff96524fcba91bf0f929040096` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:04.926282 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d159048-d0a0-40a0-96c2-2d1c177f68ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc5e8eff96524fcba91bf0f929040096)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:04.928582 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d159048-d0a0-40a0-96c2-2d1c177f68ef admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:04.959265 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 985/1983] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:29:04 2022] POST /identity/v3/projects => generated 387 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:29:04.963990 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47438ecf-4957-45f2-ab7a-30be9f47ca04 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:04.965869 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-47438ecf-4957-45f2-ab7a-30be9f47ca04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:05.017973 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-3d159048-d0a0-40a0-96c2-2d1c177f68ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc5e8eff96524fcba91bf0f929040096', 'request_id': 'req-3d159048-d0a0-40a0-96c2-2d1c177f68ef'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:05.025947 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-3d159048-d0a0-40a0-96c2-2d1c177f68ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc5e8eff96524fcba91bf0f929040096', 'request_id': 'req-3d159048-d0a0-40a0-96c2-2d1c177f68ef'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:05.038062 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-3d159048-d0a0-40a0-96c2-2d1c177f68ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc5e8eff96524fcba91bf0f929040096', 'request_id': 'req-3d159048-d0a0-40a0-96c2-2d1c177f68ef'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:05.063544 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-3d159048-d0a0-40a0-96c2-2d1c177f68ef admin admin] The token cache is being invalidate because project bc5e8eff96524fcba91bf0f929040096 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:29:05.063961 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-3d159048-d0a0-40a0-96c2-2d1c177f68ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:05.064778 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-3d159048-d0a0-40a0-96c2-2d1c177f68ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:05.066669 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 999/1984] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:29:04 2022] DELETE /identity/v3/projects/bc5e8eff96524fcba91bf0f929040096 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:05.067615 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d159048-d0a0-40a0-96c2-2d1c177f68ef admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:05.071184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-3d159048-d0a0-40a0-96c2-2d1c177f68ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:05.101948 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47438ecf-4957-45f2-ab7a-30be9f47ca04 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:05.168269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:05.178792 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d159048-d0a0-40a0-96c2-2d1c177f68ef admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:05.186129 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad8da0-59ad-4e99-bce0-798bcbdbf8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:05.186766 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad8da0-59ad-4e99-bce0-798bcbdbf8db admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:05.187045 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad8da0-59ad-4e99-bce0-798bcbdbf8db admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:05.187316 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad8da0-59ad-4e99-bce0-798bcbdbf8db admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:05.187955 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad8da0-59ad-4e99-bce0-798bcbdbf8db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:05.190134 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad8da0-59ad-4e99-bce0-798bcbdbf8db admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:05.236433 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeff9d5-8495-42a9-82e3-e15806c4f9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:05.237134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeff9d5-8495-42a9-82e3-e15806c4f9fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:05.237769 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeff9d5-8495-42a9-82e3-e15806c4f9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:05.238288 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeff9d5-8495-42a9-82e3-e15806c4f9fd admin admin] PATH_INFO: `/v3/users/7c0c0e2e24ad4a93b6c8a5e1a39ec563` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:05.240969 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeff9d5-8495-42a9-82e3-e15806c4f9fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c0c0e2e24ad4a93b6c8a5e1a39ec563)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:05.243505 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeff9d5-8495-42a9-82e3-e15806c4f9fd admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:05.266218 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1000/1985] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:29:05 2022] POST /identity/v3/users => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:29:05.270257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad8da0-59ad-4e99-bce0-798bcbdbf8db admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:05.275679 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-47ad8da0-59ad-4e99-bce0-798bcbdbf8db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:05.295130 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad8da0-59ad-4e99-bce0-798bcbdbf8db admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:05.301699 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb63d8-bd17-4801-92d6-d8d787d18a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:05.302840 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb63d8-bd17-4801-92d6-d8d787d18a31 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:05.303594 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb63d8-bd17-4801-92d6-d8d787d18a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:05.304267 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb63d8-bd17-4801-92d6-d8d787d18a31 admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:05.305154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb63d8-bd17-4801-92d6-d8d787d18a31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:05.308084 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb63d8-bd17-4801-92d6-d8d787d18a31 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:05.341566 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1001/1986] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:29:05 2022] POST /identity/v3/users => generated 300 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:29:05.343510 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb63d8-bd17-4801-92d6-d8d787d18a31 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:05.354103 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-7cfb63d8-bd17-4801-92d6-d8d787d18a31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:05.355368 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-aeeff9d5-8495-42a9-82e3-e15806c4f9fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c0c0e2e24ad4a93b6c8a5e1a39ec563'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:05.356451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-aeeff9d5-8495-42a9-82e3-e15806c4f9fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c0c0e2e24ad4a93b6c8a5e1a39ec563'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:05.375053 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=7 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:05.377037 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-aeeff9d5-8495-42a9-82e3-e15806c4f9fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c0c0e2e24ad4a93b6c8a5e1a39ec563'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:05.380725 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb63d8-bd17-4801-92d6-d8d787d18a31 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:05.399260 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-aeeff9d5-8495-42a9-82e3-e15806c4f9fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c0c0e2e24ad4a93b6c8a5e1a39ec563'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:05.400439 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244db82-d6af-4c23-b90c-abaf4d8c8f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:05.406614 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244db82-d6af-4c23-b90c-abaf4d8c8f6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:05.409309 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244db82-d6af-4c23-b90c-abaf4d8c8f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:05.410691 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244db82-d6af-4c23-b90c-abaf4d8c8f6c admin admin] PATH_INFO: `/v3/users/6586028d969a4e068d57801489c8715f` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:05.415596 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244db82-d6af-4c23-b90c-abaf4d8c8f6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6586028d969a4e068d57801489c8715f)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:05.422626 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244db82-d6af-4c23-b90c-abaf4d8c8f6c admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:05.423815 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-aeeff9d5-8495-42a9-82e3-e15806c4f9fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c0c0e2e24ad4a93b6c8a5e1a39ec563'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:05.464941 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 986/1987] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:29:04 2022] DELETE /identity/v3/users/7c0c0e2e24ad4a93b6c8a5e1a39ec563 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:05.467553 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeff9d5-8495-42a9-82e3-e15806c4f9fd admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:05.472604 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-aeeff9d5-8495-42a9-82e3-e15806c4f9fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:05.532230 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-1244db82-d6af-4c23-b90c-abaf4d8c8f6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6586028d969a4e068d57801489c8715f'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:05.534133 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-1244db82-d6af-4c23-b90c-abaf4d8c8f6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6586028d969a4e068d57801489c8715f'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:05.562970 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-1244db82-d6af-4c23-b90c-abaf4d8c8f6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6586028d969a4e068d57801489c8715f'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:05.576307 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-1244db82-d6af-4c23-b90c-abaf4d8c8f6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6586028d969a4e068d57801489c8715f'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:05.577543 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-1244db82-d6af-4c23-b90c-abaf4d8c8f6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6586028d969a4e068d57801489c8715f'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:05.630588 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1002/1988] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:29:05 2022] DELETE /identity/v3/users/6586028d969a4e068d57801489c8715f => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:05.633092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244db82-d6af-4c23-b90c-abaf4d8c8f6c admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:05.637722 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-1244db82-d6af-4c23-b90c-abaf4d8c8f6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:05.658832 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeff9d5-8495-42a9-82e3-e15806c4f9fd admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:05.757012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724182d-ffac-435c-91a0-ce23dc3ad3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:05.757920 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724182d-ffac-435c-91a0-ce23dc3ad3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:05.758360 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724182d-ffac-435c-91a0-ce23dc3ad3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:05.758735 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724182d-ffac-435c-91a0-ce23dc3ad3d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:05.759988 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f724182d-ffac-435c-91a0-ce23dc3ad3d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:05.761812 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f724182d-ffac-435c-91a0-ce23dc3ad3d6 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:05.771280 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:05.783076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 987/1989] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:29:05.786646 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ecf2c8-a422-400e-b12a-9a75b1f0f1d1 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:05.787473 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ecf2c8-a422-400e-b12a-9a75b1f0f1d1 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:05.787860 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ecf2c8-a422-400e-b12a-9a75b1f0f1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:05.822559 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-76ecf2c8-a422-400e-b12a-9a75b1f0f1d1 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:05.825063 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-76ecf2c8-a422-400e-b12a-9a75b1f0f1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:05.827920 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244db82-d6af-4c23-b90c-abaf4d8c8f6c admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:05.834777 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b107e8-1a2b-45dd-913a-154305ce4f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:05.835635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b107e8-1a2b-45dd-913a-154305ce4f9d admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:05.836015 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b107e8-1a2b-45dd-913a-154305ce4f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:05.836535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b107e8-1a2b-45dd-913a-154305ce4f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:05.837296 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b107e8-1a2b-45dd-913a-154305ce4f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:05.837955 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 988/1990] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:05.838938 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ecf2c8-a422-400e-b12a-9a75b1f0f1d1 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:05.840576 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-76ecf2c8-a422-400e-b12a-9a75b1f0f1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:05.843293 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b107e8-1a2b-45dd-913a-154305ce4f9d admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:05.860639 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1003/1991] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:29:05.860929 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ecf2c8-a422-400e-b12a-9a75b1f0f1d1 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:05.862769 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b107e8-1a2b-45dd-913a-154305ce4f9d admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:05.863442 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e16201-1e0c-4c1f-ae1f-6f2a0670dd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:05.864139 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e16201-1e0c-4c1f-ae1f-6f2a0670dd1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:05.864417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e16201-1e0c-4c1f-ae1f-6f2a0670dd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:05.864687 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e16201-1e0c-4c1f-ae1f-6f2a0670dd1a admin admin] PATH_INFO: `/v3/projects/f86e167eadf24e7197477df4f8aeefab/users/b3b778d907784e2d833d03ae4fc3d58a/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:05.875707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b107e8-1a2b-45dd-913a-154305ce4f9d admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:05.882059 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a58062-f62a-4a92-97a0-e6ea566716b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:05.883372 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a58062-f62a-4a92-97a0-e6ea566716b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:05.883762 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a58062-f62a-4a92-97a0-e6ea566716b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:05.884065 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e16201-1e0c-4c1f-ae1f-6f2a0670dd1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f86e167eadf24e7197477df4f8aeefab, user_id=b3b778d907784e2d833d03ae4fc3d58a, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:05.884265 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a58062-f62a-4a92-97a0-e6ea566716b6 admin admin] PATH_INFO: `/v3/projects/f2d874713dcb4a0882a014ee27f4ef87/users/db4cd838baed43339b8113bdb1c8dfa9/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:05.887404 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e16201-1e0c-4c1f-ae1f-6f2a0670dd1a admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:05.909498 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 989/1992] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:29:05 2022] PUT /identity/v3/projects/f86e167eadf24e7197477df4f8aeefab/users/b3b778d907784e2d833d03ae4fc3d58a/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:05.912290 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e16201-1e0c-4c1f-ae1f-6f2a0670dd1a admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:05.916054 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a58062-f62a-4a92-97a0-e6ea566716b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2d874713dcb4a0882a014ee27f4ef87, user_id=db4cd838baed43339b8113bdb1c8dfa9, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:05.921933 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a58062-f62a-4a92-97a0-e6ea566716b6 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:05.943925 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1004/1993] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:29:05 2022] PUT /identity/v3/projects/f2d874713dcb4a0882a014ee27f4ef87/users/db4cd838baed43339b8113bdb1c8dfa9/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:05.948045 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a58062-f62a-4a92-97a0-e6ea566716b6 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:06.013188 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e16201-1e0c-4c1f-ae1f-6f2a0670dd1a admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:06.020155 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:06.042742 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a58062-f62a-4a92-97a0-e6ea566716b6 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:06.050417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c453da-1bee-41ca-9890-84ce417a0fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:06.051302 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c453da-1bee-41ca-9890-84ce417a0fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:06.051751 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c453da-1bee-41ca-9890-84ce417a0fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:06.052254 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c453da-1bee-41ca-9890-84ce417a0fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:06.053712 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c453da-1bee-41ca-9890-84ce417a0fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:06.056275 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c453da-1bee-41ca-9890-84ce417a0fa1 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:06.080674 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1005/1994] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:29:06.082621 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c453da-1bee-41ca-9890-84ce417a0fa1 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:06.086394 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-a4c453da-1bee-41ca-9890-84ce417a0fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:06.121995 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bc41c-f3ba-4372-88b3-584f19e26add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:06.122952 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bc41c-f3ba-4372-88b3-584f19e26add admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:06.123283 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bc41c-f3ba-4372-88b3-584f19e26add admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:06.123554 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bc41c-f3ba-4372-88b3-584f19e26add admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:06.124234 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861bc41c-f3ba-4372-88b3-584f19e26add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:06.127080 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861bc41c-f3ba-4372-88b3-584f19e26add admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:06.146510 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 990/1995] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:29:06.147522 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bc41c-f3ba-4372-88b3-584f19e26add admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:06.171372 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bc41c-f3ba-4372-88b3-584f19e26add admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:06.183149 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a897f6-2dce-4e5b-8113-58b0fb204554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:06.183834 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a897f6-2dce-4e5b-8113-58b0fb204554 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:06.184115 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a897f6-2dce-4e5b-8113-58b0fb204554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:06.184578 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a897f6-2dce-4e5b-8113-58b0fb204554 admin admin] PATH_INFO: `/v3/projects/f2d874713dcb4a0882a014ee27f4ef87/users/db4cd838baed43339b8113bdb1c8dfa9/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:06.187712 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a897f6-2dce-4e5b-8113-58b0fb204554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2d874713dcb4a0882a014ee27f4ef87, user_id=db4cd838baed43339b8113bdb1c8dfa9, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:06.190985 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c453da-1bee-41ca-9890-84ce417a0fa1 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:06.191734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a897f6-2dce-4e5b-8113-58b0fb204554 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:06.195799 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed283e-1577-4e41-9895-6d752040a0f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:06.196909 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed283e-1577-4e41-9895-6d752040a0f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:06.197312 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed283e-1577-4e41-9895-6d752040a0f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:06.197796 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed283e-1577-4e41-9895-6d752040a0f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:06.207457 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 991/1996] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:29:06 2022] PUT /identity/v3/projects/f2d874713dcb4a0882a014ee27f4ef87/users/db4cd838baed43339b8113bdb1c8dfa9/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:06.208516 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a897f6-2dce-4e5b-8113-58b0fb204554 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:06.215562 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed283e-1577-4e41-9895-6d752040a0f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:06.219847 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed283e-1577-4e41-9895-6d752040a0f3 service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:06.234916 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1006/1997] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:06.236471 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bb730-c53b-41b0-a158-34a9c32b1c5e None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:06.237779 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bb730-c53b-41b0-a158-34a9c32b1c5e None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:06.238179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bb730-c53b-41b0-a158-34a9c32b1c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:06.276478 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-fb8bb730-c53b-41b0-a158-34a9c32b1c5e None None] MFA Rules not processed for user `db4cd838baed43339b8113bdb1c8dfa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:06.277918 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-fb8bb730-c53b-41b0-a158-34a9c32b1c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:06.293411 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a897f6-2dce-4e5b-8113-58b0fb204554 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:06.303398 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34540f44-98e4-4951-8c9b-bf7d6b4854f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:06.304103 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34540f44-98e4-4951-8c9b-bf7d6b4854f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:06.304436 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34540f44-98e4-4951-8c9b-bf7d6b4854f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:06.304716 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34540f44-98e4-4951-8c9b-bf7d6b4854f5 admin admin] PATH_INFO: `/v3/projects/f86e167eadf24e7197477df4f8aeefab/users/b3b778d907784e2d833d03ae4fc3d58a/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:06.307090 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34540f44-98e4-4951-8c9b-bf7d6b4854f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f86e167eadf24e7197477df4f8aeefab, user_id=b3b778d907784e2d833d03ae4fc3d58a, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:06.310965 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34540f44-98e4-4951-8c9b-bf7d6b4854f5 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:06.314178 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:06.333820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 992/1998] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:29:06 2022] PUT /identity/v3/projects/f86e167eadf24e7197477df4f8aeefab/users/b3b778d907784e2d833d03ae4fc3d58a/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:06.346550 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f7344-0a62-4627-bbce-353c5d9ea57d None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:06.347217 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f7344-0a62-4627-bbce-353c5d9ea57d None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:06.347819 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f7344-0a62-4627-bbce-353c5d9ea57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:06.411537 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-460f7344-0a62-4627-bbce-353c5d9ea57d None None] MFA Rules not processed for user `b3b778d907784e2d833d03ae4fc3d58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:06.413202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-460f7344-0a62-4627-bbce-353c5d9ea57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:06.415792 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1007/1999] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:06 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:06.430653 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bb730-c53b-41b0-a158-34a9c32b1c5e None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:06.436342 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-fb8bb730-c53b-41b0-a158-34a9c32b1c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:06.525499 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 993/2000] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:06 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:06.571405 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bb730-c53b-41b0-a158-34a9c32b1c5e None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:06.578921 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f7344-0a62-4627-bbce-353c5d9ea57d None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:06.580639 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-460f7344-0a62-4627-bbce-353c5d9ea57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:06.615005 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:06.661532 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d8015-2735-4a9b-b415-55a36d4b5e48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:06.662296 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d8015-2735-4a9b-b415-55a36d4b5e48 service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:06.662691 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d8015-2735-4a9b-b415-55a36d4b5e48 service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:06.663302 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d8015-2735-4a9b-b415-55a36d4b5e48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:06.670880 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f7344-0a62-4627-bbce-353c5d9ea57d None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:06.677050 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965c0cc-94c6-4ef9-bd19-ed451ccda857 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:06.678193 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965c0cc-94c6-4ef9-bd19-ed451ccda857 service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:06.678687 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965c0cc-94c6-4ef9-bd19-ed451ccda857 service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:06.679293 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965c0cc-94c6-4ef9-bd19-ed451ccda857 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:06.697077 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5965c0cc-94c6-4ef9-bd19-ed451ccda857 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:06.698800 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5965c0cc-94c6-4ef9-bd19-ed451ccda857 service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:06.722864 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 994/2001] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:06 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:29:06.805298 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d8015-2735-4a9b-b415-55a36d4b5e48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:06.811496 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d8015-2735-4a9b-b415-55a36d4b5e48 service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:06.827184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1008/2002] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:06 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:06.954385 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965c0cc-94c6-4ef9-bd19-ed451ccda857 service cinder] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:06.966695 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965c0cc-94c6-4ef9-bd19-ed451ccda857 service cinder] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:06.972541 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef15c1c-0167-4d46-ad26-689396e6980f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:06.973740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef15c1c-0167-4d46-ad26-689396e6980f service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:06.974348 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef15c1c-0167-4d46-ad26-689396e6980f service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:06.974625 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef15c1c-0167-4d46-ad26-689396e6980f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:06.977803 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-4ef15c1c-0167-4d46-ad26-689396e6980f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:07.099813 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef15c1c-0167-4d46-ad26-689396e6980f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:07.102896 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef15c1c-0167-4d46-ad26-689396e6980f service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:07.105197 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d8015-2735-4a9b-b415-55a36d4b5e48 service cinder] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:07.130588 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 995/2003] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:07.272408 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d8015-2735-4a9b-b415-55a36d4b5e48 service cinder] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:07.278220 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8ca7c-01a1-4cea-a07c-60cc62e838ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:07.279913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8ca7c-01a1-4cea-a07c-60cc62e838ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:07.280409 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8ca7c-01a1-4cea-a07c-60cc62e838ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:07.280887 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8ca7c-01a1-4cea-a07c-60cc62e838ed admin admin] PATH_INFO: `/v3/users/cc344b405eb4410896f1553362549023` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:07.282869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8ca7c-01a1-4cea-a07c-60cc62e838ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc344b405eb4410896f1553362549023)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:07.284689 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8ca7c-01a1-4cea-a07c-60cc62e838ed admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:07.377209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-11a8ca7c-01a1-4cea-a07c-60cc62e838ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc344b405eb4410896f1553362549023'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:07.378296 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-11a8ca7c-01a1-4cea-a07c-60cc62e838ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc344b405eb4410896f1553362549023'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:07.391417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-11a8ca7c-01a1-4cea-a07c-60cc62e838ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc344b405eb4410896f1553362549023'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:07.406387 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-11a8ca7c-01a1-4cea-a07c-60cc62e838ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc344b405eb4410896f1553362549023'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:07.407349 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-11a8ca7c-01a1-4cea-a07c-60cc62e838ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc344b405eb4410896f1553362549023'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:07.427449 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:07.440146 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1009/2004] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:29:07 2022] DELETE /identity/v3/users/cc344b405eb4410896f1553362549023 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:07.444623 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441b784-7a8b-49cf-ac96-b6f78953c7a9 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:07.445357 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441b784-7a8b-49cf-ac96-b6f78953c7a9 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:07.445852 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441b784-7a8b-49cf-ac96-b6f78953c7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:07.494502 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8ca7c-01a1-4cea-a07c-60cc62e838ed admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:07.498025 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-11a8ca7c-01a1-4cea-a07c-60cc62e838ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:07.500400 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-c441b784-7a8b-49cf-ac96-b6f78953c7a9 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:07.504428 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-c441b784-7a8b-49cf-ac96-b6f78953c7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:07.542402 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:07.631652 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8ca7c-01a1-4cea-a07c-60cc62e838ed admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:07.640489 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842e2e2-e556-4164-bfc2-ee735d292acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:07.642169 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842e2e2-e556-4164-bfc2-ee735d292acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:07.642169 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842e2e2-e556-4164-bfc2-ee735d292acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:07.642532 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842e2e2-e556-4164-bfc2-ee735d292acc admin admin] PATH_INFO: `/v3/projects/f3bb4940f15d43df80488270562f1559` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:07.644147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842e2e2-e556-4164-bfc2-ee735d292acc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3bb4940f15d43df80488270562f1559)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:07.647967 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842e2e2-e556-4164-bfc2-ee735d292acc admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:07.670201 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 996/2005] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:07.701992 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441b784-7a8b-49cf-ac96-b6f78953c7a9 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:07.704273 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-c441b784-7a8b-49cf-ac96-b6f78953c7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:07.799534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-3842e2e2-e556-4164-bfc2-ee735d292acc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3bb4940f15d43df80488270562f1559', 'request_id': 'req-3842e2e2-e556-4164-bfc2-ee735d292acc'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:07.831632 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-3842e2e2-e556-4164-bfc2-ee735d292acc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3bb4940f15d43df80488270562f1559', 'request_id': 'req-3842e2e2-e556-4164-bfc2-ee735d292acc'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:07.874692 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-3842e2e2-e556-4164-bfc2-ee735d292acc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3bb4940f15d43df80488270562f1559', 'request_id': 'req-3842e2e2-e556-4164-bfc2-ee735d292acc'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:07.905653 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-3842e2e2-e556-4164-bfc2-ee735d292acc admin admin] The token cache is being invalidate because project f3bb4940f15d43df80488270562f1559 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:29:07.906360 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-3842e2e2-e556-4164-bfc2-ee735d292acc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:07.907731 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-3842e2e2-e556-4164-bfc2-ee735d292acc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:07.908729 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441b784-7a8b-49cf-ac96-b6f78953c7a9 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:07.918712 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1010/2006] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:29:07 2022] DELETE /identity/v3/projects/f3bb4940f15d43df80488270562f1559 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:07.923102 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae8533-6a83-4665-b7e3-b1039cd0c632 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:07.923495 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae8533-6a83-4665-b7e3-b1039cd0c632 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:07.923810 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae8533-6a83-4665-b7e3-b1039cd0c632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:07.955182 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-d2ae8533-6a83-4665-b7e3-b1039cd0c632 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:07.957705 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-d2ae8533-6a83-4665-b7e3-b1039cd0c632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:08.072463 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1011/2007] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:08.074497 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae8533-6a83-4665-b7e3-b1039cd0c632 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:08.083920 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-d2ae8533-6a83-4665-b7e3-b1039cd0c632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:08.103054 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae8533-6a83-4665-b7e3-b1039cd0c632 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:08.115725 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1d4c4-2523-4433-8fcf-2ff7382e2554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:08.117559 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1d4c4-2523-4433-8fcf-2ff7382e2554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:08.117559 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1d4c4-2523-4433-8fcf-2ff7382e2554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:08.117559 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1d4c4-2523-4433-8fcf-2ff7382e2554 admin admin] PATH_INFO: `/v3/projects/0492e09f106249e3880c14ca111db9a8` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:08.120750 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1d4c4-2523-4433-8fcf-2ff7382e2554 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0492e09f106249e3880c14ca111db9a8)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:08.124240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1d4c4-2523-4433-8fcf-2ff7382e2554 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:08.127250 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a24e26-fe4a-4839-96e3-6f3d853fd0bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:08.130574 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a24e26-fe4a-4839-96e3-6f3d853fd0bb service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:08.131050 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a24e26-fe4a-4839-96e3-6f3d853fd0bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:08.131556 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a24e26-fe4a-4839-96e3-6f3d853fd0bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:08.150894 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-f6a24e26-fe4a-4839-96e3-6f3d853fd0bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:08.172204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:08.176074 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a24e26-fe4a-4839-96e3-6f3d853fd0bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:08.178274 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a24e26-fe4a-4839-96e3-6f3d853fd0bb service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:08.197875 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 997/2008] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:29:08.202778 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e96340-0a53-43d1-bfde-860b053aa7d2 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:08.204713 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e96340-0a53-43d1-bfde-860b053aa7d2 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:08.205292 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e96340-0a53-43d1-bfde-860b053aa7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:08.224934 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-b4e1d4c4-2523-4433-8fcf-2ff7382e2554 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0492e09f106249e3880c14ca111db9a8', 'request_id': 'req-b4e1d4c4-2523-4433-8fcf-2ff7382e2554'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:08.238922 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-70e96340-0a53-43d1-bfde-860b053aa7d2 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:08.241158 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-70e96340-0a53-43d1-bfde-860b053aa7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:08.243740 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-b4e1d4c4-2523-4433-8fcf-2ff7382e2554 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0492e09f106249e3880c14ca111db9a8', 'request_id': 'req-b4e1d4c4-2523-4433-8fcf-2ff7382e2554'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:08.259442 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-b4e1d4c4-2523-4433-8fcf-2ff7382e2554 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0492e09f106249e3880c14ca111db9a8', 'request_id': 'req-b4e1d4c4-2523-4433-8fcf-2ff7382e2554'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:08.276954 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-b4e1d4c4-2523-4433-8fcf-2ff7382e2554 admin admin] The token cache is being invalidate because project 0492e09f106249e3880c14ca111db9a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:29:08.277346 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-b4e1d4c4-2523-4433-8fcf-2ff7382e2554 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:08.278088 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-b4e1d4c4-2523-4433-8fcf-2ff7382e2554 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:08.281189 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1012/2009] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:29:08 2022] DELETE /identity/v3/projects/0492e09f106249e3880c14ca111db9a8 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:08.286351 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1d4c4-2523-4433-8fcf-2ff7382e2554 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:08.287901 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-b4e1d4c4-2523-4433-8fcf-2ff7382e2554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:08.390754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 998/2010] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:08.395033 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e96340-0a53-43d1-bfde-860b053aa7d2 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:08.422915 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e96340-0a53-43d1-bfde-860b053aa7d2 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:08.440887 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7251bb-6d6d-416b-9c69-19009c73b2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:08.441929 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7251bb-6d6d-416b-9c69-19009c73b2aa admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:08.442369 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7251bb-6d6d-416b-9c69-19009c73b2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:08.442823 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7251bb-6d6d-416b-9c69-19009c73b2aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:08.443666 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7251bb-6d6d-416b-9c69-19009c73b2aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:29:08.446382 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7251bb-6d6d-416b-9c69-19009c73b2aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:08.447208 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1d4c4-2523-4433-8fcf-2ff7382e2554 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:08.448532 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7251bb-6d6d-416b-9c69-19009c73b2aa admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:08.453429 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb980ba-9f68-41d4-a29d-1685b166ab23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:08.454156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb980ba-9f68-41d4-a29d-1685b166ab23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:08.454661 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb980ba-9f68-41d4-a29d-1685b166ab23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:08.455095 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb980ba-9f68-41d4-a29d-1685b166ab23 admin admin] PATH_INFO: `/v3/users/6a0e6556eb724d4bb2bf267e11a60696` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:08.458938 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb980ba-9f68-41d4-a29d-1685b166ab23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a0e6556eb724d4bb2bf267e11a60696)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:08.467031 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb980ba-9f68-41d4-a29d-1685b166ab23 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:08.485768 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 999/2011] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:29:08.489742 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7251bb-6d6d-416b-9c69-19009c73b2aa admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:08.510100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7251bb-6d6d-416b-9c69-19009c73b2aa admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:08.517752 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff56418-8519-4f9f-9fe6-cf91bbee5d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:08.518386 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff56418-8519-4f9f-9fe6-cf91bbee5d96 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:08.518671 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff56418-8519-4f9f-9fe6-cf91bbee5d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:08.518948 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff56418-8519-4f9f-9fe6-cf91bbee5d96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:08.519582 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff56418-8519-4f9f-9fe6-cf91bbee5d96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:08.521788 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff56418-8519-4f9f-9fe6-cf91bbee5d96 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:08.530284 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:08.569288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-ecb980ba-9f68-41d4-a29d-1685b166ab23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a0e6556eb724d4bb2bf267e11a60696'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:08.569758 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-ecb980ba-9f68-41d4-a29d-1685b166ab23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a0e6556eb724d4bb2bf267e11a60696'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:08.571557 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1000/2012] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:29:08 2022] POST /identity/v3/projects => generated 377 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:29:08.576638 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff56418-8519-4f9f-9fe6-cf91bbee5d96 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:08.578964 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-9ff56418-8519-4f9f-9fe6-cf91bbee5d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:08.596054 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-ecb980ba-9f68-41d4-a29d-1685b166ab23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a0e6556eb724d4bb2bf267e11a60696'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:08.609788 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-ecb980ba-9f68-41d4-a29d-1685b166ab23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a0e6556eb724d4bb2bf267e11a60696'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:08.610674 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-ecb980ba-9f68-41d4-a29d-1685b166ab23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a0e6556eb724d4bb2bf267e11a60696'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:08.655260 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1013/2013] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:29:08 2022] DELETE /identity/v3/users/6a0e6556eb724d4bb2bf267e11a60696 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:08.667780 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb980ba-9f68-41d4-a29d-1685b166ab23 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:08.672014 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-ecb980ba-9f68-41d4-a29d-1685b166ab23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:08.738444 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff56418-8519-4f9f-9fe6-cf91bbee5d96 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:08.793260 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:08.885561 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb08d6-4d1f-462e-80c0-aab68493419e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:08.886341 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb08d6-4d1f-462e-80c0-aab68493419e admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:08.886669 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb08d6-4d1f-462e-80c0-aab68493419e admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:08.886949 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb08d6-4d1f-462e-80c0-aab68493419e admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:08.888443 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb08d6-4d1f-462e-80c0-aab68493419e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:08.890928 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb08d6-4d1f-462e-80c0-aab68493419e admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:08.895345 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb980ba-9f68-41d4-a29d-1685b166ab23 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:08.910524 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926793dc-878b-49b0-a22f-6d14b8bbceef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:08.911191 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926793dc-878b-49b0-a22f-6d14b8bbceef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:08.911477 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926793dc-878b-49b0-a22f-6d14b8bbceef admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:08.911754 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926793dc-878b-49b0-a22f-6d14b8bbceef admin admin] PATH_INFO: `/v3/projects/bd397c910d844607870d442a81fd1cf7` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:08.914611 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926793dc-878b-49b0-a22f-6d14b8bbceef admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd397c910d844607870d442a81fd1cf7)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:08.918223 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926793dc-878b-49b0-a22f-6d14b8bbceef admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:08.964509 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1001/2014] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:29:08 2022] POST /identity/v3/users => generated 289 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:29:08.973123 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb08d6-4d1f-462e-80c0-aab68493419e admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:09.000347 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb08d6-4d1f-462e-80c0-aab68493419e admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:09.016448 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b50a0c-a82f-4e2b-9b67-185fd2eea042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:09.017611 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b50a0c-a82f-4e2b-9b67-185fd2eea042 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:09.018165 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b50a0c-a82f-4e2b-9b67-185fd2eea042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:09.018666 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b50a0c-a82f-4e2b-9b67-185fd2eea042 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:09.019556 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b50a0c-a82f-4e2b-9b67-185fd2eea042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:09.026445 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b50a0c-a82f-4e2b-9b67-185fd2eea042 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:09.060871 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1002/2015] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:29:09.062288 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b50a0c-a82f-4e2b-9b67-185fd2eea042 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:09.066267 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-926793dc-878b-49b0-a22f-6d14b8bbceef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd397c910d844607870d442a81fd1cf7', 'request_id': 'req-926793dc-878b-49b0-a22f-6d14b8bbceef'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:09.080655 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-926793dc-878b-49b0-a22f-6d14b8bbceef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd397c910d844607870d442a81fd1cf7', 'request_id': 'req-926793dc-878b-49b0-a22f-6d14b8bbceef'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:09.087180 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b50a0c-a82f-4e2b-9b67-185fd2eea042 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:09.098543 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-926793dc-878b-49b0-a22f-6d14b8bbceef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd397c910d844607870d442a81fd1cf7', 'request_id': 'req-926793dc-878b-49b0-a22f-6d14b8bbceef'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:09.120122 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-926793dc-878b-49b0-a22f-6d14b8bbceef admin admin] The token cache is being invalidate because project bd397c910d844607870d442a81fd1cf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:29:09.120817 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-926793dc-878b-49b0-a22f-6d14b8bbceef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:09.121348 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-926793dc-878b-49b0-a22f-6d14b8bbceef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:09.123787 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1014/2016] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:29:08 2022] DELETE /identity/v3/projects/bd397c910d844607870d442a81fd1cf7 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:09.128049 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926793dc-878b-49b0-a22f-6d14b8bbceef admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:09.129719 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-926793dc-878b-49b0-a22f-6d14b8bbceef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:09.253667 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248885f-8df3-43d2-9b02-7d61939f7bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:09.254333 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248885f-8df3-43d2-9b02-7d61939f7bcd admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:09.254621 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248885f-8df3-43d2-9b02-7d61939f7bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:09.254895 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248885f-8df3-43d2-9b02-7d61939f7bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:09.255566 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248885f-8df3-43d2-9b02-7d61939f7bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:09.264020 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248885f-8df3-43d2-9b02-7d61939f7bcd admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:09.271814 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926793dc-878b-49b0-a22f-6d14b8bbceef admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:09.289208 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4380b-80de-4c08-859b-49451d969d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:09.299578 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1003/2017] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:29:09.300761 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248885f-8df3-43d2-9b02-7d61939f7bcd admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:09.304373 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4380b-80de-4c08-859b-49451d969d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:09.304948 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4380b-80de-4c08-859b-49451d969d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:09.305493 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4380b-80de-4c08-859b-49451d969d64 admin admin] PATH_INFO: `/v3/users/db4cd838baed43339b8113bdb1c8dfa9` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:09.311532 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-3248885f-8df3-43d2-9b02-7d61939f7bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:09.325586 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4380b-80de-4c08-859b-49451d969d64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db4cd838baed43339b8113bdb1c8dfa9)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:09.330121 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4380b-80de-4c08-859b-49451d969d64 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:09.341702 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248885f-8df3-43d2-9b02-7d61939f7bcd admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:09.370505 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d073e1-f47f-4839-9098-5c7e4d949c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:09.371805 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d073e1-f47f-4839-9098-5c7e4d949c96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:09.376575 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d073e1-f47f-4839-9098-5c7e4d949c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:09.377287 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d073e1-f47f-4839-9098-5c7e4d949c96 admin admin] PATH_INFO: `/v3/projects/0d3f1bf003484ae4987e71ff4c3c6dd7/users/2e4e3cf7677549f090b87760b512f4da/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:09.385152 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:09.452178 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d073e1-f47f-4839-9098-5c7e4d949c96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d3f1bf003484ae4987e71ff4c3c6dd7, user_id=2e4e3cf7677549f090b87760b512f4da, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:09.462667 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d073e1-f47f-4839-9098-5c7e4d949c96 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:09.502424 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1004/2018] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:29:09 2022] PUT /identity/v3/projects/0d3f1bf003484ae4987e71ff4c3c6dd7/users/2e4e3cf7677549f090b87760b512f4da/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:09.518172 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-92c4380b-80de-4c08-859b-49451d969d64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db4cd838baed43339b8113bdb1c8dfa9'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:09.521696 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-92c4380b-80de-4c08-859b-49451d969d64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db4cd838baed43339b8113bdb1c8dfa9'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:09.532475 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab93bc0-bb06-40a8-b5fc-8d1bef2a59be None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:09.534611 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab93bc0-bb06-40a8-b5fc-8d1bef2a59be None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:09.536208 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab93bc0-bb06-40a8-b5fc-8d1bef2a59be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:09.558078 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-92c4380b-80de-4c08-859b-49451d969d64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db4cd838baed43339b8113bdb1c8dfa9'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:09.584113 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-92c4380b-80de-4c08-859b-49451d969d64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db4cd838baed43339b8113bdb1c8dfa9'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:09.586427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-92c4380b-80de-4c08-859b-49451d969d64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db4cd838baed43339b8113bdb1c8dfa9'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:09.589727 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:09.628083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-bab93bc0-bb06-40a8-b5fc-8d1bef2a59be None None] MFA Rules not processed for user `2e4e3cf7677549f090b87760b512f4da`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:09.633390 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-bab93bc0-bb06-40a8-b5fc-8d1bef2a59be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:09.642237 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1015/2019] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:29:09 2022] DELETE /identity/v3/users/db4cd838baed43339b8113bdb1c8dfa9 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:09.799385 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1005/2020] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:09.802218 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4380b-80de-4c08-859b-49451d969d64 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:09.804545 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-92c4380b-80de-4c08-859b-49451d969d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:09.952583 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4380b-80de-4c08-859b-49451d969d64 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:09.959821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d214d3-eb61-4b6e-8dcf-745451a547f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:09.960877 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d214d3-eb61-4b6e-8dcf-745451a547f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:09.961477 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d214d3-eb61-4b6e-8dcf-745451a547f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:09.962034 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d214d3-eb61-4b6e-8dcf-745451a547f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:09.963258 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d214d3-eb61-4b6e-8dcf-745451a547f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:09.968843 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d214d3-eb61-4b6e-8dcf-745451a547f6 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:10.017803 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1016/2021] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:29:09 2022] POST /identity/v3/projects => generated 377 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:29:10.022200 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab93bc0-bb06-40a8-b5fc-8d1bef2a59be None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:10.164258 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab93bc0-bb06-40a8-b5fc-8d1bef2a59be None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:10.305012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1d92e-ae6f-41a2-8c5c-016f9cea2f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:10.305644 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1d92e-ae6f-41a2-8c5c-016f9cea2f24 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:10.306123 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1d92e-ae6f-41a2-8c5c-016f9cea2f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:10.306887 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1d92e-ae6f-41a2-8c5c-016f9cea2f24 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:10.308249 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1d92e-ae6f-41a2-8c5c-016f9cea2f24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:10.311359 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1d92e-ae6f-41a2-8c5c-016f9cea2f24 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:10.343744 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1006/2022] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:29:10 2022] POST /identity/v3/users => generated 289 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:29:10.344974 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d214d3-eb61-4b6e-8dcf-745451a547f6 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:10.361292 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d214d3-eb61-4b6e-8dcf-745451a547f6 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:10.367086 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2c609-e1b2-4bb0-b178-dbc16e2ea938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:10.368823 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2c609-e1b2-4bb0-b178-dbc16e2ea938 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:10.369104 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2c609-e1b2-4bb0-b178-dbc16e2ea938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:10.369583 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2c609-e1b2-4bb0-b178-dbc16e2ea938 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:10.370333 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2c609-e1b2-4bb0-b178-dbc16e2ea938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:10.373510 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2c609-e1b2-4bb0-b178-dbc16e2ea938 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:10.398587 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1017/2023] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:29:10.400342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1d92e-ae6f-41a2-8c5c-016f9cea2f24 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:10.424329 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1d92e-ae6f-41a2-8c5c-016f9cea2f24 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:10.433572 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5f5a9-9e69-49da-958d-d16f8f6c0c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:10.435238 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5f5a9-9e69-49da-958d-d16f8f6c0c05 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:10.435533 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5f5a9-9e69-49da-958d-d16f8f6c0c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:10.435805 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5f5a9-9e69-49da-958d-d16f8f6c0c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:10.436607 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5f5a9-9e69-49da-958d-d16f8f6c0c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:10.439977 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5f5a9-9e69-49da-958d-d16f8f6c0c05 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:10.444724 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:10.466622 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1007/2024] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:29:10.474697 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2c609-e1b2-4bb0-b178-dbc16e2ea938 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:10.500135 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2c609-e1b2-4bb0-b178-dbc16e2ea938 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:10.509574 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ce7df-524d-4eb7-85ad-e15a66db9a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:10.510791 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ce7df-524d-4eb7-85ad-e15a66db9a92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:10.511557 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ce7df-524d-4eb7-85ad-e15a66db9a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:10.512064 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ce7df-524d-4eb7-85ad-e15a66db9a92 admin admin] PATH_INFO: `/v3/projects/44b4d1727c0842fea532267b29d89520/users/44302b2883544e3fbdb019b3d2302c68/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:10.574280 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ce7df-524d-4eb7-85ad-e15a66db9a92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44b4d1727c0842fea532267b29d89520, user_id=44302b2883544e3fbdb019b3d2302c68, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:10.584626 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ce7df-524d-4eb7-85ad-e15a66db9a92 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:10.638868 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1018/2025] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:29:10 2022] PUT /identity/v3/projects/44b4d1727c0842fea532267b29d89520/users/44302b2883544e3fbdb019b3d2302c68/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:10.643773 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c5c90-a159-4235-b366-7a3b37699845 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:10.644596 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c5c90-a159-4235-b366-7a3b37699845 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:10.645633 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c5c90-a159-4235-b366-7a3b37699845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:10.748568 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-ba4c5c90-a159-4235-b366-7a3b37699845 None None] MFA Rules not processed for user `44302b2883544e3fbdb019b3d2302c68`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:10.750447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-ba4c5c90-a159-4235-b366-7a3b37699845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:10.803997 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ce7df-524d-4eb7-85ad-e15a66db9a92 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:10.806805 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-714ce7df-524d-4eb7-85ad-e15a66db9a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:10.970413 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1008/2026] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:10.976796 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c5c90-a159-4235-b366-7a3b37699845 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:11.066257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ce7df-524d-4eb7-85ad-e15a66db9a92 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:11.090336 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320c96b-9414-422e-846b-63029cc5faf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:11.092566 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320c96b-9414-422e-846b-63029cc5faf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:11.093084 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320c96b-9414-422e-846b-63029cc5faf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:11.095814 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320c96b-9414-422e-846b-63029cc5faf2 admin admin] PATH_INFO: `/v3/projects/33867fe2beca4f7991a66909bb831166` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:11.100088 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320c96b-9414-422e-846b-63029cc5faf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33867fe2beca4f7991a66909bb831166)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:11.103698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320c96b-9414-422e-846b-63029cc5faf2 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:11.115081 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c5c90-a159-4235-b366-7a3b37699845 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:11.140437 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ebdca-15d5-4b63-a910-2f7f40102253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:11.141640 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ebdca-15d5-4b63-a910-2f7f40102253 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:11.142396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ebdca-15d5-4b63-a910-2f7f40102253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:11.142831 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ebdca-15d5-4b63-a910-2f7f40102253 admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:11.143628 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ebdca-15d5-4b63-a910-2f7f40102253 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:11.146086 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ebdca-15d5-4b63-a910-2f7f40102253 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:11.215609 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1009/2027] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:29:10 2022] POST /identity/v3/projects => generated 371 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:29:11.222222 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ebdca-15d5-4b63-a910-2f7f40102253 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:11.275098 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:11.315841 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f320c96b-9414-422e-846b-63029cc5faf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33867fe2beca4f7991a66909bb831166', 'request_id': 'req-f320c96b-9414-422e-846b-63029cc5faf2'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:11.326850 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f320c96b-9414-422e-846b-63029cc5faf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33867fe2beca4f7991a66909bb831166', 'request_id': 'req-f320c96b-9414-422e-846b-63029cc5faf2'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:11.342444 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f320c96b-9414-422e-846b-63029cc5faf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33867fe2beca4f7991a66909bb831166', 'request_id': 'req-f320c96b-9414-422e-846b-63029cc5faf2'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:11.353954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ebdca-15d5-4b63-a910-2f7f40102253 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:11.370495 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f320c96b-9414-422e-846b-63029cc5faf2 admin admin] The token cache is being invalidate because project 33867fe2beca4f7991a66909bb831166 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:29:11.371203 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f320c96b-9414-422e-846b-63029cc5faf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:11.371720 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f320c96b-9414-422e-846b-63029cc5faf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:11.381445 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1019/2028] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:29:10 2022] DELETE /identity/v3/projects/33867fe2beca4f7991a66909bb831166 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:11.386473 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03aa02d-389d-42d1-b6fc-dce0ae75ef0e None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:11.387145 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03aa02d-389d-42d1-b6fc-dce0ae75ef0e None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:11.388689 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03aa02d-389d-42d1-b6fc-dce0ae75ef0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:11.405829 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:11.447242 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-b03aa02d-389d-42d1-b6fc-dce0ae75ef0e None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:11.449025 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-b03aa02d-389d-42d1-b6fc-dce0ae75ef0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:11.511383 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6674f2d-bcaf-4d52-8d45-3d9dd4c7e3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:11.512036 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6674f2d-bcaf-4d52-8d45-3d9dd4c7e3a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:11.512398 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6674f2d-bcaf-4d52-8d45-3d9dd4c7e3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:11.513454 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6674f2d-bcaf-4d52-8d45-3d9dd4c7e3a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:11.514472 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6674f2d-bcaf-4d52-8d45-3d9dd4c7e3a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:11.517583 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6674f2d-bcaf-4d52-8d45-3d9dd4c7e3a2 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:11.571149 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1010/2029] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:29:11 2022] POST /identity/v3/users => generated 292 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:29:11.572224 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6674f2d-bcaf-4d52-8d45-3d9dd4c7e3a2 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:11.577891 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-e6674f2d-bcaf-4d52-8d45-3d9dd4c7e3a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:11.599444 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1020/2030] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:11.607399 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084fbaf-5428-4122-a99a-37468a2daf86 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:11.607880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084fbaf-5428-4122-a99a-37468a2daf86 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:11.610929 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084fbaf-5428-4122-a99a-37468a2daf86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:11.614133 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6674f2d-bcaf-4d52-8d45-3d9dd4c7e3a2 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:11.628857 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caaf6c0-0553-492c-8dd6-6c13d298726b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:11.629699 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caaf6c0-0553-492c-8dd6-6c13d298726b admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:11.632309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caaf6c0-0553-492c-8dd6-6c13d298726b admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:11.632755 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caaf6c0-0553-492c-8dd6-6c13d298726b admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:11.633586 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caaf6c0-0553-492c-8dd6-6c13d298726b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:11.640128 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caaf6c0-0553-492c-8dd6-6c13d298726b admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:11.652709 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-4084fbaf-5428-4122-a99a-37468a2daf86 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:11.654567 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-4084fbaf-5428-4122-a99a-37468a2daf86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:11.662333 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1011/2031] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:29:11.666682 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caaf6c0-0553-492c-8dd6-6c13d298726b admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:11.678598 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1021/2032] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:11.682426 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084fbaf-5428-4122-a99a-37468a2daf86 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:11.683494 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caaf6c0-0553-492c-8dd6-6c13d298726b admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:11.691109 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4868a-39ca-4bc1-bcaf-ad2c6c1ec8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:11.691899 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4868a-39ca-4bc1-bcaf-ad2c6c1ec8d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:11.692270 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4868a-39ca-4bc1-bcaf-ad2c6c1ec8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:11.692612 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4868a-39ca-4bc1-bcaf-ad2c6c1ec8d4 admin admin] PATH_INFO: `/v3/projects/7099441bd0e744c0be8c12de1ff8b484/users/8a4c674c94ab4169998209a5cd04a985/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:11.712428 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084fbaf-5428-4122-a99a-37468a2daf86 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:11.742397 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f52994-be31-483f-943c-b33a79238609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:11.743037 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f52994-be31-483f-943c-b33a79238609 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:11.743325 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f52994-be31-483f-943c-b33a79238609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:11.743594 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f52994-be31-483f-943c-b33a79238609 admin admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:11.744324 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f52994-be31-483f-943c-b33a79238609 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:29:11.744636 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f52994-be31-483f-943c-b33a79238609 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:11.745716 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad4868a-39ca-4bc1-bcaf-ad2c6c1ec8d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7099441bd0e744c0be8c12de1ff8b484, user_id=8a4c674c94ab4169998209a5cd04a985, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:11.746599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f52994-be31-483f-943c-b33a79238609 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:11.756737 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad4868a-39ca-4bc1-bcaf-ad2c6c1ec8d4 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:11.768117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1022/2033] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:29:11.769780 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f52994-be31-483f-943c-b33a79238609 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:11.793080 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f52994-be31-483f-943c-b33a79238609 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:11.799327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1012/2034] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:29:11 2022] PUT /identity/v3/projects/7099441bd0e744c0be8c12de1ff8b484/users/8a4c674c94ab4169998209a5cd04a985/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:11.802794 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4868a-39ca-4bc1-bcaf-ad2c6c1ec8d4 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:11.963106 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4868a-39ca-4bc1-bcaf-ad2c6c1ec8d4 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:11.976805 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a201b-790f-4400-b7f9-7dc763fec2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:11.993575 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a201b-790f-4400-b7f9-7dc763fec2e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:11.996858 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a201b-790f-4400-b7f9-7dc763fec2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:12.001106 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a201b-790f-4400-b7f9-7dc763fec2e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:12.001992 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a201b-790f-4400-b7f9-7dc763fec2e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:12.002204 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f4691-3254-4865-9108-2873e9d1216e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:12.003628 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f4691-3254-4865-9108-2873e9d1216e admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:12.003628 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f4691-3254-4865-9108-2873e9d1216e admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:12.006716 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f4691-3254-4865-9108-2873e9d1216e admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:12.008000 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f4691-3254-4865-9108-2873e9d1216e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:12.009561 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a201b-790f-4400-b7f9-7dc763fec2e8 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:12.014492 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f4691-3254-4865-9108-2873e9d1216e admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:12.041142 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1013/2035] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:29:12.044163 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f4691-3254-4865-9108-2873e9d1216e admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:12.049558 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-7d3f4691-3254-4865-9108-2873e9d1216e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:12.069048 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f4691-3254-4865-9108-2873e9d1216e admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:12.085305 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911e5e2-b53a-4eed-adf4-1dec314f9f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:12.088231 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911e5e2-b53a-4eed-adf4-1dec314f9f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:12.088818 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911e5e2-b53a-4eed-adf4-1dec314f9f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:12.089245 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911e5e2-b53a-4eed-adf4-1dec314f9f18 admin admin] PATH_INFO: `/v3/projects/f2d874713dcb4a0882a014ee27f4ef87` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:12.092126 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911e5e2-b53a-4eed-adf4-1dec314f9f18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2d874713dcb4a0882a014ee27f4ef87)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:12.096236 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911e5e2-b53a-4eed-adf4-1dec314f9f18 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:12.110130 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1023/2036] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:29:11 2022] POST /identity/v3/projects => generated 375 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:29:12.113682 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a201b-790f-4400-b7f9-7dc763fec2e8 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:12.184600 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:12.223911 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-7911e5e2-b53a-4eed-adf4-1dec314f9f18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2d874713dcb4a0882a014ee27f4ef87', 'request_id': 'req-7911e5e2-b53a-4eed-adf4-1dec314f9f18'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:12.238351 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-7911e5e2-b53a-4eed-adf4-1dec314f9f18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2d874713dcb4a0882a014ee27f4ef87', 'request_id': 'req-7911e5e2-b53a-4eed-adf4-1dec314f9f18'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:12.255117 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-7911e5e2-b53a-4eed-adf4-1dec314f9f18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2d874713dcb4a0882a014ee27f4ef87', 'request_id': 'req-7911e5e2-b53a-4eed-adf4-1dec314f9f18'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:12.258163 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:12.289557 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-7911e5e2-b53a-4eed-adf4-1dec314f9f18 admin admin] The token cache is being invalidate because project f2d874713dcb4a0882a014ee27f4ef87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:29:12.290081 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-7911e5e2-b53a-4eed-adf4-1dec314f9f18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:12.291416 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-7911e5e2-b53a-4eed-adf4-1dec314f9f18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:12.295070 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1014/2037] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:29:12 2022] DELETE /identity/v3/projects/f2d874713dcb4a0882a014ee27f4ef87 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:12.302736 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911e5e2-b53a-4eed-adf4-1dec314f9f18 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:12.308389 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a201b-790f-4400-b7f9-7dc763fec2e8 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:12.312605 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-7911e5e2-b53a-4eed-adf4-1dec314f9f18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:12.512021 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911e5e2-b53a-4eed-adf4-1dec314f9f18 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:12.522319 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b2ddb-c0f2-4d35-bfb0-73242f6ea494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:12.523137 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b2ddb-c0f2-4d35-bfb0-73242f6ea494 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:12.523363 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b2ddb-c0f2-4d35-bfb0-73242f6ea494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:12.523674 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b2ddb-c0f2-4d35-bfb0-73242f6ea494 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:12.538984 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b2ddb-c0f2-4d35-bfb0-73242f6ea494 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:12.541435 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b2ddb-c0f2-4d35-bfb0-73242f6ea494 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:12.574825 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6cb3e-4f2b-4b3b-98a6-7a15ec57e4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:12.576646 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6cb3e-4f2b-4b3b-98a6-7a15ec57e4c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:12.577578 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6cb3e-4f2b-4b3b-98a6-7a15ec57e4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:12.577946 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6cb3e-4f2b-4b3b-98a6-7a15ec57e4c9 admin admin] PATH_INFO: `/v3/projects/7099441bd0e744c0be8c12de1ff8b484/users/8a4c674c94ab4169998209a5cd04a985/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:12.580580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6cb3e-4f2b-4b3b-98a6-7a15ec57e4c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7099441bd0e744c0be8c12de1ff8b484, user_id=8a4c674c94ab4169998209a5cd04a985, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:12.584417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6cb3e-4f2b-4b3b-98a6-7a15ec57e4c9 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:12.598350 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1015/2038] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:29:12 2022] POST /identity/v3/users => generated 288 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:29:12.599790 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee78143-7b7d-4955-8b78-bc2bffbeb73f None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:12.600542 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee78143-7b7d-4955-8b78-bc2bffbeb73f None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:12.600925 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee78143-7b7d-4955-8b78-bc2bffbeb73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:12.621461 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1024/2039] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:29:12 2022] PUT /identity/v3/projects/7099441bd0e744c0be8c12de1ff8b484/users/8a4c674c94ab4169998209a5cd04a985/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:12.624933 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6cb3e-4f2b-4b3b-98a6-7a15ec57e4c9 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:12.636954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-4ee78143-7b7d-4955-8b78-bc2bffbeb73f None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:12.641063 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-4ee78143-7b7d-4955-8b78-bc2bffbeb73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:12.744451 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6cb3e-4f2b-4b3b-98a6-7a15ec57e4c9 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:12.750659 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abda80-88c3-4316-8dc3-9228c89979fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:12.751453 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abda80-88c3-4316-8dc3-9228c89979fe admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:12.751896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abda80-88c3-4316-8dc3-9228c89979fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:12.752254 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abda80-88c3-4316-8dc3-9228c89979fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:12.753009 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28abda80-88c3-4316-8dc3-9228c89979fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:12.754991 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28abda80-88c3-4316-8dc3-9228c89979fe admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:12.776600 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1025/2040] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:29:12.776600 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9541a-7ccd-4d45-bb6f-6421942d5538 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:12.776600 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9541a-7ccd-4d45-bb6f-6421942d5538 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:12.776600 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9541a-7ccd-4d45-bb6f-6421942d5538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:12.800110 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1016/2041] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:12.803715 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee78143-7b7d-4955-8b78-bc2bffbeb73f None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:12.830083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee78143-7b7d-4955-8b78-bc2bffbeb73f None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:12.836951 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28d325-9f90-42d7-8540-0e43b8493509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:12.837619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28d325-9f90-42d7-8540-0e43b8493509 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:12.837904 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28d325-9f90-42d7-8540-0e43b8493509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:12.838229 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28d325-9f90-42d7-8540-0e43b8493509 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:12.839026 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28d325-9f90-42d7-8540-0e43b8493509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:12.841809 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28d325-9f90-42d7-8540-0e43b8493509 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:12.843888 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-4bc9541a-7ccd-4d45-bb6f-6421942d5538 None None] MFA Rules not processed for user `8a4c674c94ab4169998209a5cd04a985`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:12.846853 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-4bc9541a-7ccd-4d45-bb6f-6421942d5538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:12.856883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1017/2042] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:29:12.858157 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfd4e4-509e-4ad5-9a2b-a20ecb5cec6e None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:12.858514 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfd4e4-509e-4ad5-9a2b-a20ecb5cec6e None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:12.859056 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfd4e4-509e-4ad5-9a2b-a20ecb5cec6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:12.894720 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-32dfd4e4-509e-4ad5-9a2b-a20ecb5cec6e None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:12.896996 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-32dfd4e4-509e-4ad5-9a2b-a20ecb5cec6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:12.915917 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1018/2043] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:12.915917 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfd4e4-509e-4ad5-9a2b-a20ecb5cec6e None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:12.930580 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfd4e4-509e-4ad5-9a2b-a20ecb5cec6e None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:12.930950 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:12.937931 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648821c-a706-4a1a-8aab-8bb697fd0b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:12.938638 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648821c-a706-4a1a-8aab-8bb697fd0b94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:12.938923 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648821c-a706-4a1a-8aab-8bb697fd0b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:12.939193 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648821c-a706-4a1a-8aab-8bb697fd0b94 admin admin] PATH_INFO: `/v3/projects/f653d5964b0e47fb91c82e1fbf70060e/users/d3713f3c1fcf4d7caa0c2b0bb6069742/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:12.960991 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648821c-a706-4a1a-8aab-8bb697fd0b94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f653d5964b0e47fb91c82e1fbf70060e, user_id=d3713f3c1fcf4d7caa0c2b0bb6069742, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:12.965092 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648821c-a706-4a1a-8aab-8bb697fd0b94 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:12.973630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1026/2044] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:12.974903 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9541a-7ccd-4d45-bb6f-6421942d5538 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:12.990187 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1019/2045] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:29:12 2022] PUT /identity/v3/projects/f653d5964b0e47fb91c82e1fbf70060e/users/d3713f3c1fcf4d7caa0c2b0bb6069742/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:12.990187 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648821c-a706-4a1a-8aab-8bb697fd0b94 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:12.990187 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-1648821c-a706-4a1a-8aab-8bb697fd0b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:13.005970 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9541a-7ccd-4d45-bb6f-6421942d5538 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:13.116704 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:13.132453 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bc1ef-ad5c-4991-8ae9-4b101da8d879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:13.133429 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bc1ef-ad5c-4991-8ae9-4b101da8d879 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:13.133934 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bc1ef-ad5c-4991-8ae9-4b101da8d879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:13.134277 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bc1ef-ad5c-4991-8ae9-4b101da8d879 admin admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:13.135064 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13bc1ef-ad5c-4991-8ae9-4b101da8d879 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:29:13.135447 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13bc1ef-ad5c-4991-8ae9-4b101da8d879 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:13.137488 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13bc1ef-ad5c-4991-8ae9-4b101da8d879 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:13.149055 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648821c-a706-4a1a-8aab-8bb697fd0b94 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:13.155481 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff34e3-bb2d-4417-acc9-77f14b926409 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:13.156536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff34e3-bb2d-4417-acc9-77f14b926409 service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:13.157232 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff34e3-bb2d-4417-acc9-77f14b926409 service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:13.157703 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff34e3-bb2d-4417-acc9-77f14b926409 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:13.160850 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-3fff34e3-bb2d-4417-acc9-77f14b926409 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:13.161852 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1027/2046] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:29:13.169529 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a6271-be9d-41e0-a4b5-c3ae7d22abc5 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:13.170100 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a6271-be9d-41e0-a4b5-c3ae7d22abc5 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:13.170650 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a6271-be9d-41e0-a4b5-c3ae7d22abc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:13.242133 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-c29a6271-be9d-41e0-a4b5-c3ae7d22abc5 None None] MFA Rules not processed for user `d3713f3c1fcf4d7caa0c2b0bb6069742`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:13.246390 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-c29a6271-be9d-41e0-a4b5-c3ae7d22abc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:13.286309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff34e3-bb2d-4417-acc9-77f14b926409 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:13.288156 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff34e3-bb2d-4417-acc9-77f14b926409 service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:13.305912 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1020/2047] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:13.307466 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff34e3-bb2d-4417-acc9-77f14b926409 service cinder] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:13.323982 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff34e3-bb2d-4417-acc9-77f14b926409 service cinder] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:13.332366 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e793c-837f-45da-975e-c3e60bb914c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:13.333544 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e793c-837f-45da-975e-c3e60bb914c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:13.334311 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e793c-837f-45da-975e-c3e60bb914c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:13.334783 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e793c-837f-45da-975e-c3e60bb914c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:13.335730 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e793c-837f-45da-975e-c3e60bb914c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:13.341144 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e793c-837f-45da-975e-c3e60bb914c1 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:13.392519 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1028/2048] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:13.400417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1021/2049] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:29:13 2022] POST /identity/v3/projects => generated 369 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:29:13.408850 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a6271-be9d-41e0-a4b5-c3ae7d22abc5 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:13.411130 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-c29a6271-be9d-41e0-a4b5-c3ae7d22abc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:13.411692 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e793c-837f-45da-975e-c3e60bb914c1 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:13.522107 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e793c-837f-45da-975e-c3e60bb914c1 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:13.542200 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92506246-c8d1-41c6-93ba-8d564dedb26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:13.542856 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92506246-c8d1-41c6-93ba-8d564dedb26c admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:13.543185 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92506246-c8d1-41c6-93ba-8d564dedb26c admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:13.546529 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92506246-c8d1-41c6-93ba-8d564dedb26c admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:13.548523 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92506246-c8d1-41c6-93ba-8d564dedb26c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:13.552748 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92506246-c8d1-41c6-93ba-8d564dedb26c admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:13.557839 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a6271-be9d-41e0-a4b5-c3ae7d22abc5 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:13.584746 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:13.594418 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1022/2050] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:29:13 2022] POST /identity/v3/users => generated 285 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:29:13.602175 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92506246-c8d1-41c6-93ba-8d564dedb26c admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:13.626281 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92506246-c8d1-41c6-93ba-8d564dedb26c admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:13.634219 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec87f2-6da5-4572-9820-a8993749db2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:13.635261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec87f2-6da5-4572-9820-a8993749db2a admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:13.635545 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec87f2-6da5-4572-9820-a8993749db2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:13.635815 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec87f2-6da5-4572-9820-a8993749db2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:13.636573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec87f2-6da5-4572-9820-a8993749db2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:13.638630 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec87f2-6da5-4572-9820-a8993749db2a admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:13.656602 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1023/2051] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:29:13.657591 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec87f2-6da5-4572-9820-a8993749db2a admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:13.672452 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec87f2-6da5-4572-9820-a8993749db2a admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:13.678057 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e04a60-e813-4454-bf75-9d4df8decc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:13.678481 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e04a60-e813-4454-bf75-9d4df8decc36 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:13.678769 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e04a60-e813-4454-bf75-9d4df8decc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:13.679013 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e04a60-e813-4454-bf75-9d4df8decc36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:13.679816 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e04a60-e813-4454-bf75-9d4df8decc36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:13.681732 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e04a60-e813-4454-bf75-9d4df8decc36 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:13.699897 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1024/2052] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:29:13.702126 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e04a60-e813-4454-bf75-9d4df8decc36 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:13.717009 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e04a60-e813-4454-bf75-9d4df8decc36 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:13.721050 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24fe012-a8fc-456f-b184-5d0800225d97 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '855cbc7a992d4c6697632d2d4d74abfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:13.722109 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24fe012-a8fc-456f-b184-5d0800225d97 service glance] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:13.722466 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24fe012-a8fc-456f-b184-5d0800225d97 service glance] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:13.722699 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24fe012-a8fc-456f-b184-5d0800225d97 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:13.727005 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c650b-8b6d-4b3f-b775-5457a41f02e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:13.738335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c650b-8b6d-4b3f-b775-5457a41f02e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:13.738335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c650b-8b6d-4b3f-b775-5457a41f02e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:13.738335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c650b-8b6d-4b3f-b775-5457a41f02e1 admin admin] PATH_INFO: `/v3/projects/c8285e0497d9493399cb9a549fa617e3/users/3ba07139589945f3bc97b7634aae1633/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:13.779607 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c650b-8b6d-4b3f-b775-5457a41f02e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8285e0497d9493399cb9a549fa617e3, user_id=3ba07139589945f3bc97b7634aae1633, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:13.783676 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c650b-8b6d-4b3f-b775-5457a41f02e1 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:13.802425 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1025/2053] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:29:13 2022] PUT /identity/v3/projects/c8285e0497d9493399cb9a549fa617e3/users/3ba07139589945f3bc97b7634aae1633/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:13.808900 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24fe012-a8fc-456f-b184-5d0800225d97 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:13.810823 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24fe012-a8fc-456f-b184-5d0800225d97 service glance] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:13.813037 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990753d2-6d7e-4a6d-bb55-c9801a6da6e5 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:13.813469 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990753d2-6d7e-4a6d-bb55-c9801a6da6e5 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:13.813814 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990753d2-6d7e-4a6d-bb55-c9801a6da6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:13.823009 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1029/2054] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:29:13.868685 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-990753d2-6d7e-4a6d-bb55-c9801a6da6e5 None None] MFA Rules not processed for user `3ba07139589945f3bc97b7634aae1633`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:13.870445 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-990753d2-6d7e-4a6d-bb55-c9801a6da6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:13.880254 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:13.973801 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1026/2055] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:14.006624 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24fe012-a8fc-456f-b184-5d0800225d97 service glance] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:14.008278 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-a24fe012-a8fc-456f-b184-5d0800225d97 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:14.084611 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24fe012-a8fc-456f-b184-5d0800225d97 service glance] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:14.168358 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c388a79-626f-4dbb-8e45-9ee68be724d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:14.169279 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c388a79-626f-4dbb-8e45-9ee68be724d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:14.169873 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c388a79-626f-4dbb-8e45-9ee68be724d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:14.170153 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c388a79-626f-4dbb-8e45-9ee68be724d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:14.180599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c388a79-626f-4dbb-8e45-9ee68be724d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:14.182110 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c388a79-626f-4dbb-8e45-9ee68be724d7 service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:14.193766 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1030/2056] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:14.217737 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990753d2-6d7e-4a6d-bb55-c9801a6da6e5 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:14.299094 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990753d2-6d7e-4a6d-bb55-c9801a6da6e5 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:14.309409 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc6709-fd51-45a4-963e-8354f223c7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:14.310332 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc6709-fd51-45a4-963e-8354f223c7e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:14.310480 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc6709-fd51-45a4-963e-8354f223c7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:14.310673 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc6709-fd51-45a4-963e-8354f223c7e5 admin admin] PATH_INFO: `/v3/users/3ba07139589945f3bc97b7634aae1633` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:14.312076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc6709-fd51-45a4-963e-8354f223c7e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ba07139589945f3bc97b7634aae1633)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:14.314059 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc6709-fd51-45a4-963e-8354f223c7e5 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:14.326757 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c388a79-626f-4dbb-8e45-9ee68be724d7 service cinder] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:14.328340 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-3c388a79-626f-4dbb-8e45-9ee68be724d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:14.360950 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c388a79-626f-4dbb-8e45-9ee68be724d7 service cinder] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:14.373102 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da845fd-3459-4724-83dc-630650625f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:14.381635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da845fd-3459-4724-83dc-630650625f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:14.381933 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da845fd-3459-4724-83dc-630650625f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:14.382215 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da845fd-3459-4724-83dc-630650625f81 admin admin] PATH_INFO: `/v3/users/aa22971f2ae048f48ad725a785a85eb3` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:14.383819 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da845fd-3459-4724-83dc-630650625f81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa22971f2ae048f48ad725a785a85eb3)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:14.385898 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da845fd-3459-4724-83dc-630650625f81 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:14.398561 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-83bc6709-fd51-45a4-963e-8354f223c7e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ba07139589945f3bc97b7634aae1633'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:14.399902 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-83bc6709-fd51-45a4-963e-8354f223c7e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ba07139589945f3bc97b7634aae1633'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:14.419527 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-83bc6709-fd51-45a4-963e-8354f223c7e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ba07139589945f3bc97b7634aae1633'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:14.428278 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:14.459215 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-83bc6709-fd51-45a4-963e-8354f223c7e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ba07139589945f3bc97b7634aae1633'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:14.490307 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-83bc6709-fd51-45a4-963e-8354f223c7e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ba07139589945f3bc97b7634aae1633'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:14.493739 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-8da845fd-3459-4724-83dc-630650625f81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa22971f2ae048f48ad725a785a85eb3'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:14.495123 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-8da845fd-3459-4724-83dc-630650625f81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa22971f2ae048f48ad725a785a85eb3'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:14.502272 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1027/2057] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:29:14 2022] DELETE /identity/v3/users/3ba07139589945f3bc97b7634aae1633 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:14.507441 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-8da845fd-3459-4724-83dc-630650625f81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa22971f2ae048f48ad725a785a85eb3'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:14.507717 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010214fa-70ba-4bde-a44c-8f5dd631485e None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:14.508343 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010214fa-70ba-4bde-a44c-8f5dd631485e None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:14.508974 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010214fa-70ba-4bde-a44c-8f5dd631485e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:14.519575 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-8da845fd-3459-4724-83dc-630650625f81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa22971f2ae048f48ad725a785a85eb3'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:14.520455 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-8da845fd-3459-4724-83dc-630650625f81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa22971f2ae048f48ad725a785a85eb3'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:14.541808 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-010214fa-70ba-4bde-a44c-8f5dd631485e None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:14.543229 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-010214fa-70ba-4bde-a44c-8f5dd631485e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:14.561653 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1031/2058] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:29:14 2022] DELETE /identity/v3/users/aa22971f2ae048f48ad725a785a85eb3 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:14.568652 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2dc657-24f3-41c0-b72a-07ffd0aa0491 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:14.569046 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2dc657-24f3-41c0-b72a-07ffd0aa0491 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:14.569916 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2dc657-24f3-41c0-b72a-07ffd0aa0491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:14.585793 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:14.615645 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-fd2dc657-24f3-41c0-b72a-07ffd0aa0491 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:14.617174 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-fd2dc657-24f3-41c0-b72a-07ffd0aa0491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:14.646070 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1028/2059] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:29:14.656098 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010214fa-70ba-4bde-a44c-8f5dd631485e None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:14.657575 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-010214fa-70ba-4bde-a44c-8f5dd631485e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:14.701141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1032/2060] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:14.711986 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2dc657-24f3-41c0-b72a-07ffd0aa0491 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:14.713601 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-fd2dc657-24f3-41c0-b72a-07ffd0aa0491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:14.724640 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010214fa-70ba-4bde-a44c-8f5dd631485e None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:14.788626 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2dc657-24f3-41c0-b72a-07ffd0aa0491 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:14.789048 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadeb6e8-ecdc-4f3d-b23b-52a3b5cad6ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:14.789702 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadeb6e8-ecdc-4f3d-b23b-52a3b5cad6ab service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:14.790232 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadeb6e8-ecdc-4f3d-b23b-52a3b5cad6ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:14.790401 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadeb6e8-ecdc-4f3d-b23b-52a3b5cad6ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:14.794238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea79ed-92b6-4c87-9f77-30c25f12eb01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:14.794741 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea79ed-92b6-4c87-9f77-30c25f12eb01 service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:14.795019 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea79ed-92b6-4c87-9f77-30c25f12eb01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:14.795293 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea79ed-92b6-4c87-9f77-30c25f12eb01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:14.803887 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadeb6e8-ecdc-4f3d-b23b-52a3b5cad6ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:14.806261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadeb6e8-ecdc-4f3d-b23b-52a3b5cad6ab service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:14.806478 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea79ed-92b6-4c87-9f77-30c25f12eb01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:14.807895 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea79ed-92b6-4c87-9f77-30c25f12eb01 service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:14.823409 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1033/2061] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:14.829521 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1029/2062] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:29:15.332368 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea79ed-92b6-4c87-9f77-30c25f12eb01 service neutron] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:15.335570 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-5bea79ed-92b6-4c87-9f77-30c25f12eb01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:15.343373 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadeb6e8-ecdc-4f3d-b23b-52a3b5cad6ab service neutron] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:15.345060 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-eadeb6e8-ecdc-4f3d-b23b-52a3b5cad6ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:15.376981 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadeb6e8-ecdc-4f3d-b23b-52a3b5cad6ab service neutron] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:15.386795 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65cfeb-ef0a-4d92-8fed-9aa4ca92aa4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:15.387647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65cfeb-ef0a-4d92-8fed-9aa4ca92aa4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:15.388636 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65cfeb-ef0a-4d92-8fed-9aa4ca92aa4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:15.388934 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65cfeb-ef0a-4d92-8fed-9aa4ca92aa4d admin admin] PATH_INFO: `/v3/projects/b364d1c212124c7bbd09cd538086d324` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:15.391169 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65cfeb-ef0a-4d92-8fed-9aa4ca92aa4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b364d1c212124c7bbd09cd538086d324)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:15.397417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65cfeb-ef0a-4d92-8fed-9aa4ca92aa4d admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:15.445208 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:15.484328 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea79ed-92b6-4c87-9f77-30c25f12eb01 service neutron] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:15.493439 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccef7da-31fb-4376-9850-953775741829 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:15.495574 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccef7da-31fb-4376-9850-953775741829 service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:15.496122 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccef7da-31fb-4376-9850-953775741829 service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:15.496755 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccef7da-31fb-4376-9850-953775741829 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:15.503617 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-2ccef7da-31fb-4376-9850-953775741829 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:15.537430 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-dd65cfeb-ef0a-4d92-8fed-9aa4ca92aa4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b364d1c212124c7bbd09cd538086d324', 'request_id': 'req-dd65cfeb-ef0a-4d92-8fed-9aa4ca92aa4d'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:15.547526 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-dd65cfeb-ef0a-4d92-8fed-9aa4ca92aa4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b364d1c212124c7bbd09cd538086d324', 'request_id': 'req-dd65cfeb-ef0a-4d92-8fed-9aa4ca92aa4d'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:15.558789 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-dd65cfeb-ef0a-4d92-8fed-9aa4ca92aa4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b364d1c212124c7bbd09cd538086d324', 'request_id': 'req-dd65cfeb-ef0a-4d92-8fed-9aa4ca92aa4d'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:15.586422 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-dd65cfeb-ef0a-4d92-8fed-9aa4ca92aa4d admin admin] The token cache is being invalidate because project b364d1c212124c7bbd09cd538086d324 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:29:15.586753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-dd65cfeb-ef0a-4d92-8fed-9aa4ca92aa4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:15.587475 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-dd65cfeb-ef0a-4d92-8fed-9aa4ca92aa4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:15.589105 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1030/2063] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:29:15 2022] DELETE /identity/v3/projects/b364d1c212124c7bbd09cd538086d324 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:15.590022 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65cfeb-ef0a-4d92-8fed-9aa4ca92aa4d admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:15.592401 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-dd65cfeb-ef0a-4d92-8fed-9aa4ca92aa4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:15.607814 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:15.622590 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccef7da-31fb-4376-9850-953775741829 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:15.624831 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccef7da-31fb-4376-9850-953775741829 service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:15.640385 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1034/2064] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:15.641475 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccef7da-31fb-4376-9850-953775741829 service cinder] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:15.659836 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccef7da-31fb-4376-9850-953775741829 service cinder] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:15.753499 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65cfeb-ef0a-4d92-8fed-9aa4ca92aa4d admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:15.764868 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f7609-2848-42ec-a925-a0b3626a8fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:15.765267 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429091c-899b-474f-a85d-bc3d9386b7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:15.766046 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429091c-899b-474f-a85d-bc3d9386b7c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:15.766229 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f7609-2848-42ec-a925-a0b3626a8fee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:15.766632 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429091c-899b-474f-a85d-bc3d9386b7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:15.766822 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f7609-2848-42ec-a925-a0b3626a8fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:15.767125 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429091c-899b-474f-a85d-bc3d9386b7c4 admin admin] PATH_INFO: `/v3/users/b3b778d907784e2d833d03ae4fc3d58a` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:15.767561 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f7609-2848-42ec-a925-a0b3626a8fee admin admin] PATH_INFO: `/v3/projects/c8285e0497d9493399cb9a549fa617e3` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:15.769410 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429091c-899b-474f-a85d-bc3d9386b7c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3b778d907784e2d833d03ae4fc3d58a)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:15.773716 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429091c-899b-474f-a85d-bc3d9386b7c4 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:15.779683 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f7609-2848-42ec-a925-a0b3626a8fee admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8285e0497d9493399cb9a549fa617e3)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:15.786332 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f7609-2848-42ec-a925-a0b3626a8fee admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:15.905191 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-7429091c-899b-474f-a85d-bc3d9386b7c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3b778d907784e2d833d03ae4fc3d58a'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:15.908803 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-7429091c-899b-474f-a85d-bc3d9386b7c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3b778d907784e2d833d03ae4fc3d58a'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:15.941605 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-7429091c-899b-474f-a85d-bc3d9386b7c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3b778d907784e2d833d03ae4fc3d58a'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:15.946609 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-711f7609-2848-42ec-a925-a0b3626a8fee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8285e0497d9493399cb9a549fa617e3', 'request_id': 'req-711f7609-2848-42ec-a925-a0b3626a8fee'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:15.948727 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-711f7609-2848-42ec-a925-a0b3626a8fee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8285e0497d9493399cb9a549fa617e3', 'request_id': 'req-711f7609-2848-42ec-a925-a0b3626a8fee'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:15.958151 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-7429091c-899b-474f-a85d-bc3d9386b7c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3b778d907784e2d833d03ae4fc3d58a'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:15.959314 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-7429091c-899b-474f-a85d-bc3d9386b7c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3b778d907784e2d833d03ae4fc3d58a'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:15.967104 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-711f7609-2848-42ec-a925-a0b3626a8fee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8285e0497d9493399cb9a549fa617e3', 'request_id': 'req-711f7609-2848-42ec-a925-a0b3626a8fee'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:15.985193 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-711f7609-2848-42ec-a925-a0b3626a8fee admin admin] The token cache is being invalidate because project c8285e0497d9493399cb9a549fa617e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:29:15.985894 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-711f7609-2848-42ec-a925-a0b3626a8fee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:15.987217 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-711f7609-2848-42ec-a925-a0b3626a8fee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:15.989276 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1031/2065] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:29:15 2022] DELETE /identity/v3/projects/c8285e0497d9493399cb9a549fa617e3 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:15.995258 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec05cf-5187-434c-86c1-7d2bc21c6674 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:15.995855 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec05cf-5187-434c-86c1-7d2bc21c6674 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:15.996285 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec05cf-5187-434c-86c1-7d2bc21c6674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:16.007305 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1035/2066] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:29:15 2022] DELETE /identity/v3/users/b3b778d907784e2d833d03ae4fc3d58a => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:16.030257 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-cfec05cf-5187-434c-86c1-7d2bc21c6674 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:16.031670 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-cfec05cf-5187-434c-86c1-7d2bc21c6674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:16.113123 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1032/2067] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:16.122422 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe314ad9-a7e6-454c-b531-19ea89363ccc None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:16.123002 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe314ad9-a7e6-454c-b531-19ea89363ccc None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:16.123217 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe314ad9-a7e6-454c-b531-19ea89363ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:16.152497 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-fe314ad9-a7e6-454c-b531-19ea89363ccc None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:16.153809 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-fe314ad9-a7e6-454c-b531-19ea89363ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:16.180439 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1036/2068] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:16.185655 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec05cf-5187-434c-86c1-7d2bc21c6674 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:16.197315 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec05cf-5187-434c-86c1-7d2bc21c6674 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:16.203523 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24e42b-b579-445c-9ba7-49a478347425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:16.204169 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24e42b-b579-445c-9ba7-49a478347425 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:16.204678 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24e42b-b579-445c-9ba7-49a478347425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:16.204952 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24e42b-b579-445c-9ba7-49a478347425 admin admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:16.205691 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24e42b-b579-445c-9ba7-49a478347425 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:29:16.205994 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24e42b-b579-445c-9ba7-49a478347425 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:16.209642 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24e42b-b579-445c-9ba7-49a478347425 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:16.225588 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1033/2069] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:29:16.228573 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe314ad9-a7e6-454c-b531-19ea89363ccc None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:16.235224 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:16.239829 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe314ad9-a7e6-454c-b531-19ea89363ccc None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:16.249823 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2952231-ccd8-43c9-9fb6-73d547e1d737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:16.250754 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2952231-ccd8-43c9-9fb6-73d547e1d737 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:16.251482 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2952231-ccd8-43c9-9fb6-73d547e1d737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:16.252365 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2952231-ccd8-43c9-9fb6-73d547e1d737 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:16.253439 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2952231-ccd8-43c9-9fb6-73d547e1d737 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:16.257576 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2952231-ccd8-43c9-9fb6-73d547e1d737 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:16.306444 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1037/2070] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:29:16 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:29:16.315398 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24e42b-b579-445c-9ba7-49a478347425 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:16.329761 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24e42b-b579-445c-9ba7-49a478347425 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:16.397981 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:16.422436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2952231-ccd8-43c9-9fb6-73d547e1d737 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:16.426553 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-c2952231-ccd8-43c9-9fb6-73d547e1d737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:16.487696 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a1f16-bdbe-4d39-a590-c37506e3eaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:16.488175 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a1f16-bdbe-4d39-a590-c37506e3eaa1 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:16.488518 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a1f16-bdbe-4d39-a590-c37506e3eaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:16.488732 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a1f16-bdbe-4d39-a590-c37506e3eaa1 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:16.489413 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a1f16-bdbe-4d39-a590-c37506e3eaa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:16.491387 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a1f16-bdbe-4d39-a590-c37506e3eaa1 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:16.522351 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2952231-ccd8-43c9-9fb6-73d547e1d737 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:16.527578 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788305a-89a9-4206-a84f-5a3a43f4df40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:16.528346 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788305a-89a9-4206-a84f-5a3a43f4df40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:16.528677 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788305a-89a9-4206-a84f-5a3a43f4df40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:16.528954 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788305a-89a9-4206-a84f-5a3a43f4df40 admin admin] PATH_INFO: `/v3/projects/f86e167eadf24e7197477df4f8aeefab` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:16.530208 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788305a-89a9-4206-a84f-5a3a43f4df40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f86e167eadf24e7197477df4f8aeefab)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:16.532408 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788305a-89a9-4206-a84f-5a3a43f4df40 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:16.537408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1034/2071] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:29:16 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:29:16.542230 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a1f16-bdbe-4d39-a590-c37506e3eaa1 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:16.561419 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a1f16-bdbe-4d39-a590-c37506e3eaa1 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:16.579417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb16ae-3865-4607-905d-ec82c4dc50ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:16.580066 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb16ae-3865-4607-905d-ec82c4dc50ac admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:16.580354 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb16ae-3865-4607-905d-ec82c4dc50ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:16.580709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb16ae-3865-4607-905d-ec82c4dc50ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:16.584585 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb16ae-3865-4607-905d-ec82c4dc50ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:16.589649 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb16ae-3865-4607-905d-ec82c4dc50ac admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:16.618849 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1035/2072] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:29:16.623932 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb16ae-3865-4607-905d-ec82c4dc50ac admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:16.635639 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-5788305a-89a9-4206-a84f-5a3a43f4df40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f86e167eadf24e7197477df4f8aeefab', 'request_id': 'req-5788305a-89a9-4206-a84f-5a3a43f4df40'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:16.663313 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-5788305a-89a9-4206-a84f-5a3a43f4df40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f86e167eadf24e7197477df4f8aeefab', 'request_id': 'req-5788305a-89a9-4206-a84f-5a3a43f4df40'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:16.665094 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb16ae-3865-4607-905d-ec82c4dc50ac admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:16.679008 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-5788305a-89a9-4206-a84f-5a3a43f4df40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f86e167eadf24e7197477df4f8aeefab', 'request_id': 'req-5788305a-89a9-4206-a84f-5a3a43f4df40'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:16.697290 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-5788305a-89a9-4206-a84f-5a3a43f4df40 admin admin] The token cache is being invalidate because project f86e167eadf24e7197477df4f8aeefab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:29:16.697990 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-5788305a-89a9-4206-a84f-5a3a43f4df40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:16.698991 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-5788305a-89a9-4206-a84f-5a3a43f4df40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:16.701707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1038/2073] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:29:16 2022] DELETE /identity/v3/projects/f86e167eadf24e7197477df4f8aeefab => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:29:16.708288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940b598-0996-4a3f-95a8-54251a27f6ca None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:16.708915 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940b598-0996-4a3f-95a8-54251a27f6ca None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:16.709193 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940b598-0996-4a3f-95a8-54251a27f6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:16.737445 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-a940b598-0996-4a3f-95a8-54251a27f6ca None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:16.739388 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-a940b598-0996-4a3f-95a8-54251a27f6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:16.788219 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a4377-342c-4fae-a9d2-3ca461dc81a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:16.788845 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a4377-342c-4fae-a9d2-3ca461dc81a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:16.789124 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a4377-342c-4fae-a9d2-3ca461dc81a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:16.789658 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a4377-342c-4fae-a9d2-3ca461dc81a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:16.790524 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a4377-342c-4fae-a9d2-3ca461dc81a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:16.792210 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a4377-342c-4fae-a9d2-3ca461dc81a7 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:16.804926 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1036/2074] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:29:16.806094 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a4377-342c-4fae-a9d2-3ca461dc81a7 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:16.808253 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-3c9a4377-342c-4fae-a9d2-3ca461dc81a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:16.825689 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1039/2075] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:16.833304 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940b598-0996-4a3f-95a8-54251a27f6ca None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:16.834969 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-a940b598-0996-4a3f-95a8-54251a27f6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:16.851522 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940b598-0996-4a3f-95a8-54251a27f6ca None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:16.858651 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cc383-9d10-4ed6-a266-1b4fd1c0c5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:16.859418 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cc383-9d10-4ed6-a266-1b4fd1c0c5db admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:16.859768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cc383-9d10-4ed6-a266-1b4fd1c0c5db admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:16.860118 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cc383-9d10-4ed6-a266-1b4fd1c0c5db admin admin] PATH_INFO: `/v3/projects/a3e1d6f1e4c948ac9fb0142a28187bcc/users/ccb52560704141fe946ff499d57024cc/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:16.874042 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:16.880056 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636cc383-9d10-4ed6-a266-1b4fd1c0c5db admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3e1d6f1e4c948ac9fb0142a28187bcc, user_id=ccb52560704141fe946ff499d57024cc, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:16.880267 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a4377-342c-4fae-a9d2-3ca461dc81a7 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:16.882901 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636cc383-9d10-4ed6-a266-1b4fd1c0c5db admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:16.888709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b02f4c-e8ab-43f3-93b5-1dd1ba33d805 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:16.889242 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b02f4c-e8ab-43f3-93b5-1dd1ba33d805 service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:16.889566 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b02f4c-e8ab-43f3-93b5-1dd1ba33d805 service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:16.889805 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b02f4c-e8ab-43f3-93b5-1dd1ba33d805 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:16.892594 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-c3b02f4c-e8ab-43f3-93b5-1dd1ba33d805 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:16.907591 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1040/2076] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:29:16 2022] PUT /identity/v3/projects/a3e1d6f1e4c948ac9fb0142a28187bcc/users/ccb52560704141fe946ff499d57024cc/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:16.913893 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db36cd-466c-4f97-a703-156271e64584 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:16.915719 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db36cd-466c-4f97-a703-156271e64584 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:16.916356 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db36cd-466c-4f97-a703-156271e64584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:16.955445 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-33db36cd-466c-4f97-a703-156271e64584 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:16.957704 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-33db36cd-466c-4f97-a703-156271e64584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:16.974660 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:17.004940 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b02f4c-e8ab-43f3-93b5-1dd1ba33d805 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:17.007980 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b02f4c-e8ab-43f3-93b5-1dd1ba33d805 service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:17.034110 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1037/2077] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:17.036569 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f606b38-8722-4f46-8710-d9b219c1c6ea None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:17.037206 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f606b38-8722-4f46-8710-d9b219c1c6ea None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:17.037645 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f606b38-8722-4f46-8710-d9b219c1c6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:17.091265 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1041/2078] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:17.099354 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db36cd-466c-4f97-a703-156271e64584 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:17.100296 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-2f606b38-8722-4f46-8710-d9b219c1c6ea None None] MFA Rules not processed for user `ccb52560704141fe946ff499d57024cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:17.102065 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-2f606b38-8722-4f46-8710-d9b219c1c6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:17.125469 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db36cd-466c-4f97-a703-156271e64584 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:17.131307 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc70c08-d5af-4e19-acc5-cf17e3430490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:17.132026 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc70c08-d5af-4e19-acc5-cf17e3430490 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:17.132382 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc70c08-d5af-4e19-acc5-cf17e3430490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:17.133239 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc70c08-d5af-4e19-acc5-cf17e3430490 admin admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:17.134791 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc70c08-d5af-4e19-acc5-cf17e3430490 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:29:17.135085 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc70c08-d5af-4e19-acc5-cf17e3430490 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:17.136977 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc70c08-d5af-4e19-acc5-cf17e3430490 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:17.173458 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1042/2079] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:29:17.182486 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc70c08-d5af-4e19-acc5-cf17e3430490 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:17.216883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc70c08-d5af-4e19-acc5-cf17e3430490 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:17.229831 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a038022-f18c-466c-a113-a8c242be326c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:17.232731 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a038022-f18c-466c-a113-a8c242be326c admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:17.235468 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a038022-f18c-466c-a113-a8c242be326c admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:17.236573 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a038022-f18c-466c-a113-a8c242be326c admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:17.238064 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a038022-f18c-466c-a113-a8c242be326c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:17.242976 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a038022-f18c-466c-a113-a8c242be326c admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:17.249463 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1038/2080] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:17.271713 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f606b38-8722-4f46-8710-d9b219c1c6ea None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:17.299096 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1043/2081] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:29:17 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:29:17.303494 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a038022-f18c-466c-a113-a8c242be326c admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:17.388223 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f606b38-8722-4f46-8710-d9b219c1c6ea None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:17.408269 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a038022-f18c-466c-a113-a8c242be326c admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:17.413686 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1afac-8b4d-41ca-a09b-a94a0348bd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:17.414732 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1afac-8b4d-41ca-a09b-a94a0348bd19 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:17.414875 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1afac-8b4d-41ca-a09b-a94a0348bd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:17.415197 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1afac-8b4d-41ca-a09b-a94a0348bd19 admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:17.415929 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa1afac-8b4d-41ca-a09b-a94a0348bd19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:17.418270 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa1afac-8b4d-41ca-a09b-a94a0348bd19 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:17.471765 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1044/2082] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:29:17 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:29:17.473225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1afac-8b4d-41ca-a09b-a94a0348bd19 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:17.483985 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8795f-28e6-4457-a31c-d09910b199cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:17.484951 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8795f-28e6-4457-a31c-d09910b199cc service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:17.485697 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8795f-28e6-4457-a31c-d09910b199cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:17.486246 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1afac-8b4d-41ca-a09b-a94a0348bd19 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:17.486434 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8795f-28e6-4457-a31c-d09910b199cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:17.491207 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb610d-aac6-41ca-91f0-450e8e827504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:17.491841 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb610d-aac6-41ca-91f0-450e8e827504 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:17.492114 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb610d-aac6-41ca-91f0-450e8e827504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:17.492512 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb610d-aac6-41ca-91f0-450e8e827504 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:17.493186 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb610d-aac6-41ca-91f0-450e8e827504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:17.495009 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb610d-aac6-41ca-91f0-450e8e827504 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:17.514010 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1045/2083] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:29:17.518190 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb610d-aac6-41ca-91f0-450e8e827504 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:17.530919 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb610d-aac6-41ca-91f0-450e8e827504 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:17.537192 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3089195-3b5f-4665-af0c-b98678e0f6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:17.537864 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3089195-3b5f-4665-af0c-b98678e0f6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:17.538157 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3089195-3b5f-4665-af0c-b98678e0f6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:17.538431 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3089195-3b5f-4665-af0c-b98678e0f6a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:17.539337 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3089195-3b5f-4665-af0c-b98678e0f6a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:17.541173 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3089195-3b5f-4665-af0c-b98678e0f6a6 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:17.565739 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1046/2084] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:29:17.567561 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3089195-3b5f-4665-af0c-b98678e0f6a6 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:17.580900 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:17.582676 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3089195-3b5f-4665-af0c-b98678e0f6a6 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:17.589780 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436a688-bc03-449e-92de-e18dbd868c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:17.591940 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436a688-bc03-449e-92de-e18dbd868c3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:17.592400 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436a688-bc03-449e-92de-e18dbd868c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:17.592838 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436a688-bc03-449e-92de-e18dbd868c3d admin admin] PATH_INFO: `/v3/projects/0eb1af7d072c4046aab28665240d53ec/users/cd35bf04b96b42f0a4de7ad3d3c00175/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:17.595489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8795f-28e6-4457-a31c-d09910b199cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:17.599373 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8795f-28e6-4457-a31c-d09910b199cc service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:17.612085 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436a688-bc03-449e-92de-e18dbd868c3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eb1af7d072c4046aab28665240d53ec, user_id=cd35bf04b96b42f0a4de7ad3d3c00175, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:17.615164 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436a688-bc03-449e-92de-e18dbd868c3d admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:17.624384 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1039/2085] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:29:17.635830 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:17.646961 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1047/2086] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:29:17 2022] PUT /identity/v3/projects/0eb1af7d072c4046aab28665240d53ec/users/cd35bf04b96b42f0a4de7ad3d3c00175/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:29:17.648433 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a95b9-9e80-4ac9-958a-432f88c0d7b8 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:17.648722 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a95b9-9e80-4ac9-958a-432f88c0d7b8 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:17.649005 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a95b9-9e80-4ac9-958a-432f88c0d7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:17.672254 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-c84a95b9-9e80-4ac9-958a-432f88c0d7b8 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:17.673578 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-c84a95b9-9e80-4ac9-958a-432f88c0d7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:17.785427 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1040/2087] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:29:17.798207 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436a688-bc03-449e-92de-e18dbd868c3d admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:17.800134 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-9436a688-bc03-449e-92de-e18dbd868c3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:17.923871 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436a688-bc03-449e-92de-e18dbd868c3d admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:17.932764 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1441250-29b3-4e01-a833-3c28929f837f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:17.935703 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1441250-29b3-4e01-a833-3c28929f837f service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:17.936315 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1441250-29b3-4e01-a833-3c28929f837f service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:17.936745 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1441250-29b3-4e01-a833-3c28929f837f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:17.951156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1441250-29b3-4e01-a833-3c28929f837f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:17.953075 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1441250-29b3-4e01-a833-3c28929f837f service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:17.969685 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1048/2088] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:19.110982 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca687a0a-888c-43d3-8be5-0c2420c53c3b None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:19.111981 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca687a0a-888c-43d3-8be5-0c2420c53c3b None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:19.112451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca687a0a-888c-43d3-8be5-0c2420c53c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:19.165414 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-ca687a0a-888c-43d3-8be5-0c2420c53c3b None None] MFA Rules not processed for user `cd35bf04b96b42f0a4de7ad3d3c00175`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:19.168039 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-ca687a0a-888c-43d3-8be5-0c2420c53c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:19.341307 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1041/2089] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:19.347722 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1441250-29b3-4e01-a833-3c28929f837f service neutron] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:19.367279 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1441250-29b3-4e01-a833-3c28929f837f service neutron] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:19.376770 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2274ca-825b-41ed-b1a0-f3231c803f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:19.378080 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2274ca-825b-41ed-b1a0-f3231c803f9f admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:19.378745 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2274ca-825b-41ed-b1a0-f3231c803f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:19.379341 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2274ca-825b-41ed-b1a0-f3231c803f9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:19.380780 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2274ca-825b-41ed-b1a0-f3231c803f9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:19.385208 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2274ca-825b-41ed-b1a0-f3231c803f9f admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:19.464931 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1049/2090] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:29:19 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:29:19.467365 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca687a0a-888c-43d3-8be5-0c2420c53c3b None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:19.486413 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca687a0a-888c-43d3-8be5-0c2420c53c3b None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:19.670241 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7083b4-24b6-4dda-a1e2-d3fe7b44fed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:19.671448 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7083b4-24b6-4dda-a1e2-d3fe7b44fed8 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:19.671880 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7083b4-24b6-4dda-a1e2-d3fe7b44fed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:19.672536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7083b4-24b6-4dda-a1e2-d3fe7b44fed8 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:19.673561 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7083b4-24b6-4dda-a1e2-d3fe7b44fed8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:19.677147 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7083b4-24b6-4dda-a1e2-d3fe7b44fed8 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:19.726454 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1042/2091] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:29:19 2022] POST /identity/v3/users => generated 292 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:29:19.730839 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2274ca-825b-41ed-b1a0-f3231c803f9f admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:19.753833 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2274ca-825b-41ed-b1a0-f3231c803f9f admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:19.759590 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754e6c1-1def-4bd4-aa81-3fc7b50e7d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:19.760231 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754e6c1-1def-4bd4-aa81-3fc7b50e7d70 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:19.760513 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754e6c1-1def-4bd4-aa81-3fc7b50e7d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:19.760805 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754e6c1-1def-4bd4-aa81-3fc7b50e7d70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:19.761492 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754e6c1-1def-4bd4-aa81-3fc7b50e7d70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:19.764762 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754e6c1-1def-4bd4-aa81-3fc7b50e7d70 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:19.780374 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1050/2092] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:29:19.786690 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7083b4-24b6-4dda-a1e2-d3fe7b44fed8 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:19.799620 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7083b4-24b6-4dda-a1e2-d3fe7b44fed8 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:19.806710 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a066eec-7edb-4af0-b451-6c1f5e43ecc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:19.807558 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a066eec-7edb-4af0-b451-6c1f5e43ecc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:19.808058 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a066eec-7edb-4af0-b451-6c1f5e43ecc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:19.808439 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a066eec-7edb-4af0-b451-6c1f5e43ecc6 admin admin] PATH_INFO: `/v3/projects/4dd4a60749aa44a183eaef0ddbcab697/users/63ed7644dcdd4c978152db8f2b6dfbbb/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:19.822921 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:19.852671 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a066eec-7edb-4af0-b451-6c1f5e43ecc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dd4a60749aa44a183eaef0ddbcab697, user_id=63ed7644dcdd4c978152db8f2b6dfbbb, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:19.858161 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a066eec-7edb-4af0-b451-6c1f5e43ecc6 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:19.915830 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1043/2093] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:29:19 2022] PUT /identity/v3/projects/4dd4a60749aa44a183eaef0ddbcab697/users/63ed7644dcdd4c978152db8f2b6dfbbb/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:19.923967 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754e6c1-1def-4bd4-aa81-3fc7b50e7d70 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:19.958494 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754e6c1-1def-4bd4-aa81-3fc7b50e7d70 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:20.236651 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1970e25-9195-4c2b-8834-98a8a1421e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:20.238069 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1970e25-9195-4c2b-8834-98a8a1421e21 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:20.238491 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1970e25-9195-4c2b-8834-98a8a1421e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:20.238983 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1970e25-9195-4c2b-8834-98a8a1421e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:20.240307 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1970e25-9195-4c2b-8834-98a8a1421e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:20.243268 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1970e25-9195-4c2b-8834-98a8a1421e21 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:20.284815 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1051/2094] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:29:20.287171 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a066eec-7edb-4af0-b451-6c1f5e43ecc6 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:20.362230 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a066eec-7edb-4af0-b451-6c1f5e43ecc6 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:20.377621 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2e610-2a3c-48cb-8ea0-ed2a65b61137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:20.378284 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2e610-2a3c-48cb-8ea0-ed2a65b61137 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:20.378775 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2e610-2a3c-48cb-8ea0-ed2a65b61137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:20.379062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2e610-2a3c-48cb-8ea0-ed2a65b61137 admin admin] PATH_INFO: `/v3/projects/4dd4a60749aa44a183eaef0ddbcab697/users/63ed7644dcdd4c978152db8f2b6dfbbb/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:20.382661 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a2e610-2a3c-48cb-8ea0-ed2a65b61137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dd4a60749aa44a183eaef0ddbcab697, user_id=63ed7644dcdd4c978152db8f2b6dfbbb, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:20.386156 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a2e610-2a3c-48cb-8ea0-ed2a65b61137 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:20.411855 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1044/2095] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:29:20 2022] PUT /identity/v3/projects/4dd4a60749aa44a183eaef0ddbcab697/users/63ed7644dcdd4c978152db8f2b6dfbbb/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:22.043828 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2e610-2a3c-48cb-8ea0-ed2a65b61137 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:22.046469 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8d6ed-f9bb-43cf-8d41-d7507bd56ee7 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:22.047687 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8d6ed-f9bb-43cf-8d41-d7507bd56ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:22.048343 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8d6ed-f9bb-43cf-8d41-d7507bd56ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:22.056135 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-d9a2e610-2a3c-48cb-8ea0-ed2a65b61137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:22.145276 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-b4e8d6ed-f9bb-43cf-8d41-d7507bd56ee7 None None] MFA Rules not processed for user `63ed7644dcdd4c978152db8f2b6dfbbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:22.146962 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-b4e8d6ed-f9bb-43cf-8d41-d7507bd56ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:22.242650 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2e610-2a3c-48cb-8ea0-ed2a65b61137 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:22.276016 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e606f0-663e-4ebd-88d8-c59b9ac9a4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:22.277034 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e606f0-663e-4ebd-88d8-c59b9ac9a4bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:22.278065 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e606f0-663e-4ebd-88d8-c59b9ac9a4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:22.280195 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e606f0-663e-4ebd-88d8-c59b9ac9a4bf admin admin] PATH_INFO: `/v3/users/2e4e3cf7677549f090b87760b512f4da` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:22.286183 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e606f0-663e-4ebd-88d8-c59b9ac9a4bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e4e3cf7677549f090b87760b512f4da)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:22.288643 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e606f0-663e-4ebd-88d8-c59b9ac9a4bf admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:22.345353 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:22.415042 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1052/2096] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:22.432595 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83395cfb-3716-4f55-b8fd-35ef13113d4a None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:22.433193 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83395cfb-3716-4f55-b8fd-35ef13113d4a None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:22.433193 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83395cfb-3716-4f55-b8fd-35ef13113d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:22.450894 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-96e606f0-663e-4ebd-88d8-c59b9ac9a4bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e4e3cf7677549f090b87760b512f4da'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:22.453066 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-96e606f0-663e-4ebd-88d8-c59b9ac9a4bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e4e3cf7677549f090b87760b512f4da'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:22.468313 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-96e606f0-663e-4ebd-88d8-c59b9ac9a4bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e4e3cf7677549f090b87760b512f4da'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:22.484299 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-96e606f0-663e-4ebd-88d8-c59b9ac9a4bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e4e3cf7677549f090b87760b512f4da'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:22.489912 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-83395cfb-3716-4f55-b8fd-35ef13113d4a None None] MFA Rules not processed for user `cd35bf04b96b42f0a4de7ad3d3c00175`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:22.492586 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-83395cfb-3716-4f55-b8fd-35ef13113d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:22.514169 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-96e606f0-663e-4ebd-88d8-c59b9ac9a4bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e4e3cf7677549f090b87760b512f4da'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:22.543615 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1045/2097] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:29:22 2022] DELETE /identity/v3/users/2e4e3cf7677549f090b87760b512f4da => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:22.549038 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560779d-a651-4838-be4c-9af2d2062be9 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:22.549890 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560779d-a651-4838-be4c-9af2d2062be9 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:22.550187 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560779d-a651-4838-be4c-9af2d2062be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:22.581601 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-7560779d-a651-4838-be4c-9af2d2062be9 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:22.583156 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-7560779d-a651-4838-be4c-9af2d2062be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:22.608584 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1053/2098] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:22.622203 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83395cfb-3716-4f55-b8fd-35ef13113d4a None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:22.624951 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-83395cfb-3716-4f55-b8fd-35ef13113d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:22.666935 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:22.699027 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1046/2099] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:22.721970 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560779d-a651-4838-be4c-9af2d2062be9 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:22.724980 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-7560779d-a651-4838-be4c-9af2d2062be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:22.753233 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83395cfb-3716-4f55-b8fd-35ef13113d4a None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:22.816280 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560779d-a651-4838-be4c-9af2d2062be9 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:22.820868 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f46433-00d4-4794-8eab-910462ec51bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:22.821540 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f46433-00d4-4794-8eab-910462ec51bc service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:22.821818 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f46433-00d4-4794-8eab-910462ec51bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:22.822088 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f46433-00d4-4794-8eab-910462ec51bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:22.833834 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62afc02-0db3-4c58-a772-c9b5386eead9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:22.839305 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f46433-00d4-4794-8eab-910462ec51bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:22.839520 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62afc02-0db3-4c58-a772-c9b5386eead9 service nova] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:22.839520 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62afc02-0db3-4c58-a772-c9b5386eead9 service nova] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:22.839520 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62afc02-0db3-4c58-a772-c9b5386eead9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:22.841702 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f46433-00d4-4794-8eab-910462ec51bc service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:22.842138 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-d62afc02-0db3-4c58-a772-c9b5386eead9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:22.854607 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1047/2100] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:29:22.885150 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:22.927850 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62afc02-0db3-4c58-a772-c9b5386eead9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:22.931650 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62afc02-0db3-4c58-a772-c9b5386eead9 service nova] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:22.945345 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1054/2101] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:22.962957 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689793d-a63c-491f-9c7e-12b11c60ae28 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:22.964147 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689793d-a63c-491f-9c7e-12b11c60ae28 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:22.964592 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689793d-a63c-491f-9c7e-12b11c60ae28 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:22.968094 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1048/2102] 10.222.0.77 () {54 vars in 921 bytes} [Tue Aug 23 22:29:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:29:23.022671 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54986fc-6ad2-4846-b544-08a68d9c4d2d None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:23.023613 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54986fc-6ad2-4846-b544-08a68d9c4d2d None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:23.023914 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54986fc-6ad2-4846-b544-08a68d9c4d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:23.052386 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-f54986fc-6ad2-4846-b544-08a68d9c4d2d None None] MFA Rules not processed for user `2000b80e34ae45d2a8b658cd394419f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:23.055184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-f54986fc-6ad2-4846-b544-08a68d9c4d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:23.070408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689793d-a63c-491f-9c7e-12b11c60ae28 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:23.072200 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-4689793d-a63c-491f-9c7e-12b11c60ae28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:23.103496 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689793d-a63c-491f-9c7e-12b11c60ae28 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:23.117153 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299ead5-37c8-45ff-9163-593a9632e132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:23.118588 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299ead5-37c8-45ff-9163-593a9632e132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:23.119186 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299ead5-37c8-45ff-9163-593a9632e132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:23.120005 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299ead5-37c8-45ff-9163-593a9632e132 admin admin] PATH_INFO: `/v3/users/081aba900bfd4ace9e9f49daf8d941a0` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:23.123005 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2299ead5-37c8-45ff-9163-593a9632e132 admin admin] RBAC: Authorizing `identity:delete_user(user_id=081aba900bfd4ace9e9f49daf8d941a0)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:23.128946 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2299ead5-37c8-45ff-9163-593a9632e132 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:23.196287 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1055/2103] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Aug 23 22:29:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:23.235737 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2299ead5-37c8-45ff-9163-593a9632e132 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '081aba900bfd4ace9e9f49daf8d941a0'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:23.237455 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54986fc-6ad2-4846-b544-08a68d9c4d2d None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:23.239351 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-f54986fc-6ad2-4846-b544-08a68d9c4d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:23.258445 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2299ead5-37c8-45ff-9163-593a9632e132 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '081aba900bfd4ace9e9f49daf8d941a0'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:23.270102 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2299ead5-37c8-45ff-9163-593a9632e132 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '081aba900bfd4ace9e9f49daf8d941a0'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:23.272521 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54986fc-6ad2-4846-b544-08a68d9c4d2d None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:23.282695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc4819-e817-4b41-b5bc-dabe08250511 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2000b80e34ae45d2a8b658cd394419f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:23.283337 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc4819-e817-4b41-b5bc-dabe08250511 service placement] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:23.283618 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc4819-e817-4b41-b5bc-dabe08250511 service placement] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:23.284514 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc4819-e817-4b41-b5bc-dabe08250511 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:23.290835 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2299ead5-37c8-45ff-9163-593a9632e132 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '081aba900bfd4ace9e9f49daf8d941a0'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:23.294858 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-53bc4819-e817-4b41-b5bc-dabe08250511 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:23.315127 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc4819-e817-4b41-b5bc-dabe08250511 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:23.316506 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2299ead5-37c8-45ff-9163-593a9632e132 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '081aba900bfd4ace9e9f49daf8d941a0'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:23.317081 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc4819-e817-4b41-b5bc-dabe08250511 service placement] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:23.328948 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1049/2104] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:29:23 2022] DELETE /identity/v3/users/081aba900bfd4ace9e9f49daf8d941a0 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:29:23.362602 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1056/2105] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:23.614020 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299ead5-37c8-45ff-9163-593a9632e132 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:23.621536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-2299ead5-37c8-45ff-9163-593a9632e132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:23.672253 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc4819-e817-4b41-b5bc-dabe08250511 service placement] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:23.674643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-53bc4819-e817-4b41-b5bc-dabe08250511 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:23.709872 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc4819-e817-4b41-b5bc-dabe08250511 service placement] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:23.764112 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299ead5-37c8-45ff-9163-593a9632e132 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:23.775837 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374334da-27bc-4428-ac5b-9197019897e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:23.776554 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374334da-27bc-4428-ac5b-9197019897e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:23.776841 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374334da-27bc-4428-ac5b-9197019897e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:23.777598 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374334da-27bc-4428-ac5b-9197019897e1 admin admin] PATH_INFO: `/v3/projects/0d3f1bf003484ae4987e71ff4c3c6dd7` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:23.779491 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374334da-27bc-4428-ac5b-9197019897e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d3f1bf003484ae4987e71ff4c3c6dd7)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:23.783124 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374334da-27bc-4428-ac5b-9197019897e1 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:23.807073 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:23.833954 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e59f5e-1faa-4467-80f2-c8d830143a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:23.835343 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e59f5e-1faa-4467-80f2-c8d830143a76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:23.835902 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e59f5e-1faa-4467-80f2-c8d830143a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:23.836388 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e59f5e-1faa-4467-80f2-c8d830143a76 admin admin] PATH_INFO: `/v3/projects/d874153bdbff4a4db275deabdf712b2a` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:23.838155 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e59f5e-1faa-4467-80f2-c8d830143a76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d874153bdbff4a4db275deabdf712b2a)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:23.840984 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e59f5e-1faa-4467-80f2-c8d830143a76 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:23.886182 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-374334da-27bc-4428-ac5b-9197019897e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d3f1bf003484ae4987e71ff4c3c6dd7', 'request_id': 'req-374334da-27bc-4428-ac5b-9197019897e1'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:23.899675 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-374334da-27bc-4428-ac5b-9197019897e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d3f1bf003484ae4987e71ff4c3c6dd7', 'request_id': 'req-374334da-27bc-4428-ac5b-9197019897e1'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:23.917830 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-374334da-27bc-4428-ac5b-9197019897e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d3f1bf003484ae4987e71ff4c3c6dd7', 'request_id': 'req-374334da-27bc-4428-ac5b-9197019897e1'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:23.938783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-04e59f5e-1faa-4467-80f2-c8d830143a76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd874153bdbff4a4db275deabdf712b2a', 'request_id': 'req-04e59f5e-1faa-4467-80f2-c8d830143a76'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:23.949654 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-374334da-27bc-4428-ac5b-9197019897e1 admin admin] The token cache is being invalidate because project 0d3f1bf003484ae4987e71ff4c3c6dd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:29:23.949654 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-374334da-27bc-4428-ac5b-9197019897e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:23.949654 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-374334da-27bc-4428-ac5b-9197019897e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:23.949654 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1050/2106] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:29:23 2022] DELETE /identity/v3/projects/0d3f1bf003484ae4987e71ff4c3c6dd7 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:23.953848 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374334da-27bc-4428-ac5b-9197019897e1 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:23.956175 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-374334da-27bc-4428-ac5b-9197019897e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:23.967253 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-04e59f5e-1faa-4467-80f2-c8d830143a76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd874153bdbff4a4db275deabdf712b2a', 'request_id': 'req-04e59f5e-1faa-4467-80f2-c8d830143a76'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:23.971941 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:23.992891 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-04e59f5e-1faa-4467-80f2-c8d830143a76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd874153bdbff4a4db275deabdf712b2a', 'request_id': 'req-04e59f5e-1faa-4467-80f2-c8d830143a76'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:24.016624 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-04e59f5e-1faa-4467-80f2-c8d830143a76 admin admin] The token cache is being invalidate because project d874153bdbff4a4db275deabdf712b2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:29:24.017606 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-04e59f5e-1faa-4467-80f2-c8d830143a76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:24.018727 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-04e59f5e-1faa-4467-80f2-c8d830143a76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:24.021789 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1057/2107] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:29:23 2022] DELETE /identity/v3/projects/d874153bdbff4a4db275deabdf712b2a => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:29:24.029595 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28690f-ac07-4369-beae-bbdc67fe6cc1 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:24.052611 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28690f-ac07-4369-beae-bbdc67fe6cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:24.053706 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28690f-ac07-4369-beae-bbdc67fe6cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:24.080459 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374334da-27bc-4428-ac5b-9197019897e1 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:24.106247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-5d28690f-ac07-4369-beae-bbdc67fe6cc1 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:24.108697 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-5d28690f-ac07-4369-beae-bbdc67fe6cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:24.176961 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ab581-bb38-4f5c-b2f4-41c7445cd82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:24.177703 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ab581-bb38-4f5c-b2f4-41c7445cd82a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:24.177979 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ab581-bb38-4f5c-b2f4-41c7445cd82a admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:24.178251 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ab581-bb38-4f5c-b2f4-41c7445cd82a admin admin] PATH_INFO: `/v3/users/44302b2883544e3fbdb019b3d2302c68` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:24.179605 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ab581-bb38-4f5c-b2f4-41c7445cd82a admin admin] RBAC: Authorizing `identity:delete_user(user_id=44302b2883544e3fbdb019b3d2302c68)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:24.183239 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ab581-bb38-4f5c-b2f4-41c7445cd82a admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:24.230512 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1058/2108] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:24.240633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc620b9d-9de4-49a7-b050-b7c497c4f732 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:24.240941 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc620b9d-9de4-49a7-b050-b7c497c4f732 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:24.241229 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc620b9d-9de4-49a7-b050-b7c497c4f732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:24.265603 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-fc620b9d-9de4-49a7-b050-b7c497c4f732 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:24.267030 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-fc620b9d-9de4-49a7-b050-b7c497c4f732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:24.287853 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1059/2109] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:24.290892 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-f07ab581-bb38-4f5c-b2f4-41c7445cd82a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44302b2883544e3fbdb019b3d2302c68'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:24.293903 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-f07ab581-bb38-4f5c-b2f4-41c7445cd82a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44302b2883544e3fbdb019b3d2302c68'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:24.296000 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc620b9d-9de4-49a7-b050-b7c497c4f732 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:24.303057 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:24.311590 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-f07ab581-bb38-4f5c-b2f4-41c7445cd82a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44302b2883544e3fbdb019b3d2302c68'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:24.316497 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc620b9d-9de4-49a7-b050-b7c497c4f732 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:24.322485 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e3bbb-15dd-4582-b9a8-1cdad96e29e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:24.323118 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e3bbb-15dd-4582-b9a8-1cdad96e29e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:24.323469 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e3bbb-15dd-4582-b9a8-1cdad96e29e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:24.323821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e3bbb-15dd-4582-b9a8-1cdad96e29e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:24.325064 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e3bbb-15dd-4582-b9a8-1cdad96e29e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:29:24.325390 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e3bbb-15dd-4582-b9a8-1cdad96e29e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:24.327129 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e3bbb-15dd-4582-b9a8-1cdad96e29e7 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:24.330951 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-f07ab581-bb38-4f5c-b2f4-41c7445cd82a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44302b2883544e3fbdb019b3d2302c68'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:24.346834 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1060/2110] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:29:24.352504 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e3bbb-15dd-4582-b9a8-1cdad96e29e7 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:24.354548 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-9e5e3bbb-15dd-4582-b9a8-1cdad96e29e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:24.364179 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-f07ab581-bb38-4f5c-b2f4-41c7445cd82a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44302b2883544e3fbdb019b3d2302c68'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:24.374865 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1051/2111] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:29:23 2022] DELETE /identity/v3/users/44302b2883544e3fbdb019b3d2302c68 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:29:24.376215 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ab581-bb38-4f5c-b2f4-41c7445cd82a admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:24.378070 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-f07ab581-bb38-4f5c-b2f4-41c7445cd82a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:24.393826 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e3bbb-15dd-4582-b9a8-1cdad96e29e7 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:24.480245 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ab581-bb38-4f5c-b2f4-41c7445cd82a admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:24.491329 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07492f-6bef-4785-9639-d09c07156896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:24.492488 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07492f-6bef-4785-9639-d09c07156896 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:24.492975 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07492f-6bef-4785-9639-d09c07156896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:24.493535 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07492f-6bef-4785-9639-d09c07156896 admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:24.494884 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07492f-6bef-4785-9639-d09c07156896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:24.500225 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07492f-6bef-4785-9639-d09c07156896 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:24.576399 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1052/2112] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:29:24 2022] POST /identity/v3/projects => generated 387 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:29:24.595369 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07492f-6bef-4785-9639-d09c07156896 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:24.674262 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd80c7-2cf4-44c1-a8e8-5eb45d419465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:24.674945 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd80c7-2cf4-44c1-a8e8-5eb45d419465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:24.675242 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd80c7-2cf4-44c1-a8e8-5eb45d419465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:24.677345 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd80c7-2cf4-44c1-a8e8-5eb45d419465 admin admin] PATH_INFO: `/v3/users/ccb52560704141fe946ff499d57024cc` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:24.682534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd80c7-2cf4-44c1-a8e8-5eb45d419465 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccb52560704141fe946ff499d57024cc)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:24.687718 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd80c7-2cf4-44c1-a8e8-5eb45d419465 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:24.804620 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-9edd80c7-2cf4-44c1-a8e8-5eb45d419465 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccb52560704141fe946ff499d57024cc'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:24.806829 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-9edd80c7-2cf4-44c1-a8e8-5eb45d419465 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccb52560704141fe946ff499d57024cc'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:24.829902 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-9edd80c7-2cf4-44c1-a8e8-5eb45d419465 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccb52560704141fe946ff499d57024cc'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:24.844810 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07492f-6bef-4785-9639-d09c07156896 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:24.847025 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-9edd80c7-2cf4-44c1-a8e8-5eb45d419465 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccb52560704141fe946ff499d57024cc'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:24.848240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-9edd80c7-2cf4-44c1-a8e8-5eb45d419465 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccb52560704141fe946ff499d57024cc'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:24.850941 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e6d3d-39c4-4fda-b0c4-a29a3a3e4a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:24.852245 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e6d3d-39c4-4fda-b0c4-a29a3a3e4a49 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:24.852513 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e6d3d-39c4-4fda-b0c4-a29a3a3e4a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:24.852817 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e6d3d-39c4-4fda-b0c4-a29a3a3e4a49 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:24.853616 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e6d3d-39c4-4fda-b0c4-a29a3a3e4a49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:24.853736 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:24.856341 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e6d3d-39c4-4fda-b0c4-a29a3a3e4a49 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:24.905600 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1053/2114] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:29:24 2022] POST /identity/v3/users => generated 294 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:29:24.905825 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1061/2114] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:29:24 2022] DELETE /identity/v3/users/ccb52560704141fe946ff499d57024cc => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:29:24.906861 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd80c7-2cf4-44c1-a8e8-5eb45d419465 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:24.907463 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4948f91-95f3-4aa4-a6f1-24badd1c8da7 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:24.909018 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-9edd80c7-2cf4-44c1-a8e8-5eb45d419465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:24.909842 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4948f91-95f3-4aa4-a6f1-24badd1c8da7 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:24.911532 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4948f91-95f3-4aa4-a6f1-24badd1c8da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:24.951647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-a4948f91-95f3-4aa4-a6f1-24badd1c8da7 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:24.952915 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-a4948f91-95f3-4aa4-a6f1-24badd1c8da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:25.019062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:25.039537 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd80c7-2cf4-44c1-a8e8-5eb45d419465 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:25.048885 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664051e-77cb-401e-ae2c-5e4d749724a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:25.049920 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664051e-77cb-401e-ae2c-5e4d749724a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:25.050375 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664051e-77cb-401e-ae2c-5e4d749724a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:25.051022 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664051e-77cb-401e-ae2c-5e4d749724a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:25.051908 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664051e-77cb-401e-ae2c-5e4d749724a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:25.054130 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664051e-77cb-401e-ae2c-5e4d749724a5 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:25.069128 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1062/2115] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:29:25.070531 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664051e-77cb-401e-ae2c-5e4d749724a5 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:25.078569 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-f664051e-77cb-401e-ae2c-5e4d749724a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:25.078835 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1054/2116] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:25.078835 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4948f91-95f3-4aa4-a6f1-24badd1c8da7 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:25.098725 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4948f91-95f3-4aa4-a6f1-24badd1c8da7 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:25.106683 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54221c-df9c-4da1-aab9-7e6b127d89ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:25.107888 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54221c-df9c-4da1-aab9-7e6b127d89ec admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:25.108407 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54221c-df9c-4da1-aab9-7e6b127d89ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:25.108796 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54221c-df9c-4da1-aab9-7e6b127d89ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:25.109669 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664051e-77cb-401e-ae2c-5e4d749724a5 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:25.109873 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54221c-df9c-4da1-aab9-7e6b127d89ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:25.111760 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54221c-df9c-4da1-aab9-7e6b127d89ec admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:25.115570 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7c1b9-439c-45d0-a41c-02a57cf215d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:25.116577 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7c1b9-439c-45d0-a41c-02a57cf215d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:25.116953 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7c1b9-439c-45d0-a41c-02a57cf215d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:25.117327 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7c1b9-439c-45d0-a41c-02a57cf215d5 admin admin] PATH_INFO: `/v3/projects/44b4d1727c0842fea532267b29d89520` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:25.119151 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7c1b9-439c-45d0-a41c-02a57cf215d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44b4d1727c0842fea532267b29d89520)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:25.122389 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7c1b9-439c-45d0-a41c-02a57cf215d5 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:25.133600 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1055/2117] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:29:25.134544 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54221c-df9c-4da1-aab9-7e6b127d89ec admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:25.139362 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-be54221c-df9c-4da1-aab9-7e6b127d89ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:25.206913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-70c7c1b9-439c-45d0-a41c-02a57cf215d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44b4d1727c0842fea532267b29d89520', 'request_id': 'req-70c7c1b9-439c-45d0-a41c-02a57cf215d5'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:25.234307 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-70c7c1b9-439c-45d0-a41c-02a57cf215d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44b4d1727c0842fea532267b29d89520', 'request_id': 'req-70c7c1b9-439c-45d0-a41c-02a57cf215d5'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:25.234741 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54221c-df9c-4da1-aab9-7e6b127d89ec admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:25.260760 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-70c7c1b9-439c-45d0-a41c-02a57cf215d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44b4d1727c0842fea532267b29d89520', 'request_id': 'req-70c7c1b9-439c-45d0-a41c-02a57cf215d5'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:25.279389 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-70c7c1b9-439c-45d0-a41c-02a57cf215d5 admin admin] The token cache is being invalidate because project 44b4d1727c0842fea532267b29d89520 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:29:25.279696 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-70c7c1b9-439c-45d0-a41c-02a57cf215d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:25.280899 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-70c7c1b9-439c-45d0-a41c-02a57cf215d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:25.282567 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1063/2118] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:29:25 2022] DELETE /identity/v3/projects/44b4d1727c0842fea532267b29d89520 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:25.283555 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7c1b9-439c-45d0-a41c-02a57cf215d5 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:25.287534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-70c7c1b9-439c-45d0-a41c-02a57cf215d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:25.327333 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7b349-ae14-42d5-8337-dce9676cd98b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:25.328278 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7b349-ae14-42d5-8337-dce9676cd98b service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:25.328705 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7b349-ae14-42d5-8337-dce9676cd98b service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:25.329060 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7b349-ae14-42d5-8337-dce9676cd98b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:25.331367 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-d6e7b349-ae14-42d5-8337-dce9676cd98b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:25.398175 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7c1b9-439c-45d0-a41c-02a57cf215d5 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:25.405230 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d63f8-0733-44d0-9ed6-becf716b99ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:25.405996 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d63f8-0733-44d0-9ed6-becf716b99ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:25.406337 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d63f8-0733-44d0-9ed6-becf716b99ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:25.406651 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d63f8-0733-44d0-9ed6-becf716b99ad admin admin] PATH_INFO: `/v3/projects/88bb58d6fcb641ae9b20b7041bde0579/users/c4aa1c394e8445adbb4bf668ce056a38/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:25.411362 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:25.430254 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d63f8-0733-44d0-9ed6-becf716b99ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=88bb58d6fcb641ae9b20b7041bde0579, user_id=c4aa1c394e8445adbb4bf668ce056a38, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:25.439224 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d63f8-0733-44d0-9ed6-becf716b99ad admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:25.461361 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1064/2119] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:29:25 2022] PUT /identity/v3/projects/88bb58d6fcb641ae9b20b7041bde0579/users/c4aa1c394e8445adbb4bf668ce056a38/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:25.461679 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7b349-ae14-42d5-8337-dce9676cd98b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:25.462610 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d63f8-0733-44d0-9ed6-becf716b99ad admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:25.463078 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7b349-ae14-42d5-8337-dce9676cd98b service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:25.464897 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-8c0d63f8-0733-44d0-9ed6-becf716b99ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:25.479036 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1056/2120] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:25.483042 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643f6bd-5639-4a64-b991-5bb67154e8b2 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:25.483363 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643f6bd-5639-4a64-b991-5bb67154e8b2 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:25.483783 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643f6bd-5639-4a64-b991-5bb67154e8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:25.509095 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-4643f6bd-5639-4a64-b991-5bb67154e8b2 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:25.511249 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-4643f6bd-5639-4a64-b991-5bb67154e8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:25.588719 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:25.599407 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d63f8-0733-44d0-9ed6-becf716b99ad admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:25.612892 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccfcc8-bc74-4e67-a0ca-2554a2ea2ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:25.613816 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccfcc8-bc74-4e67-a0ca-2554a2ea2ed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:25.613931 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccfcc8-bc74-4e67-a0ca-2554a2ea2ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:25.614202 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccfcc8-bc74-4e67-a0ca-2554a2ea2ed1 admin admin] PATH_INFO: `/v3/users/8a4c674c94ab4169998209a5cd04a985` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:25.615509 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ccfcc8-bc74-4e67-a0ca-2554a2ea2ed1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a4c674c94ab4169998209a5cd04a985)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:25.617554 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ccfcc8-bc74-4e67-a0ca-2554a2ea2ed1 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:25.663314 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1057/2121] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:25.683318 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643f6bd-5639-4a64-b991-5bb67154e8b2 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:25.686408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-4643f6bd-5639-4a64-b991-5bb67154e8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:25.701070 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-21ccfcc8-bc74-4e67-a0ca-2554a2ea2ed1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a4c674c94ab4169998209a5cd04a985'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:25.702296 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-21ccfcc8-bc74-4e67-a0ca-2554a2ea2ed1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a4c674c94ab4169998209a5cd04a985'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:25.717874 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-21ccfcc8-bc74-4e67-a0ca-2554a2ea2ed1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a4c674c94ab4169998209a5cd04a985'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:25.731879 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-21ccfcc8-bc74-4e67-a0ca-2554a2ea2ed1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a4c674c94ab4169998209a5cd04a985'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:25.731879 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-21ccfcc8-bc74-4e67-a0ca-2554a2ea2ed1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a4c674c94ab4169998209a5cd04a985'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:25.777393 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1065/2122] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:29:25 2022] DELETE /identity/v3/users/8a4c674c94ab4169998209a5cd04a985 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:25.826776 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643f6bd-5639-4a64-b991-5bb67154e8b2 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:25.957914 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44427c-3956-4381-b02f-deb691a36aec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:25.959688 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44427c-3956-4381-b02f-deb691a36aec service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:25.960189 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44427c-3956-4381-b02f-deb691a36aec service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:25.960694 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44427c-3956-4381-b02f-deb691a36aec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:25.967065 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-0e44427c-3956-4381-b02f-deb691a36aec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:26.157494 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e44427c-3956-4381-b02f-deb691a36aec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:26.162248 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e44427c-3956-4381-b02f-deb691a36aec service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:26.192345 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1058/2123] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:29:26.495745 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccfcc8-bc74-4e67-a0ca-2554a2ea2ed1 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:26.503125 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-21ccfcc8-bc74-4e67-a0ca-2554a2ea2ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:26.536896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccfcc8-bc74-4e67-a0ca-2554a2ea2ed1 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:26.543614 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a10d97-e0b1-43a8-ac01-1158b0438c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:26.544502 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a10d97-e0b1-43a8-ac01-1158b0438c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:26.544893 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a10d97-e0b1-43a8-ac01-1158b0438c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:26.545275 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a10d97-e0b1-43a8-ac01-1158b0438c4a admin admin] PATH_INFO: `/v3/projects/a3e1d6f1e4c948ac9fb0142a28187bcc` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:26.547974 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a10d97-e0b1-43a8-ac01-1158b0438c4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3e1d6f1e4c948ac9fb0142a28187bcc)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:26.552823 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a10d97-e0b1-43a8-ac01-1158b0438c4a admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:26.666538 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-63a10d97-e0b1-43a8-ac01-1158b0438c4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3e1d6f1e4c948ac9fb0142a28187bcc', 'request_id': 'req-63a10d97-e0b1-43a8-ac01-1158b0438c4a'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:26.676459 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-63a10d97-e0b1-43a8-ac01-1158b0438c4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3e1d6f1e4c948ac9fb0142a28187bcc', 'request_id': 'req-63a10d97-e0b1-43a8-ac01-1158b0438c4a'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:26.683856 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=82,keystone:INSERT=3,keystone:DELETE=15 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:26.700526 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-63a10d97-e0b1-43a8-ac01-1158b0438c4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3e1d6f1e4c948ac9fb0142a28187bcc', 'request_id': 'req-63a10d97-e0b1-43a8-ac01-1158b0438c4a'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:26.727869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-63a10d97-e0b1-43a8-ac01-1158b0438c4a admin admin] The token cache is being invalidate because project a3e1d6f1e4c948ac9fb0142a28187bcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:29:26.728393 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-63a10d97-e0b1-43a8-ac01-1158b0438c4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:26.733911 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-63a10d97-e0b1-43a8-ac01-1158b0438c4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:26.741583 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1066/2124] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:29:26 2022] DELETE /identity/v3/projects/a3e1d6f1e4c948ac9fb0142a28187bcc => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:29:26.751203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10d89e-b734-463d-b216-2800359cd0a1 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:26.752168 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10d89e-b734-463d-b216-2800359cd0a1 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:26.752723 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10d89e-b734-463d-b216-2800359cd0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:26.794271 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-3e10d89e-b734-463d-b216-2800359cd0a1 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:26.797739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-3e10d89e-b734-463d-b216-2800359cd0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:26.817534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a10d97-e0b1-43a8-ac01-1158b0438c4a admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:26.822351 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-63a10d97-e0b1-43a8-ac01-1158b0438c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:26.878180 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:26.924746 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1059/2125] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:26.936291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45772522-4e29-42cc-961a-f52998322ba1 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:26.937267 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45772522-4e29-42cc-961a-f52998322ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:26.937667 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45772522-4e29-42cc-961a-f52998322ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:26.974516 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-45772522-4e29-42cc-961a-f52998322ba1 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:26.977270 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-45772522-4e29-42cc-961a-f52998322ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:26.979220 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a10d97-e0b1-43a8-ac01-1158b0438c4a admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:26.989170 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee4997-1178-4258-9931-6e6868b4dcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:26.990233 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee4997-1178-4258-9931-6e6868b4dcec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:26.990592 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee4997-1178-4258-9931-6e6868b4dcec admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:26.990833 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee4997-1178-4258-9931-6e6868b4dcec admin admin] PATH_INFO: `/v3/projects/7099441bd0e744c0be8c12de1ff8b484` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:26.991262 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1060/2126] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:26.996406 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45772522-4e29-42cc-961a-f52998322ba1 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:26.999627 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee4997-1178-4258-9931-6e6868b4dcec admin admin] RBAC: Authorizing `identity:delete_project(project_id=7099441bd0e744c0be8c12de1ff8b484)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:27.000656 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee4997-1178-4258-9931-6e6868b4dcec admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:27.009923 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45772522-4e29-42cc-961a-f52998322ba1 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:27.023333 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19080a4-9dae-4279-b0d0-7a45eec53b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:27.023604 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19080a4-9dae-4279-b0d0-7a45eec53b73 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:27.023996 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19080a4-9dae-4279-b0d0-7a45eec53b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:27.024791 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19080a4-9dae-4279-b0d0-7a45eec53b73 admin admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:27.025446 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19080a4-9dae-4279-b0d0-7a45eec53b73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:29:27.025819 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19080a4-9dae-4279-b0d0-7a45eec53b73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:27.028326 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19080a4-9dae-4279-b0d0-7a45eec53b73 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:27.049611 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1061/2127] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:29:27.053510 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19080a4-9dae-4279-b0d0-7a45eec53b73 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:27.069264 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19080a4-9dae-4279-b0d0-7a45eec53b73 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:27.084924 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-5eee4997-1178-4258-9931-6e6868b4dcec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7099441bd0e744c0be8c12de1ff8b484', 'request_id': 'req-5eee4997-1178-4258-9931-6e6868b4dcec'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:27.094884 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-5eee4997-1178-4258-9931-6e6868b4dcec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7099441bd0e744c0be8c12de1ff8b484', 'request_id': 'req-5eee4997-1178-4258-9931-6e6868b4dcec'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:27.104204 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-5eee4997-1178-4258-9931-6e6868b4dcec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7099441bd0e744c0be8c12de1ff8b484', 'request_id': 'req-5eee4997-1178-4258-9931-6e6868b4dcec'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:27.123682 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-5eee4997-1178-4258-9931-6e6868b4dcec admin admin] The token cache is being invalidate because project 7099441bd0e744c0be8c12de1ff8b484 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:29:27.124088 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-5eee4997-1178-4258-9931-6e6868b4dcec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:27.124922 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-5eee4997-1178-4258-9931-6e6868b4dcec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:27.130808 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1067/2128] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:29:26 2022] DELETE /identity/v3/projects/7099441bd0e744c0be8c12de1ff8b484 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:27.133200 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3055e7c-4494-4b16-a115-e6452d1402b6 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:27.133709 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3055e7c-4494-4b16-a115-e6452d1402b6 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:27.134140 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3055e7c-4494-4b16-a115-e6452d1402b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:27.166095 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-e3055e7c-4494-4b16-a115-e6452d1402b6 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:27.167878 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-e3055e7c-4494-4b16-a115-e6452d1402b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:27.205677 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae8c23-ffcb-4204-8335-eddc53e25cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:27.207614 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae8c23-ffcb-4204-8335-eddc53e25cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:27.208349 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae8c23-ffcb-4204-8335-eddc53e25cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:27.209058 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae8c23-ffcb-4204-8335-eddc53e25cd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:27.210284 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae8c23-ffcb-4204-8335-eddc53e25cd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:27.216402 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae8c23-ffcb-4204-8335-eddc53e25cd9 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:27.284466 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1062/2129] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:29:27 2022] POST /identity/v3/projects => generated 361 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:29:27.288681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae8c23-ffcb-4204-8335-eddc53e25cd9 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:27.294134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-03ae8c23-ffcb-4204-8335-eddc53e25cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:27.297096 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1068/2130] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:27.307466 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5d1e4-7ca8-48b6-9ad9-536373d5348a None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:27.309735 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5d1e4-7ca8-48b6-9ad9-536373d5348a None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:27.310366 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5d1e4-7ca8-48b6-9ad9-536373d5348a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:27.381294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-48d5d1e4-7ca8-48b6-9ad9-536373d5348a None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:27.385987 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-48d5d1e4-7ca8-48b6-9ad9-536373d5348a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:27.422302 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:27.462498 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae8c23-ffcb-4204-8335-eddc53e25cd9 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:27.474873 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10baf781-6afe-4b9d-a32f-77c8bb04ab30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:27.475486 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10baf781-6afe-4b9d-a32f-77c8bb04ab30 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:27.475837 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10baf781-6afe-4b9d-a32f-77c8bb04ab30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:27.476531 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10baf781-6afe-4b9d-a32f-77c8bb04ab30 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:27.476816 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10baf781-6afe-4b9d-a32f-77c8bb04ab30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:27.494584 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10baf781-6afe-4b9d-a32f-77c8bb04ab30 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:27.532984 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1063/2131] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:29:27 2022] POST /identity/v3/users => generated 281 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:29:27.539985 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10baf781-6afe-4b9d-a32f-77c8bb04ab30 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:27.563913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1069/2132] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:27.565685 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5d1e4-7ca8-48b6-9ad9-536373d5348a None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:27.570608 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10baf781-6afe-4b9d-a32f-77c8bb04ab30 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:27.585898 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5d1e4-7ca8-48b6-9ad9-536373d5348a None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:27.591293 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08764e0a-92f9-4000-a58b-ce5771f54849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:27.591998 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08764e0a-92f9-4000-a58b-ce5771f54849 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:27.592311 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08764e0a-92f9-4000-a58b-ce5771f54849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:27.592615 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08764e0a-92f9-4000-a58b-ce5771f54849 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:27.593403 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08764e0a-92f9-4000-a58b-ce5771f54849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:27.595115 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08764e0a-92f9-4000-a58b-ce5771f54849 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:27.602747 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d699247-b178-45b6-aae0-6d61e1ab79b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:27.603449 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d699247-b178-45b6-aae0-6d61e1ab79b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:27.605249 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d699247-b178-45b6-aae0-6d61e1ab79b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:27.607265 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d699247-b178-45b6-aae0-6d61e1ab79b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:27.608249 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d699247-b178-45b6-aae0-6d61e1ab79b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:29:27.608620 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d699247-b178-45b6-aae0-6d61e1ab79b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:27.612235 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d699247-b178-45b6-aae0-6d61e1ab79b1 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:27.629762 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1064/2133] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:29:27.631929 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08764e0a-92f9-4000-a58b-ce5771f54849 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:27.643694 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1070/2134] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:29:27.650190 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d699247-b178-45b6-aae0-6d61e1ab79b1 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:27.660406 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08764e0a-92f9-4000-a58b-ce5771f54849 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:27.669030 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495ba0f-ef13-4c1b-aee0-1110b577bb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:27.669855 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495ba0f-ef13-4c1b-aee0-1110b577bb6a admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:27.670580 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495ba0f-ef13-4c1b-aee0-1110b577bb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:27.671002 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495ba0f-ef13-4c1b-aee0-1110b577bb6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:27.671931 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495ba0f-ef13-4c1b-aee0-1110b577bb6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:27.673806 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495ba0f-ef13-4c1b-aee0-1110b577bb6a admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:27.674409 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d699247-b178-45b6-aae0-6d61e1ab79b1 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:27.683016 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806872c6-3471-4cc1-ad95-1a7568c18a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:27.685983 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806872c6-3471-4cc1-ad95-1a7568c18a4c admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:27.686704 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806872c6-3471-4cc1-ad95-1a7568c18a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:27.687176 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806872c6-3471-4cc1-ad95-1a7568c18a4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:27.688317 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806872c6-3471-4cc1-ad95-1a7568c18a4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:27.694408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1065/2135] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:29:27.696840 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495ba0f-ef13-4c1b-aee0-1110b577bb6a admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:27.701897 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806872c6-3471-4cc1-ad95-1a7568c18a4c admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:27.718015 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495ba0f-ef13-4c1b-aee0-1110b577bb6a admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:27.725554 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdb0aa-9e67-462a-bb42-49604fd0f1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:27.726343 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdb0aa-9e67-462a-bb42-49604fd0f1cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:27.726799 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdb0aa-9e67-462a-bb42-49604fd0f1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:27.727154 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdb0aa-9e67-462a-bb42-49604fd0f1cf admin admin] PATH_INFO: `/v3/projects/afa49e6a960c40e5944e5b21485beacf/users/27c4651258df490ba81ff38670439db2/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:27.758433 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1071/2136] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:29:27 2022] POST /identity/v3/projects => generated 369 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:29:27.763625 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:27.767412 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806872c6-3471-4cc1-ad95-1a7568c18a4c admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:27.779470 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cdb0aa-9e67-462a-bb42-49604fd0f1cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=afa49e6a960c40e5944e5b21485beacf, user_id=27c4651258df490ba81ff38670439db2, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:27.782746 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cdb0aa-9e67-462a-bb42-49604fd0f1cf admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:27.817424 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1066/2137] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:29:27 2022] PUT /identity/v3/projects/afa49e6a960c40e5944e5b21485beacf/users/27c4651258df490ba81ff38670439db2/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:27.828886 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b76fae-c983-4f74-98c0-50a1bffac3df None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:27.829171 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b76fae-c983-4f74-98c0-50a1bffac3df None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:27.829513 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b76fae-c983-4f74-98c0-50a1bffac3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:27.881406 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-12b76fae-c983-4f74-98c0-50a1bffac3df None None] MFA Rules not processed for user `27c4651258df490ba81ff38670439db2`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:27.881406 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-12b76fae-c983-4f74-98c0-50a1bffac3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:27.952297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806872c6-3471-4cc1-ad95-1a7568c18a4c admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:28.146838 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1067/2138] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:29:28.190594 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa94139-f954-4bc1-89b2-d455709807dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:28.190594 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa94139-f954-4bc1-89b2-d455709807dc admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:28.190594 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa94139-f954-4bc1-89b2-d455709807dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:28.190594 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa94139-f954-4bc1-89b2-d455709807dc admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:28.191188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa94139-f954-4bc1-89b2-d455709807dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:28.198598 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa94139-f954-4bc1-89b2-d455709807dc admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:28.208614 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b76fae-c983-4f74-98c0-50a1bffac3df None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:28.211046 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-12b76fae-c983-4f74-98c0-50a1bffac3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:28.260176 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1072/2139] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:29:27 2022] POST /identity/v3/users => generated 285 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:29:28.266965 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa94139-f954-4bc1-89b2-d455709807dc admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:28.293070 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa94139-f954-4bc1-89b2-d455709807dc admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:28.311176 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d856f1b-78ef-4678-b0ee-dfdff49d2dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:28.321015 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d856f1b-78ef-4678-b0ee-dfdff49d2dff admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:28.321572 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d856f1b-78ef-4678-b0ee-dfdff49d2dff admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:28.322371 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d856f1b-78ef-4678-b0ee-dfdff49d2dff admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:28.325670 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d856f1b-78ef-4678-b0ee-dfdff49d2dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:28.327786 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d856f1b-78ef-4678-b0ee-dfdff49d2dff admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:28.346555 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b76fae-c983-4f74-98c0-50a1bffac3df None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:28.352933 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdf97f-e6d3-49ac-bba0-e6d6ca2e3391 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:28.354113 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdf97f-e6d3-49ac-bba0-e6d6ca2e3391 service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:28.354725 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdf97f-e6d3-49ac-bba0-e6d6ca2e3391 service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:28.354838 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1073/2140] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:29:28.357112 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdf97f-e6d3-49ac-bba0-e6d6ca2e3391 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:28.366813 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d856f1b-78ef-4678-b0ee-dfdff49d2dff admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:28.378366 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bdf97f-e6d3-49ac-bba0-e6d6ca2e3391 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:28.381555 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bdf97f-e6d3-49ac-bba0-e6d6ca2e3391 service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:28.397609 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d856f1b-78ef-4678-b0ee-dfdff49d2dff admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:28.423126 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201f6c3-c5b8-4a9c-9f32-f455a9cd15a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:28.423126 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201f6c3-c5b8-4a9c-9f32-f455a9cd15a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:28.423126 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201f6c3-c5b8-4a9c-9f32-f455a9cd15a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:28.423126 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201f6c3-c5b8-4a9c-9f32-f455a9cd15a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:28.423851 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201f6c3-c5b8-4a9c-9f32-f455a9cd15a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:28.425600 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1068/2141] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:28.426294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201f6c3-c5b8-4a9c-9f32-f455a9cd15a3 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:28.427066 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdf97f-e6d3-49ac-bba0-e6d6ca2e3391 service cinder] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:28.434849 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:28.454927 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdf97f-e6d3-49ac-bba0-e6d6ca2e3391 service cinder] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:28.457236 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1074/2142] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:29:28.462617 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201f6c3-c5b8-4a9c-9f32-f455a9cd15a3 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:28.471239 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd8b338-8068-4c9d-88b9-bb264816554c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:28.471900 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8b338-8068-4c9d-88b9-bb264816554c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:28.472225 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8b338-8068-4c9d-88b9-bb264816554c admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:28.472512 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8b338-8068-4c9d-88b9-bb264816554c admin admin] PATH_INFO: `/v3/users/27c4651258df490ba81ff38670439db2` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:28.474901 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd8b338-8068-4c9d-88b9-bb264816554c admin admin] RBAC: Authorizing `identity:delete_user(user_id=27c4651258df490ba81ff38670439db2)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:28.475705 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201f6c3-c5b8-4a9c-9f32-f455a9cd15a3 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:28.477027 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd8b338-8068-4c9d-88b9-bb264816554c admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:28.487088 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4706f3-e8c5-42ec-9307-bdecb7b1e4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:28.487815 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4706f3-e8c5-42ec-9307-bdecb7b1e4f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:28.488076 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4706f3-e8c5-42ec-9307-bdecb7b1e4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:28.488879 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4706f3-e8c5-42ec-9307-bdecb7b1e4f0 admin admin] PATH_INFO: `/v3/projects/4fe05713f21042b4a78adaf547aae030/users/759b06113b7247db8e3a1fe9ded23172/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:28.511479 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4706f3-e8c5-42ec-9307-bdecb7b1e4f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fe05713f21042b4a78adaf547aae030, user_id=759b06113b7247db8e3a1fe9ded23172, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:28.520110 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4706f3-e8c5-42ec-9307-bdecb7b1e4f0 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:28.540622 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1075/2143] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:29:28 2022] PUT /identity/v3/projects/4fe05713f21042b4a78adaf547aae030/users/759b06113b7247db8e3a1fe9ded23172/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:28.555366 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30ea5f-d9b5-4d19-a505-065d3a03ad05 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:28.555682 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30ea5f-d9b5-4d19-a505-065d3a03ad05 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:28.556015 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30ea5f-d9b5-4d19-a505-065d3a03ad05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:28.599137 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-9c30ea5f-d9b5-4d19-a505-065d3a03ad05 None None] MFA Rules not processed for user `759b06113b7247db8e3a1fe9ded23172`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:28.601079 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-9c30ea5f-d9b5-4d19-a505-065d3a03ad05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:28.607384 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-1cd8b338-8068-4c9d-88b9-bb264816554c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27c4651258df490ba81ff38670439db2'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:28.608318 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-1cd8b338-8068-4c9d-88b9-bb264816554c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27c4651258df490ba81ff38670439db2'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:28.624704 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-1cd8b338-8068-4c9d-88b9-bb264816554c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27c4651258df490ba81ff38670439db2'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:28.644878 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-1cd8b338-8068-4c9d-88b9-bb264816554c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27c4651258df490ba81ff38670439db2'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:28.681513 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:28.685653 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-1cd8b338-8068-4c9d-88b9-bb264816554c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27c4651258df490ba81ff38670439db2'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:28.698132 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1069/2144] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:29:28 2022] DELETE /identity/v3/users/27c4651258df490ba81ff38670439db2 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:28.717005 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dfa571-1d5b-451d-a068-d61d5b806174 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:28.717411 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dfa571-1d5b-451d-a068-d61d5b806174 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:28.717772 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dfa571-1d5b-451d-a068-d61d5b806174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:28.761238 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-43dfa571-1d5b-451d-a068-d61d5b806174 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:28.762816 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-43dfa571-1d5b-451d-a068-d61d5b806174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:28.837443 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1076/2145] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:28.855156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30ea5f-d9b5-4d19-a505-065d3a03ad05 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:28.859990 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-9c30ea5f-d9b5-4d19-a505-065d3a03ad05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:28.965510 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1070/2146] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:29:29.020639 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30ea5f-d9b5-4d19-a505-065d3a03ad05 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:29.143771 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dfa571-1d5b-451d-a068-d61d5b806174 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:29.146399 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-43dfa571-1d5b-451d-a068-d61d5b806174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:29.150228 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a7d43-c108-4ad1-81b9-ec7108a7192e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '855cbc7a992d4c6697632d2d4d74abfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:29.151935 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a7d43-c108-4ad1-81b9-ec7108a7192e service glance] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:29.153009 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a7d43-c108-4ad1-81b9-ec7108a7192e service glance] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:29.153509 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a7d43-c108-4ad1-81b9-ec7108a7192e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:29.256379 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:29.316338 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dfa571-1d5b-451d-a068-d61d5b806174 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:29.333471 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d4dd4-0746-4c24-84bc-59a0f5b1416d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:29.333865 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d4dd4-0746-4c24-84bc-59a0f5b1416d service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:29.334164 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d4dd4-0746-4c24-84bc-59a0f5b1416d service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:29.334448 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d4dd4-0746-4c24-84bc-59a0f5b1416d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:29.365925 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a7d43-c108-4ad1-81b9-ec7108a7192e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:29.368177 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a7d43-c108-4ad1-81b9-ec7108a7192e service glance] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:29.368914 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d4dd4-0746-4c24-84bc-59a0f5b1416d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:29.372666 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d4dd4-0746-4c24-84bc-59a0f5b1416d service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:29.398233 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1071/2147] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:29.421250 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1077/2148] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:30.404276 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d4dd4-0746-4c24-84bc-59a0f5b1416d service neutron] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:30.408835 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-fe0d4dd4-0746-4c24-84bc-59a0f5b1416d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:30.458080 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d4dd4-0746-4c24-84bc-59a0f5b1416d service neutron] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:30.472474 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e257ef3-ce50-43ec-b378-94a3b9ec3592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:30.473662 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e257ef3-ce50-43ec-b378-94a3b9ec3592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:30.474124 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e257ef3-ce50-43ec-b378-94a3b9ec3592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:30.474657 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e257ef3-ce50-43ec-b378-94a3b9ec3592 admin admin] PATH_INFO: `/v3/projects/afa49e6a960c40e5944e5b21485beacf` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:30.476967 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e257ef3-ce50-43ec-b378-94a3b9ec3592 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afa49e6a960c40e5944e5b21485beacf)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:30.481274 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e257ef3-ce50-43ec-b378-94a3b9ec3592 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:30.653869 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-0e257ef3-ce50-43ec-b378-94a3b9ec3592 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afa49e6a960c40e5944e5b21485beacf', 'request_id': 'req-0e257ef3-ce50-43ec-b378-94a3b9ec3592'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:30.662645 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-0e257ef3-ce50-43ec-b378-94a3b9ec3592 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afa49e6a960c40e5944e5b21485beacf', 'request_id': 'req-0e257ef3-ce50-43ec-b378-94a3b9ec3592'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:30.675625 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-0e257ef3-ce50-43ec-b378-94a3b9ec3592 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afa49e6a960c40e5944e5b21485beacf', 'request_id': 'req-0e257ef3-ce50-43ec-b378-94a3b9ec3592'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:30.694037 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-0e257ef3-ce50-43ec-b378-94a3b9ec3592 admin admin] The token cache is being invalidate because project afa49e6a960c40e5944e5b21485beacf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:29:30.694331 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-0e257ef3-ce50-43ec-b378-94a3b9ec3592 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:30.695033 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-0e257ef3-ce50-43ec-b378-94a3b9ec3592 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:30.697176 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1072/2149] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:29:30 2022] DELETE /identity/v3/projects/afa49e6a960c40e5944e5b21485beacf => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:30.703071 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15caf8ac-2fed-4204-bc1a-133c29d6f405 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:30.703628 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15caf8ac-2fed-4204-bc1a-133c29d6f405 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:30.703715 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15caf8ac-2fed-4204-bc1a-133c29d6f405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:30.765492 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-15caf8ac-2fed-4204-bc1a-133c29d6f405 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:30.766772 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-15caf8ac-2fed-4204-bc1a-133c29d6f405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:30.917538 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1078/2150] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:30.927955 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270af593-70d6-41b1-a7f2-b4f7194431b9 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:30.928251 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270af593-70d6-41b1-a7f2-b4f7194431b9 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:30.928529 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270af593-70d6-41b1-a7f2-b4f7194431b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:30.963496 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-270af593-70d6-41b1-a7f2-b4f7194431b9 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:30.966764 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-270af593-70d6-41b1-a7f2-b4f7194431b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:30.979764 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1073/2151] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:30.984534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15caf8ac-2fed-4204-bc1a-133c29d6f405 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:31.002268 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15caf8ac-2fed-4204-bc1a-133c29d6f405 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:31.014183 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9d0ca-b027-4fee-90e9-6fa574143886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:31.015103 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9d0ca-b027-4fee-90e9-6fa574143886 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:31.020480 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9d0ca-b027-4fee-90e9-6fa574143886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:31.021079 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9d0ca-b027-4fee-90e9-6fa574143886 admin admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:31.022042 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9d0ca-b027-4fee-90e9-6fa574143886 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:29:31.022583 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9d0ca-b027-4fee-90e9-6fa574143886 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:31.025236 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9d0ca-b027-4fee-90e9-6fa574143886 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:31.054997 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1079/2152] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:29:31.060740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270af593-70d6-41b1-a7f2-b4f7194431b9 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:31.076944 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270af593-70d6-41b1-a7f2-b4f7194431b9 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:31.087561 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7f59c-989e-46f3-9356-1f7d3c613cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:31.088339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7f59c-989e-46f3-9356-1f7d3c613cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:31.088866 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7f59c-989e-46f3-9356-1f7d3c613cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:31.089150 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7f59c-989e-46f3-9356-1f7d3c613cf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:31.090664 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7f59c-989e-46f3-9356-1f7d3c613cf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:31.093334 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7f59c-989e-46f3-9356-1f7d3c613cf8 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:31.126791 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:31.182263 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1074/2153] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:29:31 2022] POST /identity/v3/projects => generated 389 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:29:31.183505 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9d0ca-b027-4fee-90e9-6fa574143886 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:31.203444 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9d0ca-b027-4fee-90e9-6fa574143886 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:31.322245 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f8595-61a6-4b9c-aa9e-90f87f15d084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:31.323810 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f8595-61a6-4b9c-aa9e-90f87f15d084 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:31.324611 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f8595-61a6-4b9c-aa9e-90f87f15d084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:31.325115 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f8595-61a6-4b9c-aa9e-90f87f15d084 admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:31.326337 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f8595-61a6-4b9c-aa9e-90f87f15d084 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:31.330320 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f8595-61a6-4b9c-aa9e-90f87f15d084 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:31.374169 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1080/2154] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:29:31 2022] POST /identity/v3/users => generated 295 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:29:31.378690 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7f59c-989e-46f3-9356-1f7d3c613cf8 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:31.391730 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7f59c-989e-46f3-9356-1f7d3c613cf8 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:31.399284 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a9f65-f637-455e-84b8-35c7b3e980e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:31.400271 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a9f65-f637-455e-84b8-35c7b3e980e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:31.400566 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a9f65-f637-455e-84b8-35c7b3e980e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:31.400846 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a9f65-f637-455e-84b8-35c7b3e980e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:31.402215 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a9f65-f637-455e-84b8-35c7b3e980e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:31.404579 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a9f65-f637-455e-84b8-35c7b3e980e9 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:31.423222 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1075/2155] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:29:31.427327 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f8595-61a6-4b9c-aa9e-90f87f15d084 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:31.470510 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f8595-61a6-4b9c-aa9e-90f87f15d084 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:31.492674 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2c709-14d3-432b-ae0f-fd7d3d75c94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:31.494052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2c709-14d3-432b-ae0f-fd7d3d75c94c admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:31.494463 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2c709-14d3-432b-ae0f-fd7d3d75c94c admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:31.494850 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2c709-14d3-432b-ae0f-fd7d3d75c94c admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:31.495689 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2c709-14d3-432b-ae0f-fd7d3d75c94c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:31.497890 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2c709-14d3-432b-ae0f-fd7d3d75c94c admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:31.512737 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1081/2156] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:29:31.517053 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a9f65-f637-455e-84b8-35c7b3e980e9 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:31.528241 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a9f65-f637-455e-84b8-35c7b3e980e9 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:31.534126 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161ba60-4ad0-4436-ac74-944e28b6fb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:31.534805 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161ba60-4ad0-4436-ac74-944e28b6fb15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:31.535529 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161ba60-4ad0-4436-ac74-944e28b6fb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:31.535529 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161ba60-4ad0-4436-ac74-944e28b6fb15 admin admin] PATH_INFO: `/v3/projects/fa1555bb331c43a291061b72cb58773d/users/605363978c934d6eabf304de7d13ea9d/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:31.553710 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161ba60-4ad0-4436-ac74-944e28b6fb15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa1555bb331c43a291061b72cb58773d, user_id=605363978c934d6eabf304de7d13ea9d, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:31.556423 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161ba60-4ad0-4436-ac74-944e28b6fb15 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:31.577433 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1076/2157] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:29:31 2022] PUT /identity/v3/projects/fa1555bb331c43a291061b72cb58773d/users/605363978c934d6eabf304de7d13ea9d/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:31.585141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54632b-ad55-46ab-b80c-a88f373d2929 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:31.585458 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54632b-ad55-46ab-b80c-a88f373d2929 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:31.585801 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54632b-ad55-46ab-b80c-a88f373d2929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:31.617252 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-ed54632b-ad55-46ab-b80c-a88f373d2929 None None] MFA Rules not processed for user `605363978c934d6eabf304de7d13ea9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:31.618559 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-ed54632b-ad55-46ab-b80c-a88f373d2929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:31.664276 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:31.718822 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1082/2158] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:31.728024 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161ba60-4ad0-4436-ac74-944e28b6fb15 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:31.729821 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-3161ba60-4ad0-4436-ac74-944e28b6fb15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:31.817970 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161ba60-4ad0-4436-ac74-944e28b6fb15 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:31.823228 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1dd0ab-91d4-46a3-bc79-29b192cab68d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:31.824134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1dd0ab-91d4-46a3-bc79-29b192cab68d service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:31.825045 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1dd0ab-91d4-46a3-bc79-29b192cab68d service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:31.825990 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1dd0ab-91d4-46a3-bc79-29b192cab68d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:31.835062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1dd0ab-91d4-46a3-bc79-29b192cab68d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:31.836360 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1dd0ab-91d4-46a3-bc79-29b192cab68d service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:31.855132 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1077/2159] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:31 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:34.687846 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe992a76-bd36-4696-9f6b-4dbca123fa0e None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:34.688472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe992a76-bd36-4696-9f6b-4dbca123fa0e None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:34.688802 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe992a76-bd36-4696-9f6b-4dbca123fa0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:34.724381 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-fe992a76-bd36-4696-9f6b-4dbca123fa0e None None] MFA Rules not processed for user `c4aa1c394e8445adbb4bf668ce056a38`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:34.725578 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-fe992a76-bd36-4696-9f6b-4dbca123fa0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:34.867944 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1083/2160] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:34.884416 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1dd0ab-91d4-46a3-bc79-29b192cab68d service cinder] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:34.886065 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-8e1dd0ab-91d4-46a3-bc79-29b192cab68d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:34.999565 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1dd0ab-91d4-46a3-bc79-29b192cab68d service cinder] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:35.005886 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3967e8-13ab-44a8-9e0f-c9999ff1fd7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:35.006716 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3967e8-13ab-44a8-9e0f-c9999ff1fd7d service nova] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:35.007029 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3967e8-13ab-44a8-9e0f-c9999ff1fd7d service nova] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:35.007238 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3967e8-13ab-44a8-9e0f-c9999ff1fd7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:35.017290 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3967e8-13ab-44a8-9e0f-c9999ff1fd7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:35.019119 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3967e8-13ab-44a8-9e0f-c9999ff1fd7d service nova] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:35.035933 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1078/2161] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:34 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:35.226098 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe992a76-bd36-4696-9f6b-4dbca123fa0e None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:35.228100 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-fe992a76-bd36-4696-9f6b-4dbca123fa0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:35.349936 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe992a76-bd36-4696-9f6b-4dbca123fa0e None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:35.358767 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a9fee-db64-448f-9200-6527a0e4c502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:35.359983 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a9fee-db64-448f-9200-6527a0e4c502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:35.360470 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a9fee-db64-448f-9200-6527a0e4c502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:35.360976 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a9fee-db64-448f-9200-6527a0e4c502 admin admin] PATH_INFO: `/v3/users/d3713f3c1fcf4d7caa0c2b0bb6069742` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:35.369574 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a9fee-db64-448f-9200-6527a0e4c502 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3713f3c1fcf4d7caa0c2b0bb6069742)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:35.374885 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a9fee-db64-448f-9200-6527a0e4c502 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:35.443940 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-4c7a9fee-db64-448f-9200-6527a0e4c502 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3713f3c1fcf4d7caa0c2b0bb6069742'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:35.444662 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-4c7a9fee-db64-448f-9200-6527a0e4c502 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3713f3c1fcf4d7caa0c2b0bb6069742'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:35.454280 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-4c7a9fee-db64-448f-9200-6527a0e4c502 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3713f3c1fcf4d7caa0c2b0bb6069742'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:35.458736 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:35.470341 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-4c7a9fee-db64-448f-9200-6527a0e4c502 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3713f3c1fcf4d7caa0c2b0bb6069742'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:35.473637 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-4c7a9fee-db64-448f-9200-6527a0e4c502 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3713f3c1fcf4d7caa0c2b0bb6069742'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:35.503617 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1084/2162] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:29:35 2022] DELETE /identity/v3/users/d3713f3c1fcf4d7caa0c2b0bb6069742 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:29:35.504247 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1733c-26df-4bdb-93b3-30db90b3fe9c None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:35.505076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1733c-26df-4bdb-93b3-30db90b3fe9c None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:35.505076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1733c-26df-4bdb-93b3-30db90b3fe9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:35.534926 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-17e1733c-26df-4bdb-93b3-30db90b3fe9c None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:35.536979 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-17e1733c-26df-4bdb-93b3-30db90b3fe9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:35.608669 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:35.646736 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1079/2163] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:35.661033 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a9fee-db64-448f-9200-6527a0e4c502 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:35.662729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-4c7a9fee-db64-448f-9200-6527a0e4c502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:35.751726 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a9fee-db64-448f-9200-6527a0e4c502 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:35.756557 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e5e4b-0f37-4e69-9ef1-8470108e3025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:35.757189 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e5e4b-0f37-4e69-9ef1-8470108e3025 service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:35.757521 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e5e4b-0f37-4e69-9ef1-8470108e3025 service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:35.757839 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e5e4b-0f37-4e69-9ef1-8470108e3025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:35.774388 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e5e4b-0f37-4e69-9ef1-8470108e3025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:35.787026 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e5e4b-0f37-4e69-9ef1-8470108e3025 service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:35.796341 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1085/2164] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:36.484068 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1733c-26df-4bdb-93b3-30db90b3fe9c None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:36.490913 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-17e1733c-26df-4bdb-93b3-30db90b3fe9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:36.534153 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1733c-26df-4bdb-93b3-30db90b3fe9c None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:36.550278 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaed1fa-166d-4269-944e-d02b3002d59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:36.551616 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaed1fa-166d-4269-944e-d02b3002d59a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:36.552333 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaed1fa-166d-4269-944e-d02b3002d59a admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:36.553814 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaed1fa-166d-4269-944e-d02b3002d59a admin admin] PATH_INFO: `/v3/projects/f653d5964b0e47fb91c82e1fbf70060e` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:36.559720 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaed1fa-166d-4269-944e-d02b3002d59a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f653d5964b0e47fb91c82e1fbf70060e)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:36.570040 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaed1fa-166d-4269-944e-d02b3002d59a admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:36.698693 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-4aaed1fa-166d-4269-944e-d02b3002d59a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f653d5964b0e47fb91c82e1fbf70060e', 'request_id': 'req-4aaed1fa-166d-4269-944e-d02b3002d59a'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:36.712163 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-4aaed1fa-166d-4269-944e-d02b3002d59a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f653d5964b0e47fb91c82e1fbf70060e', 'request_id': 'req-4aaed1fa-166d-4269-944e-d02b3002d59a'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:36.736181 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-4aaed1fa-166d-4269-944e-d02b3002d59a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f653d5964b0e47fb91c82e1fbf70060e', 'request_id': 'req-4aaed1fa-166d-4269-944e-d02b3002d59a'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:36.765583 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-4aaed1fa-166d-4269-944e-d02b3002d59a admin admin] The token cache is being invalidate because project f653d5964b0e47fb91c82e1fbf70060e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:29:36.766096 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-4aaed1fa-166d-4269-944e-d02b3002d59a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:36.768008 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-4aaed1fa-166d-4269-944e-d02b3002d59a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:36.773457 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1080/2165] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:29:36 2022] DELETE /identity/v3/projects/f653d5964b0e47fb91c82e1fbf70060e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:36.775619 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e8de7-91ba-4bbc-b38d-68407f08c01a None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:36.776551 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e8de7-91ba-4bbc-b38d-68407f08c01a None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:36.777100 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e8de7-91ba-4bbc-b38d-68407f08c01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:36.836996 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-836e8de7-91ba-4bbc-b38d-68407f08c01a None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:36.837923 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-836e8de7-91ba-4bbc-b38d-68407f08c01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:36.994098 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1086/2166] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:36.997641 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e9173-c40c-4eb8-998b-b8c171d8871a None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:36.998258 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e9173-c40c-4eb8-998b-b8c171d8871a None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:36.998823 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e9173-c40c-4eb8-998b-b8c171d8871a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:37.066084 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-d94e9173-c40c-4eb8-998b-b8c171d8871a None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:37.067696 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-d94e9173-c40c-4eb8-998b-b8c171d8871a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:37.084771 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1081/2167] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:37.090674 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e8de7-91ba-4bbc-b38d-68407f08c01a None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:37.102732 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e8de7-91ba-4bbc-b38d-68407f08c01a None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:37.110674 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bfc9d-42d3-44e6-944f-074299b3fe84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:37.110841 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bfc9d-42d3-44e6-944f-074299b3fe84 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:37.111093 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bfc9d-42d3-44e6-944f-074299b3fe84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:37.111439 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bfc9d-42d3-44e6-944f-074299b3fe84 admin admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:37.112188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2bfc9d-42d3-44e6-944f-074299b3fe84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:29:37.112572 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2bfc9d-42d3-44e6-944f-074299b3fe84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:37.114358 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2bfc9d-42d3-44e6-944f-074299b3fe84 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:37.138275 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1087/2168] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:29:37.139626 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e9173-c40c-4eb8-998b-b8c171d8871a None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:37.150701 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e9173-c40c-4eb8-998b-b8c171d8871a None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:37.157083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c368194-b9fc-4979-b435-a31e232c5718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:37.158461 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c368194-b9fc-4979-b435-a31e232c5718 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:37.158461 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c368194-b9fc-4979-b435-a31e232c5718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:37.158461 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c368194-b9fc-4979-b435-a31e232c5718 admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:37.159375 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c368194-b9fc-4979-b435-a31e232c5718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:37.161642 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c368194-b9fc-4979-b435-a31e232c5718 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:37.209874 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1082/2169] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:29:37 2022] POST /identity/v3/projects => generated 375 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:29:37.214397 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bfc9d-42d3-44e6-944f-074299b3fe84 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:37.229328 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bfc9d-42d3-44e6-944f-074299b3fe84 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:37.338967 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae4875-9490-4e48-9f45-ef358f019bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:37.340829 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae4875-9490-4e48-9f45-ef358f019bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:37.341140 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae4875-9490-4e48-9f45-ef358f019bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:37.342325 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae4875-9490-4e48-9f45-ef358f019bc8 admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:37.343014 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae4875-9490-4e48-9f45-ef358f019bc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:37.345862 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae4875-9490-4e48-9f45-ef358f019bc8 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:37.377765 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:37.389154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1088/2170] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:29:37 2022] POST /identity/v3/users => generated 288 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:29:37.393639 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c368194-b9fc-4979-b435-a31e232c5718 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:37.409447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c368194-b9fc-4979-b435-a31e232c5718 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:37.417121 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f98b4-33b5-4229-9def-a3543e0235b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:37.418548 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f98b4-33b5-4229-9def-a3543e0235b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:37.418980 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f98b4-33b5-4229-9def-a3543e0235b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:37.419318 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f98b4-33b5-4229-9def-a3543e0235b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:37.420011 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f98b4-33b5-4229-9def-a3543e0235b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:37.422302 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f98b4-33b5-4229-9def-a3543e0235b7 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:37.438889 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1083/2171] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:29:37.440705 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae4875-9490-4e48-9f45-ef358f019bc8 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:37.468934 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae4875-9490-4e48-9f45-ef358f019bc8 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:37.490598 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f842704-7364-421d-a981-455f2fc08faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:37.494105 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f842704-7364-421d-a981-455f2fc08faf admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:37.494471 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f842704-7364-421d-a981-455f2fc08faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:37.494667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f842704-7364-421d-a981-455f2fc08faf admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:37.496758 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f842704-7364-421d-a981-455f2fc08faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:37.502489 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f842704-7364-421d-a981-455f2fc08faf admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:37.525491 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1089/2172] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:29:37.530255 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f98b4-33b5-4229-9def-a3543e0235b7 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:37.564871 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f98b4-33b5-4229-9def-a3543e0235b7 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:37.587799 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142076a6-58b8-4b34-9ff9-c6f2edf98216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:37.587799 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142076a6-58b8-4b34-9ff9-c6f2edf98216 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:37.588092 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142076a6-58b8-4b34-9ff9-c6f2edf98216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:37.588317 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142076a6-58b8-4b34-9ff9-c6f2edf98216 admin admin] PATH_INFO: `/v3/projects/707fb7d471434060987deab164a586a4/users/b700339020e84dd6b1e6c372bfff8ba1/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:37.613335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142076a6-58b8-4b34-9ff9-c6f2edf98216 admin admin] RBAC: Authorizing `identity:create_grant(project_id=707fb7d471434060987deab164a586a4, user_id=b700339020e84dd6b1e6c372bfff8ba1, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:37.616366 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142076a6-58b8-4b34-9ff9-c6f2edf98216 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:37.658730 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1084/2173] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:29:37 2022] PUT /identity/v3/projects/707fb7d471434060987deab164a586a4/users/b700339020e84dd6b1e6c372bfff8ba1/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:37.661832 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0075ee-4827-4015-85e0-9e86f2c98303 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:37.663032 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0075ee-4827-4015-85e0-9e86f2c98303 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:37.663419 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0075ee-4827-4015-85e0-9e86f2c98303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:37.699580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-eb0075ee-4827-4015-85e0-9e86f2c98303 None None] MFA Rules not processed for user `b700339020e84dd6b1e6c372bfff8ba1`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:37.701409 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-eb0075ee-4827-4015-85e0-9e86f2c98303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:37.819424 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afbf27-1084-4073-899b-6ace1d7fe3b2 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:37.821782 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afbf27-1084-4073-899b-6ace1d7fe3b2 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:37.822440 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afbf27-1084-4073-899b-6ace1d7fe3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:37.849914 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1090/2174] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:37.865670 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0075ee-4827-4015-85e0-9e86f2c98303 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:37.892990 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-f3afbf27-1084-4073-899b-6ace1d7fe3b2 None None] MFA Rules not processed for user `c4aa1c394e8445adbb4bf668ce056a38`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:37.892990 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-f3afbf27-1084-4073-899b-6ace1d7fe3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:37.979282 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0075ee-4827-4015-85e0-9e86f2c98303 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:37.985745 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a162d-3fee-40cf-9654-58fcd31c58c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:37.986625 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a162d-3fee-40cf-9654-58fcd31c58c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:37.986962 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a162d-3fee-40cf-9654-58fcd31c58c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:37.987304 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a162d-3fee-40cf-9654-58fcd31c58c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:37.988162 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a162d-3fee-40cf-9654-58fcd31c58c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:37.991069 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a162d-3fee-40cf-9654-58fcd31c58c4 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:38.038880 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1085/2175] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:38.077970 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1091/2176] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:29:37 2022] POST /identity/v3/projects => generated 375 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:29:38.082392 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afbf27-1084-4073-899b-6ace1d7fe3b2 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:38.139380 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afbf27-1084-4073-899b-6ace1d7fe3b2 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:38.174657 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:38.337725 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6dbe3-2913-45b6-b2b0-e1c3e28693af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:38.338581 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6dbe3-2913-45b6-b2b0-e1c3e28693af admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:38.338867 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6dbe3-2913-45b6-b2b0-e1c3e28693af admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:38.339146 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6dbe3-2913-45b6-b2b0-e1c3e28693af admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:38.340866 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6dbe3-2913-45b6-b2b0-e1c3e28693af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:38.343794 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6dbe3-2913-45b6-b2b0-e1c3e28693af admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:38.399661 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1086/2177] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:29:38 2022] POST /identity/v3/users => generated 294 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:29:38.404147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a162d-3fee-40cf-9654-58fcd31c58c4 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:38.438333 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a162d-3fee-40cf-9654-58fcd31c58c4 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:38.457475 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ff6e1-2987-4c3d-8338-54c1cab32487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:38.460824 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ff6e1-2987-4c3d-8338-54c1cab32487 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:38.461223 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ff6e1-2987-4c3d-8338-54c1cab32487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:38.461615 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ff6e1-2987-4c3d-8338-54c1cab32487 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:38.464166 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ff6e1-2987-4c3d-8338-54c1cab32487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:38.467525 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ff6e1-2987-4c3d-8338-54c1cab32487 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:38.507249 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1092/2178] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:29:38.511553 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6dbe3-2913-45b6-b2b0-e1c3e28693af admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:38.537535 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6dbe3-2913-45b6-b2b0-e1c3e28693af admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:38.571676 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fae771-ffcf-4e0e-8fa3-bacc3863b586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:38.572603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fae771-ffcf-4e0e-8fa3-bacc3863b586 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:38.573034 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fae771-ffcf-4e0e-8fa3-bacc3863b586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:38.573314 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fae771-ffcf-4e0e-8fa3-bacc3863b586 admin admin] PATH_INFO: `/v3/projects/5fa257fd46d44f3f86e79e270b2278df/users/0397cd4247544aee9f1f22c4eff95fe9/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:38.606423 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fae771-ffcf-4e0e-8fa3-bacc3863b586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fa257fd46d44f3f86e79e270b2278df, user_id=0397cd4247544aee9f1f22c4eff95fe9, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:38.613245 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fae771-ffcf-4e0e-8fa3-bacc3863b586 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:38.659365 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1087/2179] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:29:38 2022] PUT /identity/v3/projects/5fa257fd46d44f3f86e79e270b2278df/users/0397cd4247544aee9f1f22c4eff95fe9/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:38.660671 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ff6e1-2987-4c3d-8338-54c1cab32487 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:38.677940 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ff6e1-2987-4c3d-8338-54c1cab32487 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:38.794937 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:38.814240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b9fc3-5df0-4708-a1fa-9f2d5be7cd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:38.815497 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b9fc3-5df0-4708-a1fa-9f2d5be7cd5a admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:38.816009 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b9fc3-5df0-4708-a1fa-9f2d5be7cd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:38.816500 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b9fc3-5df0-4708-a1fa-9f2d5be7cd5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:38.817463 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b9fc3-5df0-4708-a1fa-9f2d5be7cd5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:38.819660 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b9fc3-5df0-4708-a1fa-9f2d5be7cd5a admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:38.839636 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1093/2180] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:29:38.841106 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fae771-ffcf-4e0e-8fa3-bacc3863b586 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:38.873087 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fae771-ffcf-4e0e-8fa3-bacc3863b586 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:38.882025 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7d319-235a-4e48-8a65-08a081420ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:38.882628 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7d319-235a-4e48-8a65-08a081420ea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:38.882902 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7d319-235a-4e48-8a65-08a081420ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:38.883172 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7d319-235a-4e48-8a65-08a081420ea3 admin admin] PATH_INFO: `/v3/projects/5fa257fd46d44f3f86e79e270b2278df/users/0397cd4247544aee9f1f22c4eff95fe9/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:38.887560 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7d319-235a-4e48-8a65-08a081420ea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fa257fd46d44f3f86e79e270b2278df, user_id=0397cd4247544aee9f1f22c4eff95fe9, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:38.891649 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7d319-235a-4e48-8a65-08a081420ea3 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:38.925858 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1088/2181] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:29:38 2022] PUT /identity/v3/projects/5fa257fd46d44f3f86e79e270b2278df/users/0397cd4247544aee9f1f22c4eff95fe9/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:38.936906 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c7f4e-c71d-49f0-86f5-dee9ab366e42 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:38.937566 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c7f4e-c71d-49f0-86f5-dee9ab366e42 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:38.937932 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c7f4e-c71d-49f0-86f5-dee9ab366e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:39.023577 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-3e1c7f4e-c71d-49f0-86f5-dee9ab366e42 None None] MFA Rules not processed for user `0397cd4247544aee9f1f22c4eff95fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:39.026153 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-3e1c7f4e-c71d-49f0-86f5-dee9ab366e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:39.305803 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1094/2182] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:39.412332 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7d319-235a-4e48-8a65-08a081420ea3 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:39.415732 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-85c7d319-235a-4e48-8a65-08a081420ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:39.634921 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7d319-235a-4e48-8a65-08a081420ea3 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:39.643009 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cdfc8e-feb4-4e69-9e94-72f3fd9c82b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:39.643996 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdfc8e-feb4-4e69-9e94-72f3fd9c82b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:39.644447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdfc8e-feb4-4e69-9e94-72f3fd9c82b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:39.644883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdfc8e-feb4-4e69-9e94-72f3fd9c82b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:39.782505 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cdfc8e-feb4-4e69-9e94-72f3fd9c82b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:39.783994 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cdfc8e-feb4-4e69-9e94-72f3fd9c82b8 service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:39.797630 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1089/2183] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:42.719423 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c7f4e-c71d-49f0-86f5-dee9ab366e42 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:42.842124 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c7f4e-c71d-49f0-86f5-dee9ab366e42 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:42.849311 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfca3c3-7fa7-4897-bea3-984541739656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:42.850144 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfca3c3-7fa7-4897-bea3-984541739656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:42.850267 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfca3c3-7fa7-4897-bea3-984541739656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:42.850712 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfca3c3-7fa7-4897-bea3-984541739656 admin admin] PATH_INFO: `/v3/users/b700339020e84dd6b1e6c372bfff8ba1` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:42.851895 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfca3c3-7fa7-4897-bea3-984541739656 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b700339020e84dd6b1e6c372bfff8ba1)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:42.853899 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfca3c3-7fa7-4897-bea3-984541739656 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:42.940566 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-7dfca3c3-7fa7-4897-bea3-984541739656 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b700339020e84dd6b1e6c372bfff8ba1'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:42.941692 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-7dfca3c3-7fa7-4897-bea3-984541739656 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b700339020e84dd6b1e6c372bfff8ba1'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:42.961457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-7dfca3c3-7fa7-4897-bea3-984541739656 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b700339020e84dd6b1e6c372bfff8ba1'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:42.975691 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-7dfca3c3-7fa7-4897-bea3-984541739656 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b700339020e84dd6b1e6c372bfff8ba1'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:42.976744 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-7dfca3c3-7fa7-4897-bea3-984541739656 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b700339020e84dd6b1e6c372bfff8ba1'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:42.991173 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:43.019254 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1095/2184] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:29:42 2022] DELETE /identity/v3/users/b700339020e84dd6b1e6c372bfff8ba1 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:29:43.026390 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7bf45-9504-47bb-bafe-de500dabe597 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:43.027620 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7bf45-9504-47bb-bafe-de500dabe597 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:43.028072 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7bf45-9504-47bb-bafe-de500dabe597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:43.063130 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-c7b7bf45-9504-47bb-bafe-de500dabe597 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:43.065441 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-c7b7bf45-9504-47bb-bafe-de500dabe597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:43.082111 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:43.182962 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1090/2185] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:43.200774 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfca3c3-7fa7-4897-bea3-984541739656 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:43.202482 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-7dfca3c3-7fa7-4897-bea3-984541739656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:43.305244 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfca3c3-7fa7-4897-bea3-984541739656 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:43.312988 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8436c6-3346-4a80-8e6e-85e869ab8ef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:43.314647 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8436c6-3346-4a80-8e6e-85e869ab8ef2 service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:43.315071 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8436c6-3346-4a80-8e6e-85e869ab8ef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:43.315477 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8436c6-3346-4a80-8e6e-85e869ab8ef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:43.333683 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8436c6-3346-4a80-8e6e-85e869ab8ef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:43.336720 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8436c6-3346-4a80-8e6e-85e869ab8ef2 service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:43.355746 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1096/2186] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:44.020567 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7bf45-9504-47bb-bafe-de500dabe597 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:44.022522 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-c7b7bf45-9504-47bb-bafe-de500dabe597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:44.050078 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7bf45-9504-47bb-bafe-de500dabe597 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:44.071513 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603be41-d12a-4903-947d-735f563c610d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:44.077402 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603be41-d12a-4903-947d-735f563c610d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:44.081975 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603be41-d12a-4903-947d-735f563c610d admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:44.082461 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603be41-d12a-4903-947d-735f563c610d admin admin] PATH_INFO: `/v3/projects/707fb7d471434060987deab164a586a4` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:44.084862 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603be41-d12a-4903-947d-735f563c610d admin admin] RBAC: Authorizing `identity:delete_project(project_id=707fb7d471434060987deab164a586a4)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:44.087864 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603be41-d12a-4903-947d-735f563c610d admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:44.103613 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8436c6-3346-4a80-8e6e-85e869ab8ef2 service neutron] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:44.105541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-1e8436c6-3346-4a80-8e6e-85e869ab8ef2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:44.185294 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2603be41-d12a-4903-947d-735f563c610d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '707fb7d471434060987deab164a586a4', 'request_id': 'req-2603be41-d12a-4903-947d-735f563c610d'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:44.205569 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2603be41-d12a-4903-947d-735f563c610d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '707fb7d471434060987deab164a586a4', 'request_id': 'req-2603be41-d12a-4903-947d-735f563c610d'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:44.205790 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8436c6-3346-4a80-8e6e-85e869ab8ef2 service neutron] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:44.216783 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2603be41-d12a-4903-947d-735f563c610d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '707fb7d471434060987deab164a586a4', 'request_id': 'req-2603be41-d12a-4903-947d-735f563c610d'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:44.232653 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2603be41-d12a-4903-947d-735f563c610d admin admin] The token cache is being invalidate because project 707fb7d471434060987deab164a586a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:29:44.232842 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2603be41-d12a-4903-947d-735f563c610d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:44.233662 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2603be41-d12a-4903-947d-735f563c610d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:44.235499 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1091/2187] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:29:44 2022] DELETE /identity/v3/projects/707fb7d471434060987deab164a586a4 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:44.241460 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603be41-d12a-4903-947d-735f563c610d admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:44.248530 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-2603be41-d12a-4903-947d-735f563c610d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:44.280397 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0807c6-8954-4898-b3fb-6b799e7b4e6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:44.281850 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0807c6-8954-4898-b3fb-6b799e7b4e6b service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:44.282318 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0807c6-8954-4898-b3fb-6b799e7b4e6b service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:44.282725 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0807c6-8954-4898-b3fb-6b799e7b4e6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:44.285786 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-5b0807c6-8954-4898-b3fb-6b799e7b4e6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:44.340867 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603be41-d12a-4903-947d-735f563c610d admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:44.347035 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246107b-e188-4ac6-8bce-18f580ca0059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:44.347724 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246107b-e188-4ac6-8bce-18f580ca0059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:44.348003 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246107b-e188-4ac6-8bce-18f580ca0059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:44.348276 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246107b-e188-4ac6-8bce-18f580ca0059 admin admin] PATH_INFO: `/v3/users/0397cd4247544aee9f1f22c4eff95fe9` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:44.350083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246107b-e188-4ac6-8bce-18f580ca0059 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0397cd4247544aee9f1f22c4eff95fe9)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:44.353926 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246107b-e188-4ac6-8bce-18f580ca0059 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:44.394047 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0807c6-8954-4898-b3fb-6b799e7b4e6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:44.396002 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0807c6-8954-4898-b3fb-6b799e7b4e6b service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:44.406448 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:44.414644 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1097/2188] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:29:44.431446 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:44.438245 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2246107b-e188-4ac6-8bce-18f580ca0059 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0397cd4247544aee9f1f22c4eff95fe9'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:44.441258 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2246107b-e188-4ac6-8bce-18f580ca0059 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0397cd4247544aee9f1f22c4eff95fe9'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:44.463668 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2246107b-e188-4ac6-8bce-18f580ca0059 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0397cd4247544aee9f1f22c4eff95fe9'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:44.490122 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2246107b-e188-4ac6-8bce-18f580ca0059 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0397cd4247544aee9f1f22c4eff95fe9'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:44.514028 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2246107b-e188-4ac6-8bce-18f580ca0059 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0397cd4247544aee9f1f22c4eff95fe9'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:44.528060 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1092/2189] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:29:44 2022] DELETE /identity/v3/users/0397cd4247544aee9f1f22c4eff95fe9 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:45.086750 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0807c6-8954-4898-b3fb-6b799e7b4e6b service cinder] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:45.103291 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0807c6-8954-4898-b3fb-6b799e7b4e6b service cinder] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:45.197607 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08073fe9-e0f8-43e0-9726-051f137074a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:45.198558 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08073fe9-e0f8-43e0-9726-051f137074a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:45.198811 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08073fe9-e0f8-43e0-9726-051f137074a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:45.199354 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08073fe9-e0f8-43e0-9726-051f137074a4 admin admin] PATH_INFO: `/v3/projects/5fa257fd46d44f3f86e79e270b2278df` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:45.200816 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08073fe9-e0f8-43e0-9726-051f137074a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fa257fd46d44f3f86e79e270b2278df)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:45.202960 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08073fe9-e0f8-43e0-9726-051f137074a4 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:45.234880 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246107b-e188-4ac6-8bce-18f580ca0059 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:45.236473 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-2246107b-e188-4ac6-8bce-18f580ca0059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:45.254233 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246107b-e188-4ac6-8bce-18f580ca0059 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:45.265143 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c11d98-037f-4ed6-b4f0-ecffe5fc4c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:45.265830 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c11d98-037f-4ed6-b4f0-ecffe5fc4c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:45.266116 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c11d98-037f-4ed6-b4f0-ecffe5fc4c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:45.266396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c11d98-037f-4ed6-b4f0-ecffe5fc4c03 admin admin] PATH_INFO: `/v3/users/605363978c934d6eabf304de7d13ea9d` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:45.271444 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c11d98-037f-4ed6-b4f0-ecffe5fc4c03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=605363978c934d6eabf304de7d13ea9d)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:45.273727 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c11d98-037f-4ed6-b4f0-ecffe5fc4c03 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:45.318601 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-08073fe9-e0f8-43e0-9726-051f137074a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fa257fd46d44f3f86e79e270b2278df', 'request_id': 'req-08073fe9-e0f8-43e0-9726-051f137074a4'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:45.327578 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-08073fe9-e0f8-43e0-9726-051f137074a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fa257fd46d44f3f86e79e270b2278df', 'request_id': 'req-08073fe9-e0f8-43e0-9726-051f137074a4'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:45.338267 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-08073fe9-e0f8-43e0-9726-051f137074a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fa257fd46d44f3f86e79e270b2278df', 'request_id': 'req-08073fe9-e0f8-43e0-9726-051f137074a4'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:45.355365 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-08073fe9-e0f8-43e0-9726-051f137074a4 admin admin] The token cache is being invalidate because project 5fa257fd46d44f3f86e79e270b2278df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:29:45.356588 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-08073fe9-e0f8-43e0-9726-051f137074a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:45.357592 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-08073fe9-e0f8-43e0-9726-051f137074a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:45.360826 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1098/2190] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:29:45 2022] DELETE /identity/v3/projects/5fa257fd46d44f3f86e79e270b2278df => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:45.362664 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-50c11d98-037f-4ed6-b4f0-ecffe5fc4c03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '605363978c934d6eabf304de7d13ea9d'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:45.363338 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-50c11d98-037f-4ed6-b4f0-ecffe5fc4c03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '605363978c934d6eabf304de7d13ea9d'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:45.365595 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb3633-8de7-4145-8f4f-5da45723500c None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:45.366142 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb3633-8de7-4145-8f4f-5da45723500c None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:45.366998 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb3633-8de7-4145-8f4f-5da45723500c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:45.378713 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-50c11d98-037f-4ed6-b4f0-ecffe5fc4c03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '605363978c934d6eabf304de7d13ea9d'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:45.388602 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-50c11d98-037f-4ed6-b4f0-ecffe5fc4c03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '605363978c934d6eabf304de7d13ea9d'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:45.395919 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-2dfb3633-8de7-4145-8f4f-5da45723500c None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:45.397659 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-2dfb3633-8de7-4145-8f4f-5da45723500c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:45.412550 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-50c11d98-037f-4ed6-b4f0-ecffe5fc4c03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '605363978c934d6eabf304de7d13ea9d'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:45.420933 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1093/2191] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:29:45 2022] DELETE /identity/v3/users/605363978c934d6eabf304de7d13ea9d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:29:45.425344 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf221b-7022-4884-b930-930ee4ee19fe None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:45.425663 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf221b-7022-4884-b930-930ee4ee19fe None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:45.428164 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf221b-7022-4884-b930-930ee4ee19fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:45.472947 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-76cf221b-7022-4884-b930-930ee4ee19fe None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:45.474264 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-76cf221b-7022-4884-b930-930ee4ee19fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:45.506587 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1099/2192] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:45.516390 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a14b88-188c-4dc9-b30f-7410d9575fae None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:45.519615 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a14b88-188c-4dc9-b30f-7410d9575fae None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:45.520337 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a14b88-188c-4dc9-b30f-7410d9575fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:45.554868 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-a1a14b88-188c-4dc9-b30f-7410d9575fae None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:45.556366 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-a1a14b88-188c-4dc9-b30f-7410d9575fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:45.596309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1094/2193] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:29:45.599136 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:45.614950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf221b-7022-4884-b930-930ee4ee19fe None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:45.616464 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-76cf221b-7022-4884-b930-930ee4ee19fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:45.647711 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1100/2194] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:45.651731 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a14b88-188c-4dc9-b30f-7410d9575fae None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:45.661425 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:45.663185 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a14b88-188c-4dc9-b30f-7410d9575fae None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:45.675168 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca8d16c-afdd-4317-a0a1-170f925f6bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:45.675816 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8d16c-afdd-4317-a0a1-170f925f6bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:45.676171 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8d16c-afdd-4317-a0a1-170f925f6bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:45.676531 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8d16c-afdd-4317-a0a1-170f925f6bf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:45.677199 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca8d16c-afdd-4317-a0a1-170f925f6bf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:29:45.677535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca8d16c-afdd-4317-a0a1-170f925f6bf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:45.679190 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca8d16c-afdd-4317-a0a1-170f925f6bf2 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:45.694199 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1101/2195] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:29:45.698259 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca8d16c-afdd-4317-a0a1-170f925f6bf2 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:45.702535 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf221b-7022-4884-b930-930ee4ee19fe None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:45.707950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2510fc-4131-4122-b4bd-48a366b97428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:45.708681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2510fc-4131-4122-b4bd-48a366b97428 service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:45.708955 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2510fc-4131-4122-b4bd-48a366b97428 service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:45.709231 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2510fc-4131-4122-b4bd-48a366b97428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:45.710562 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca8d16c-afdd-4317-a0a1-170f925f6bf2 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:45.719795 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2510fc-4131-4122-b4bd-48a366b97428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:45.721277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2510fc-4131-4122-b4bd-48a366b97428 service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:45.724636 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bb324-9410-4f84-8f15-a16e35fad802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:45.725269 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bb324-9410-4f84-8f15-a16e35fad802 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:45.725575 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bb324-9410-4f84-8f15-a16e35fad802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:45.725853 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bb324-9410-4f84-8f15-a16e35fad802 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:45.726489 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4bb324-9410-4f84-8f15-a16e35fad802 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:45.728401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4bb324-9410-4f84-8f15-a16e35fad802 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:45.738551 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1095/2196] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:45.760598 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1102/2197] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:29:45 2022] POST /identity/v3/projects => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:29:45.765034 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2510fc-4131-4122-b4bd-48a366b97428 service neutron] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:45.775818 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2510fc-4131-4122-b4bd-48a366b97428 service neutron] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:45.848076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d046e52-c2ea-4eb7-bc11-276be6794abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:45.848697 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d046e52-c2ea-4eb7-bc11-276be6794abf admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:45.848986 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d046e52-c2ea-4eb7-bc11-276be6794abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:45.849787 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d046e52-c2ea-4eb7-bc11-276be6794abf admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:45.850428 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d046e52-c2ea-4eb7-bc11-276be6794abf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:45.852744 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d046e52-c2ea-4eb7-bc11-276be6794abf admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:45.888569 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1096/2198] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:29:45 2022] POST /identity/v3/users => generated 291 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:29:45.892768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bb324-9410-4f84-8f15-a16e35fad802 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:45.904040 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bb324-9410-4f84-8f15-a16e35fad802 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:45.908882 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55adc1-88b8-4301-990b-45b9ceea8d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:45.909682 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55adc1-88b8-4301-990b-45b9ceea8d7b admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:45.910077 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55adc1-88b8-4301-990b-45b9ceea8d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:45.910611 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55adc1-88b8-4301-990b-45b9ceea8d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:45.911210 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55adc1-88b8-4301-990b-45b9ceea8d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:45.912811 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55adc1-88b8-4301-990b-45b9ceea8d7b admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:45.927038 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1103/2199] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:29:45.931383 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d046e52-c2ea-4eb7-bc11-276be6794abf admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:45.942485 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d046e52-c2ea-4eb7-bc11-276be6794abf admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:45.947329 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db569b5b-10c3-4c49-9283-535afd171e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:45.947954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db569b5b-10c3-4c49-9283-535afd171e87 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:45.948234 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db569b5b-10c3-4c49-9283-535afd171e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:45.948572 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db569b5b-10c3-4c49-9283-535afd171e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:45.949983 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db569b5b-10c3-4c49-9283-535afd171e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:45.951629 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db569b5b-10c3-4c49-9283-535afd171e87 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:45.962880 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1097/2200] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:29:45.967799 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55adc1-88b8-4301-990b-45b9ceea8d7b admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:45.980282 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55adc1-88b8-4301-990b-45b9ceea8d7b admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:45.993592 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb619a-7522-4a53-80c2-8bac84439c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:45.994284 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb619a-7522-4a53-80c2-8bac84439c88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:45.994567 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb619a-7522-4a53-80c2-8bac84439c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:45.994844 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb619a-7522-4a53-80c2-8bac84439c88 admin admin] PATH_INFO: `/v3/projects/5802e8090ef343b097d33c9f5285d8ca/users/37f301ea09fc418d85e1f57ef3baf5f3/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:46.014152 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb619a-7522-4a53-80c2-8bac84439c88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5802e8090ef343b097d33c9f5285d8ca, user_id=37f301ea09fc418d85e1f57ef3baf5f3, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:46.016796 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb619a-7522-4a53-80c2-8bac84439c88 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:46.032348 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1104/2201] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:29:45 2022] PUT /identity/v3/projects/5802e8090ef343b097d33c9f5285d8ca/users/37f301ea09fc418d85e1f57ef3baf5f3/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:46.043220 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3d04d-9543-4469-b1d6-690a0b410998 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:46.043601 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3d04d-9543-4469-b1d6-690a0b410998 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:46.043940 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3d04d-9543-4469-b1d6-690a0b410998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:46.078296 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-5ab3d04d-9543-4469-b1d6-690a0b410998 None None] MFA Rules not processed for user `37f301ea09fc418d85e1f57ef3baf5f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:46.079390 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-5ab3d04d-9543-4469-b1d6-690a0b410998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:46.211772 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1098/2202] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:46.218217 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb619a-7522-4a53-80c2-8bac84439c88 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:46.319047 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb619a-7522-4a53-80c2-8bac84439c88 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:46.324031 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892471d3-a887-4d2c-a6d5-74009c14cc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:46.324995 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892471d3-a887-4d2c-a6d5-74009c14cc3f admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:46.325264 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892471d3-a887-4d2c-a6d5-74009c14cc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:46.325578 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892471d3-a887-4d2c-a6d5-74009c14cc3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:46.326230 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892471d3-a887-4d2c-a6d5-74009c14cc3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:46.328401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892471d3-a887-4d2c-a6d5-74009c14cc3f admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:46.368756 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1105/2203] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:29:46 2022] POST /identity/v3/projects => generated 381 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:29:46.372907 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3d04d-9543-4469-b1d6-690a0b410998 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:46.392638 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3d04d-9543-4469-b1d6-690a0b410998 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:46.452749 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:46.479417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961faa92-08e6-4150-88f2-e6efecdcace7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:46.480829 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961faa92-08e6-4150-88f2-e6efecdcace7 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:46.481269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961faa92-08e6-4150-88f2-e6efecdcace7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:46.481608 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961faa92-08e6-4150-88f2-e6efecdcace7 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:46.482354 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961faa92-08e6-4150-88f2-e6efecdcace7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:46.484465 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961faa92-08e6-4150-88f2-e6efecdcace7 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:46.514554 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1099/2204] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:29:46 2022] POST /identity/v3/users => generated 291 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:29:46.518800 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892471d3-a887-4d2c-a6d5-74009c14cc3f admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:46.531787 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892471d3-a887-4d2c-a6d5-74009c14cc3f admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:46.538626 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f5108-8c3f-4857-9faa-ccd947244505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:46.538974 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f5108-8c3f-4857-9faa-ccd947244505 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:46.539388 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f5108-8c3f-4857-9faa-ccd947244505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:46.540394 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f5108-8c3f-4857-9faa-ccd947244505 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:46.540847 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f5108-8c3f-4857-9faa-ccd947244505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:46.542934 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f5108-8c3f-4857-9faa-ccd947244505 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:46.559866 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1106/2205] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:29:46.565097 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961faa92-08e6-4150-88f2-e6efecdcace7 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:46.593950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961faa92-08e6-4150-88f2-e6efecdcace7 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:46.610954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f68deb-610e-4960-889c-4548509ccc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:46.611887 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f68deb-610e-4960-889c-4548509ccc31 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:46.612315 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f68deb-610e-4960-889c-4548509ccc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:46.612751 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f68deb-610e-4960-889c-4548509ccc31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:46.613603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f68deb-610e-4960-889c-4548509ccc31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:46.615391 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f68deb-610e-4960-889c-4548509ccc31 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:46.626865 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1100/2206] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:29:46.630953 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f5108-8c3f-4857-9faa-ccd947244505 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:46.641792 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f5108-8c3f-4857-9faa-ccd947244505 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:46.651275 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d42f3-752a-4dff-b497-d948e49c690f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:46.653079 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d42f3-752a-4dff-b497-d948e49c690f admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:46.653622 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d42f3-752a-4dff-b497-d948e49c690f admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:46.654114 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d42f3-752a-4dff-b497-d948e49c690f admin admin] PATH_INFO: `/v3/projects/784745157f274cb5ae5654f9556bd7f3/users/028f58e1a57f4058986d7ee21b50cb3f/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:46.674700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d42f3-752a-4dff-b497-d948e49c690f admin admin] RBAC: Authorizing `identity:create_grant(project_id=784745157f274cb5ae5654f9556bd7f3, user_id=028f58e1a57f4058986d7ee21b50cb3f, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:46.678334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d42f3-752a-4dff-b497-d948e49c690f admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:46.686477 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f68deb-610e-4960-889c-4548509ccc31 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:46.688597 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-c3f68deb-610e-4960-889c-4548509ccc31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:46.704000 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1107/2207] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:29:46 2022] PUT /identity/v3/projects/784745157f274cb5ae5654f9556bd7f3/users/028f58e1a57f4058986d7ee21b50cb3f/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:29:46.721442 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f68deb-610e-4960-889c-4548509ccc31 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:46.727425 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809ee32-c186-4b98-81e5-5fd3fc0ac677 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:46.727425 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809ee32-c186-4b98-81e5-5fd3fc0ac677 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:46.727425 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809ee32-c186-4b98-81e5-5fd3fc0ac677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:46.760272 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:46.777407 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-0809ee32-c186-4b98-81e5-5fd3fc0ac677 None None] MFA Rules not processed for user `028f58e1a57f4058986d7ee21b50cb3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:46.779090 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-0809ee32-c186-4b98-81e5-5fd3fc0ac677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:46.827461 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6776d-de8f-4fde-bf8e-d040cb99ba86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:46.828027 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6776d-de8f-4fde-bf8e-d040cb99ba86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:46.828310 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6776d-de8f-4fde-bf8e-d040cb99ba86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:46.828587 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6776d-de8f-4fde-bf8e-d040cb99ba86 admin admin] PATH_INFO: `/v3/projects/fa1555bb331c43a291061b72cb58773d` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:46.829799 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6776d-de8f-4fde-bf8e-d040cb99ba86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa1555bb331c43a291061b72cb58773d)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:46.831880 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6776d-de8f-4fde-bf8e-d040cb99ba86 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:46.875162 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1108/2208] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:46.881209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809ee32-c186-4b98-81e5-5fd3fc0ac677 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:46.896055 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-bca6776d-de8f-4fde-bf8e-d040cb99ba86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa1555bb331c43a291061b72cb58773d', 'request_id': 'req-bca6776d-de8f-4fde-bf8e-d040cb99ba86'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:46.897887 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809ee32-c186-4b98-81e5-5fd3fc0ac677 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:46.903465 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-bca6776d-de8f-4fde-bf8e-d040cb99ba86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa1555bb331c43a291061b72cb58773d', 'request_id': 'req-bca6776d-de8f-4fde-bf8e-d040cb99ba86'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:46.914632 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-bca6776d-de8f-4fde-bf8e-d040cb99ba86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa1555bb331c43a291061b72cb58773d', 'request_id': 'req-bca6776d-de8f-4fde-bf8e-d040cb99ba86'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:46.932420 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-bca6776d-de8f-4fde-bf8e-d040cb99ba86 admin admin] The token cache is being invalidate because project fa1555bb331c43a291061b72cb58773d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:29:46.932685 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-bca6776d-de8f-4fde-bf8e-d040cb99ba86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:46.934029 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-bca6776d-de8f-4fde-bf8e-d040cb99ba86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:46.935936 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1101/2209] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:29:46 2022] DELETE /identity/v3/projects/fa1555bb331c43a291061b72cb58773d => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:46.941215 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a28ea7-2c14-4256-962d-7916d853dca4 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:46.941614 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a28ea7-2c14-4256-962d-7916d853dca4 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:46.941992 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a28ea7-2c14-4256-962d-7916d853dca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:46.975789 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-11a28ea7-2c14-4256-962d-7916d853dca4 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:46.978358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-11a28ea7-2c14-4256-962d-7916d853dca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:46.979528 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e68b0-eb34-487a-a687-633fa9c3503f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:46.980569 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e68b0-eb34-487a-a687-633fa9c3503f admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:46.980901 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e68b0-eb34-487a-a687-633fa9c3503f admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:46.981071 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e68b0-eb34-487a-a687-633fa9c3503f admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:46.981838 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e68b0-eb34-487a-a687-633fa9c3503f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:46.983681 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e68b0-eb34-487a-a687-633fa9c3503f admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:46.992868 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1102/2210] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:29:47.005456 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41d58a-a4e1-494d-9250-661c8a8c7553 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:47.005456 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41d58a-a4e1-494d-9250-661c8a8c7553 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:47.005456 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41d58a-a4e1-494d-9250-661c8a8c7553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:47.025081 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-8c41d58a-a4e1-494d-9250-661c8a8c7553 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:47.025878 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1109/2211] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:29:46 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:29:47.026771 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-8c41d58a-a4e1-494d-9250-661c8a8c7553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:47.031813 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e68b0-eb34-487a-a687-633fa9c3503f admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:47.033749 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-382e68b0-eb34-487a-a687-633fa9c3503f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:47.087206 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:47.116417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1103/2212] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:29:47.122300 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41d58a-a4e1-494d-9250-661c8a8c7553 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:47.133238 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41d58a-a4e1-494d-9250-661c8a8c7553 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:47.138773 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a011407-d278-4f81-8329-493849fcbf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:47.139451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a011407-d278-4f81-8329-493849fcbf77 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:47.139727 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a011407-d278-4f81-8329-493849fcbf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:47.139998 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a011407-d278-4f81-8329-493849fcbf77 admin admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:47.140660 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a011407-d278-4f81-8329-493849fcbf77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:29:47.140963 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a011407-d278-4f81-8329-493849fcbf77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:47.141567 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e68b0-eb34-487a-a687-633fa9c3503f admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:47.142836 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a011407-d278-4f81-8329-493849fcbf77 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:47.149103 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bf05b-0dc9-4aac-ac3d-58d106f11444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:47.150053 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bf05b-0dc9-4aac-ac3d-58d106f11444 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:47.150570 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bf05b-0dc9-4aac-ac3d-58d106f11444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:47.151003 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bf05b-0dc9-4aac-ac3d-58d106f11444 admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:47.152334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504bf05b-0dc9-4aac-ac3d-58d106f11444 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:47.155633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504bf05b-0dc9-4aac-ac3d-58d106f11444 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:47.166625 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1104/2213] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:29:47.174355 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a011407-d278-4f81-8329-493849fcbf77 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:47.193051 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1110/2214] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:29:47 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:29:47.197743 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a011407-d278-4f81-8329-493849fcbf77 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:47.199776 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bf05b-0dc9-4aac-ac3d-58d106f11444 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:47.206504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472d31d-1047-48c8-8508-cd2e039857f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:47.207455 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472d31d-1047-48c8-8508-cd2e039857f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:47.208119 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472d31d-1047-48c8-8508-cd2e039857f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:47.208314 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472d31d-1047-48c8-8508-cd2e039857f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:47.209485 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472d31d-1047-48c8-8508-cd2e039857f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:47.212611 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472d31d-1047-48c8-8508-cd2e039857f5 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:47.217142 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bf05b-0dc9-4aac-ac3d-58d106f11444 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:47.224317 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd09ca-2632-4caf-865b-8b4123d74fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:47.225306 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd09ca-2632-4caf-865b-8b4123d74fcf admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:47.225833 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd09ca-2632-4caf-865b-8b4123d74fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:47.226310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd09ca-2632-4caf-865b-8b4123d74fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:47.227419 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd09ca-2632-4caf-865b-8b4123d74fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:47.230487 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd09ca-2632-4caf-865b-8b4123d74fcf admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:47.254338 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1111/2215] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:29:47.259277 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd09ca-2632-4caf-865b-8b4123d74fcf admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:47.260664 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1105/2216] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:29:47 2022] POST /identity/v3/projects => generated 399 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:29:47.266168 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472d31d-1047-48c8-8508-cd2e039857f5 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:47.269134 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:47.274500 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd09ca-2632-4caf-865b-8b4123d74fcf admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:47.368471 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22cd08f-9d45-4431-a23d-061f032ae087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:47.370148 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22cd08f-9d45-4431-a23d-061f032ae087 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:47.371032 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22cd08f-9d45-4431-a23d-061f032ae087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:47.371707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22cd08f-9d45-4431-a23d-061f032ae087 admin admin] PATH_INFO: `/v3/projects/b13777b84e0443f6a30184fc845637d3/users/6a23dab4c1ee499f86dc392c25f2e08b/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:47.390170 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472d31d-1047-48c8-8508-cd2e039857f5 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:47.412993 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff0c91-4d9e-43a2-bd7e-29f8f5ca7d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:47.414030 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff0c91-4d9e-43a2-bd7e-29f8f5ca7d16 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:47.414508 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff0c91-4d9e-43a2-bd7e-29f8f5ca7d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:47.415209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22cd08f-9d45-4431-a23d-061f032ae087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b13777b84e0443f6a30184fc845637d3, user_id=6a23dab4c1ee499f86dc392c25f2e08b, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:47.416045 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff0c91-4d9e-43a2-bd7e-29f8f5ca7d16 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:47.418804 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff0c91-4d9e-43a2-bd7e-29f8f5ca7d16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:47.419330 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22cd08f-9d45-4431-a23d-061f032ae087 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:47.421185 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff0c91-4d9e-43a2-bd7e-29f8f5ca7d16 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:47.442385 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1112/2217] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:29:47 2022] PUT /identity/v3/projects/b13777b84e0443f6a30184fc845637d3/users/6a23dab4c1ee499f86dc392c25f2e08b/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:47.448672 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22cd08f-9d45-4431-a23d-061f032ae087 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:47.498420 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1106/2218] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:29:47 2022] POST /identity/v3/users => generated 300 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:29:47.503561 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff0c91-4d9e-43a2-bd7e-29f8f5ca7d16 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:47.531395 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff0c91-4d9e-43a2-bd7e-29f8f5ca7d16 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:47.567786 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22cd08f-9d45-4431-a23d-061f032ae087 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:47.573303 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7827d92-76d7-4f1d-8234-67642d9b747b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:47.574269 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7827d92-76d7-4f1d-8234-67642d9b747b admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:47.574754 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7827d92-76d7-4f1d-8234-67642d9b747b admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:47.575574 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7827d92-76d7-4f1d-8234-67642d9b747b admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:47.575941 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7827d92-76d7-4f1d-8234-67642d9b747b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:47.577723 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7827d92-76d7-4f1d-8234-67642d9b747b admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:47.590424 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1113/2219] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:29:47.595357 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7827d92-76d7-4f1d-8234-67642d9b747b admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:47.609906 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7827d92-76d7-4f1d-8234-67642d9b747b admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:47.615794 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22699ff4-468c-4e47-b331-634c329414c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:47.616749 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22699ff4-468c-4e47-b331-634c329414c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:47.617062 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22699ff4-468c-4e47-b331-634c329414c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:47.617351 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22699ff4-468c-4e47-b331-634c329414c4 admin admin] PATH_INFO: `/v3/projects/b13777b84e0443f6a30184fc845637d3/users/6a23dab4c1ee499f86dc392c25f2e08b/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:47.623145 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22699ff4-468c-4e47-b331-634c329414c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b13777b84e0443f6a30184fc845637d3, user_id=6a23dab4c1ee499f86dc392c25f2e08b, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:47.626885 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22699ff4-468c-4e47-b331-634c329414c4 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:47.681749 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1114/2220] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:29:47 2022] PUT /identity/v3/projects/b13777b84e0443f6a30184fc845637d3/users/6a23dab4c1ee499f86dc392c25f2e08b/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:29:47.681749 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8da36-9c76-4ae6-b523-88fba73a737c None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:47.681749 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8da36-9c76-4ae6-b523-88fba73a737c None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:47.681749 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8da36-9c76-4ae6-b523-88fba73a737c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:47.683915 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f3e48-0382-4e97-adb9-96a7a7fca1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:47.684705 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f3e48-0382-4e97-adb9-96a7a7fca1ef admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:47.685071 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f3e48-0382-4e97-adb9-96a7a7fca1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:47.686101 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f3e48-0382-4e97-adb9-96a7a7fca1ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:47.687746 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f3e48-0382-4e97-adb9-96a7a7fca1ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:47.699344 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f3e48-0382-4e97-adb9-96a7a7fca1ef admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:47.709093 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1107/2221] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:29:47.710842 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f3e48-0382-4e97-adb9-96a7a7fca1ef admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:47.724942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f3e48-0382-4e97-adb9-96a7a7fca1ef admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:47.764766 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-2fc8da36-9c76-4ae6-b523-88fba73a737c None None] MFA Rules not processed for user `6a23dab4c1ee499f86dc392c25f2e08b`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:47.767450 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-2fc8da36-9c76-4ae6-b523-88fba73a737c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:47.793837 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:47.869871 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16cc6c-fe1e-404c-842b-959112502392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:47.871191 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16cc6c-fe1e-404c-842b-959112502392 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:47.871565 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16cc6c-fe1e-404c-842b-959112502392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:47.871984 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16cc6c-fe1e-404c-842b-959112502392 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:47.872734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16cc6c-fe1e-404c-842b-959112502392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:47.875122 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16cc6c-fe1e-404c-842b-959112502392 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:47.888468 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1108/2222] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:29:47.893130 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16cc6c-fe1e-404c-842b-959112502392 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:47.905607 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16cc6c-fe1e-404c-842b-959112502392 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:47.910741 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:47.911073 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701276e0-621f-40d6-837b-823c7c1d29ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:47.911957 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701276e0-621f-40d6-837b-823c7c1d29ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:47.912111 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701276e0-621f-40d6-837b-823c7c1d29ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:47.912326 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701276e0-621f-40d6-837b-823c7c1d29ca admin admin] PATH_INFO: `/v3/projects/933f648b01c9445fa7c67aba888a2172/users/fcfcbaae7ce24860ac0b3366cbccd7ed/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:47.931911 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701276e0-621f-40d6-837b-823c7c1d29ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=933f648b01c9445fa7c67aba888a2172, user_id=fcfcbaae7ce24860ac0b3366cbccd7ed, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:47.934577 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1115/2223] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:47 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:47.936184 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701276e0-621f-40d6-837b-823c7c1d29ca admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:47.947875 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8da36-9c76-4ae6-b523-88fba73a737c None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:47.950003 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-2fc8da36-9c76-4ae6-b523-88fba73a737c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:47.953877 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1109/2224] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:29:47 2022] PUT /identity/v3/projects/933f648b01c9445fa7c67aba888a2172/users/fcfcbaae7ce24860ac0b3366cbccd7ed/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:29:47.965816 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f70d0-3b88-4c52-bb9c-9c5a224c1a50 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:47.966089 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f70d0-3b88-4c52-bb9c-9c5a224c1a50 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:47.966342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f70d0-3b88-4c52-bb9c-9c5a224c1a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:48.005944 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-ce8f70d0-3b88-4c52-bb9c-9c5a224c1a50 None None] MFA Rules not processed for user `fcfcbaae7ce24860ac0b3366cbccd7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:48.007503 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-ce8f70d0-3b88-4c52-bb9c-9c5a224c1a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:48.053396 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8da36-9c76-4ae6-b523-88fba73a737c None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:48.144465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77613dd0-8c3c-4280-ba83-4b7b6cc60d21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:48.145813 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77613dd0-8c3c-4280-ba83-4b7b6cc60d21 service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:48.146094 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77613dd0-8c3c-4280-ba83-4b7b6cc60d21 service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:48.146370 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77613dd0-8c3c-4280-ba83-4b7b6cc60d21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:48.148680 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-77613dd0-8c3c-4280-ba83-4b7b6cc60d21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:48.148838 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1110/2225] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:47 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:48.172958 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f70d0-3b88-4c52-bb9c-9c5a224c1a50 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:48.175111 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-ce8f70d0-3b88-4c52-bb9c-9c5a224c1a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:48.193115 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f70d0-3b88-4c52-bb9c-9c5a224c1a50 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:48.199215 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1d16a-abdf-4041-ace1-dfaa880e8216 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:48.199984 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1d16a-abdf-4041-ace1-dfaa880e8216 service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:48.200144 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1d16a-abdf-4041-ace1-dfaa880e8216 service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:48.200416 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1d16a-abdf-4041-ace1-dfaa880e8216 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:48.213699 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1d16a-abdf-4041-ace1-dfaa880e8216 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:48.216544 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1d16a-abdf-4041-ace1-dfaa880e8216 service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:48.240005 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1111/2226] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:48 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:29:48.248284 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77613dd0-8c3c-4280-ba83-4b7b6cc60d21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:48.250288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77613dd0-8c3c-4280-ba83-4b7b6cc60d21 service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:48.275337 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1116/2227] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:29:49.937659 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1d16a-abdf-4041-ace1-dfaa880e8216 service cinder] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:49.948127 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1d16a-abdf-4041-ace1-dfaa880e8216 service cinder] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:49.952128 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95309d2d-d761-4c7d-93c1-3a9c1298cae7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:49.952746 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95309d2d-d761-4c7d-93c1-3a9c1298cae7 service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:49.953032 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95309d2d-d761-4c7d-93c1-3a9c1298cae7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:49.953309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95309d2d-d761-4c7d-93c1-3a9c1298cae7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:49.955227 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-95309d2d-d761-4c7d-93c1-3a9c1298cae7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:50.040814 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95309d2d-d761-4c7d-93c1-3a9c1298cae7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:50.043119 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95309d2d-d761-4c7d-93c1-3a9c1298cae7 service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:50.055225 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1112/2228] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:50.901096 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77613dd0-8c3c-4280-ba83-4b7b6cc60d21 service cinder] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:50.914307 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77613dd0-8c3c-4280-ba83-4b7b6cc60d21 service cinder] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:50.919626 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac2286-86b9-4be6-8420-70fa4223f19c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:50.920531 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac2286-86b9-4be6-8420-70fa4223f19c service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:50.921168 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac2286-86b9-4be6-8420-70fa4223f19c service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:50.921485 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac2286-86b9-4be6-8420-70fa4223f19c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:51.001036 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac2286-86b9-4be6-8420-70fa4223f19c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:51.002448 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac2286-86b9-4be6-8420-70fa4223f19c service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:51.008619 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:51.021269 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1117/2229] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:50 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:53.787514 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95309d2d-d761-4c7d-93c1-3a9c1298cae7 service cinder] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:53.848235 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:53.968611 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95309d2d-d761-4c7d-93c1-3a9c1298cae7 service cinder] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:53.999293 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21774bfd-29c5-4640-a508-a6ddb33d9979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:54.000716 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21774bfd-29c5-4640-a508-a6ddb33d9979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:54.001221 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21774bfd-29c5-4640-a508-a6ddb33d9979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:54.001437 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21774bfd-29c5-4640-a508-a6ddb33d9979 admin admin] PATH_INFO: `/v3/users/fcfcbaae7ce24860ac0b3366cbccd7ed` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:54.004222 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21774bfd-29c5-4640-a508-a6ddb33d9979 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcfcbaae7ce24860ac0b3366cbccd7ed)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:54.009008 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21774bfd-29c5-4640-a508-a6ddb33d9979 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:54.139754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-21774bfd-29c5-4640-a508-a6ddb33d9979 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcfcbaae7ce24860ac0b3366cbccd7ed'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:54.140932 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-21774bfd-29c5-4640-a508-a6ddb33d9979 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcfcbaae7ce24860ac0b3366cbccd7ed'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:54.164102 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-21774bfd-29c5-4640-a508-a6ddb33d9979 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcfcbaae7ce24860ac0b3366cbccd7ed'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:54.200114 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-21774bfd-29c5-4640-a508-a6ddb33d9979 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcfcbaae7ce24860ac0b3366cbccd7ed'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:54.275737 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-21774bfd-29c5-4640-a508-a6ddb33d9979 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcfcbaae7ce24860ac0b3366cbccd7ed'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:54.298859 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1113/2230] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:29:53 2022] DELETE /identity/v3/users/fcfcbaae7ce24860ac0b3366cbccd7ed => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:54.305346 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bcca6-f09e-4ef1-a108-81b6e02e00cd None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:54.305946 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bcca6-f09e-4ef1-a108-81b6e02e00cd None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:54.306066 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bcca6-f09e-4ef1-a108-81b6e02e00cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:54.336009 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-9d4bcca6-f09e-4ef1-a108-81b6e02e00cd None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:54.337892 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-9d4bcca6-f09e-4ef1-a108-81b6e02e00cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:54.474806 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1118/2231] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:54.489731 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21774bfd-29c5-4640-a508-a6ddb33d9979 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:54.497707 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-21774bfd-29c5-4640-a508-a6ddb33d9979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:54.718708 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21774bfd-29c5-4640-a508-a6ddb33d9979 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:54.725429 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0adeec9-8a5b-4ab5-a91f-a4397250a1aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:54.726405 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adeec9-8a5b-4ab5-a91f-a4397250a1aa service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:54.726690 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adeec9-8a5b-4ab5-a91f-a4397250a1aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:54.726969 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adeec9-8a5b-4ab5-a91f-a4397250a1aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:54.747408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0adeec9-8a5b-4ab5-a91f-a4397250a1aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:54.750191 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0adeec9-8a5b-4ab5-a91f-a4397250a1aa service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:54.768543 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1114/2232] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:55.130147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4bcca6-f09e-4ef1-a108-81b6e02e00cd None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:55.131628 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-9d4bcca6-f09e-4ef1-a108-81b6e02e00cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:55.150351 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4bcca6-f09e-4ef1-a108-81b6e02e00cd None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:55.156200 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895cae3b-3885-4ae1-89fa-61eae8688929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:55.156865 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cae3b-3885-4ae1-89fa-61eae8688929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:55.157146 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cae3b-3885-4ae1-89fa-61eae8688929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:55.157497 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cae3b-3885-4ae1-89fa-61eae8688929 admin admin] PATH_INFO: `/v3/projects/933f648b01c9445fa7c67aba888a2172` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:55.158673 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895cae3b-3885-4ae1-89fa-61eae8688929 admin admin] RBAC: Authorizing `identity:delete_project(project_id=933f648b01c9445fa7c67aba888a2172)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:55.160766 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895cae3b-3885-4ae1-89fa-61eae8688929 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:55.217476 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-895cae3b-3885-4ae1-89fa-61eae8688929 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '933f648b01c9445fa7c67aba888a2172', 'request_id': 'req-895cae3b-3885-4ae1-89fa-61eae8688929'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:55.223867 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-895cae3b-3885-4ae1-89fa-61eae8688929 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '933f648b01c9445fa7c67aba888a2172', 'request_id': 'req-895cae3b-3885-4ae1-89fa-61eae8688929'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:55.233834 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-895cae3b-3885-4ae1-89fa-61eae8688929 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '933f648b01c9445fa7c67aba888a2172', 'request_id': 'req-895cae3b-3885-4ae1-89fa-61eae8688929'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:55.245090 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-895cae3b-3885-4ae1-89fa-61eae8688929 admin admin] The token cache is being invalidate because project 933f648b01c9445fa7c67aba888a2172 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:29:55.245499 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-895cae3b-3885-4ae1-89fa-61eae8688929 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:55.246190 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-895cae3b-3885-4ae1-89fa-61eae8688929 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:55.247717 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1119/2233] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:29:55 2022] DELETE /identity/v3/projects/933f648b01c9445fa7c67aba888a2172 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:55.382004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0adeec9-8a5b-4ab5-a91f-a4397250a1aa service neutron] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:55.384368 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-d0adeec9-8a5b-4ab5-a91f-a4397250a1aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:55.400738 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0adeec9-8a5b-4ab5-a91f-a4397250a1aa service neutron] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:55.463647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:55.483040 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b59416-2fdc-4870-80ac-f8961e31e2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:55.483699 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b59416-2fdc-4870-80ac-f8961e31e2a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:55.483979 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b59416-2fdc-4870-80ac-f8961e31e2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:55.484252 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b59416-2fdc-4870-80ac-f8961e31e2a6 admin admin] PATH_INFO: `/v3/users/37f301ea09fc418d85e1f57ef3baf5f3` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:55.485422 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b59416-2fdc-4870-80ac-f8961e31e2a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37f301ea09fc418d85e1f57ef3baf5f3)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:55.487366 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b59416-2fdc-4870-80ac-f8961e31e2a6 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:55.549520 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-f9b59416-2fdc-4870-80ac-f8961e31e2a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37f301ea09fc418d85e1f57ef3baf5f3'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:55.550232 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-f9b59416-2fdc-4870-80ac-f8961e31e2a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37f301ea09fc418d85e1f57ef3baf5f3'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:55.560332 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-f9b59416-2fdc-4870-80ac-f8961e31e2a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37f301ea09fc418d85e1f57ef3baf5f3'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:55.569800 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-f9b59416-2fdc-4870-80ac-f8961e31e2a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37f301ea09fc418d85e1f57ef3baf5f3'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:55.584995 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-f9b59416-2fdc-4870-80ac-f8961e31e2a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37f301ea09fc418d85e1f57ef3baf5f3'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:55.592829 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1115/2234] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:29:55 2022] DELETE /identity/v3/users/37f301ea09fc418d85e1f57ef3baf5f3 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:55.597589 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a5ca4-0a12-43a1-8ce7-13880413a5b8 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:55.598105 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a5ca4-0a12-43a1-8ce7-13880413a5b8 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:55.598224 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a5ca4-0a12-43a1-8ce7-13880413a5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:55.618795 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-c92a5ca4-0a12-43a1-8ce7-13880413a5b8 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:55.619555 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-c92a5ca4-0a12-43a1-8ce7-13880413a5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:55.682462 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1120/2235] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:55.693118 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b59416-2fdc-4870-80ac-f8961e31e2a6 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:55.694691 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-f9b59416-2fdc-4870-80ac-f8961e31e2a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:55.777862 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b59416-2fdc-4870-80ac-f8961e31e2a6 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:55.784854 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c3685-c50d-4d9f-943a-96052d43c5dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:55.786175 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c3685-c50d-4d9f-943a-96052d43c5dc service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:55.786175 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c3685-c50d-4d9f-943a-96052d43c5dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:55.786175 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c3685-c50d-4d9f-943a-96052d43c5dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:55.801252 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c3685-c50d-4d9f-943a-96052d43c5dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:55.802847 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c3685-c50d-4d9f-943a-96052d43c5dc service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:55.819107 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1116/2236] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:56.230689 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a5ca4-0a12-43a1-8ce7-13880413a5b8 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:56.232272 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-c92a5ca4-0a12-43a1-8ce7-13880413a5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:56.250676 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a5ca4-0a12-43a1-8ce7-13880413a5b8 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:56.270887 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b0950-3aab-45f9-b92d-c810e5e7e613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:56.272318 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b0950-3aab-45f9-b92d-c810e5e7e613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:56.273893 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b0950-3aab-45f9-b92d-c810e5e7e613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:56.274427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b0950-3aab-45f9-b92d-c810e5e7e613 admin admin] PATH_INFO: `/v3/projects/5802e8090ef343b097d33c9f5285d8ca` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:56.277470 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b0950-3aab-45f9-b92d-c810e5e7e613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5802e8090ef343b097d33c9f5285d8ca)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:56.281412 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b0950-3aab-45f9-b92d-c810e5e7e613 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:56.331133 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:56.380284 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-b54b0950-3aab-45f9-b92d-c810e5e7e613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5802e8090ef343b097d33c9f5285d8ca', 'request_id': 'req-b54b0950-3aab-45f9-b92d-c810e5e7e613'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:56.389734 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-b54b0950-3aab-45f9-b92d-c810e5e7e613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5802e8090ef343b097d33c9f5285d8ca', 'request_id': 'req-b54b0950-3aab-45f9-b92d-c810e5e7e613'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:56.414277 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-b54b0950-3aab-45f9-b92d-c810e5e7e613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5802e8090ef343b097d33c9f5285d8ca', 'request_id': 'req-b54b0950-3aab-45f9-b92d-c810e5e7e613'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:56.429993 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-b54b0950-3aab-45f9-b92d-c810e5e7e613 admin admin] The token cache is being invalidate because project 5802e8090ef343b097d33c9f5285d8ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:29:56.430390 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-b54b0950-3aab-45f9-b92d-c810e5e7e613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:56.430975 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-b54b0950-3aab-45f9-b92d-c810e5e7e613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:56.433096 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1121/2237] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:29:56 2022] DELETE /identity/v3/projects/5802e8090ef343b097d33c9f5285d8ca => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:56.438570 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c3685-c50d-4d9f-943a-96052d43c5dc service neutron] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:56.452318 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c3685-c50d-4d9f-943a-96052d43c5dc service neutron] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:56.521989 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bebab4-7fc5-4494-9184-c9555fa04ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:56.522608 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bebab4-7fc5-4494-9184-c9555fa04ee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:56.522978 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bebab4-7fc5-4494-9184-c9555fa04ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:56.523253 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bebab4-7fc5-4494-9184-c9555fa04ee5 admin admin] PATH_INFO: `/v3/users/028f58e1a57f4058986d7ee21b50cb3f` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:56.524702 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bebab4-7fc5-4494-9184-c9555fa04ee5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=028f58e1a57f4058986d7ee21b50cb3f)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:56.527023 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bebab4-7fc5-4494-9184-c9555fa04ee5 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:56.540680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:56.590217 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-53bebab4-7fc5-4494-9184-c9555fa04ee5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '028f58e1a57f4058986d7ee21b50cb3f'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:56.591108 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-53bebab4-7fc5-4494-9184-c9555fa04ee5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '028f58e1a57f4058986d7ee21b50cb3f'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:56.603167 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-53bebab4-7fc5-4494-9184-c9555fa04ee5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '028f58e1a57f4058986d7ee21b50cb3f'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:56.612761 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-53bebab4-7fc5-4494-9184-c9555fa04ee5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '028f58e1a57f4058986d7ee21b50cb3f'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:56.626610 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-53bebab4-7fc5-4494-9184-c9555fa04ee5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '028f58e1a57f4058986d7ee21b50cb3f'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:56.634059 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1117/2238] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:29:56 2022] DELETE /identity/v3/users/028f58e1a57f4058986d7ee21b50cb3f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:57.102303 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b0950-3aab-45f9-b92d-c810e5e7e613 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:57.107280 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-b54b0950-3aab-45f9-b92d-c810e5e7e613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:57.142511 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b0950-3aab-45f9-b92d-c810e5e7e613 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:57.233800 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac1acf-a92c-44dd-a86c-e3062939e664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:57.234444 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac1acf-a92c-44dd-a86c-e3062939e664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:57.234869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac1acf-a92c-44dd-a86c-e3062939e664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:57.235143 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac1acf-a92c-44dd-a86c-e3062939e664 admin admin] PATH_INFO: `/v3/projects/784745157f274cb5ae5654f9556bd7f3` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:57.236499 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac1acf-a92c-44dd-a86c-e3062939e664 admin admin] RBAC: Authorizing `identity:delete_project(project_id=784745157f274cb5ae5654f9556bd7f3)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:57.238463 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac1acf-a92c-44dd-a86c-e3062939e664 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:57.295344 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-93ac1acf-a92c-44dd-a86c-e3062939e664 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '784745157f274cb5ae5654f9556bd7f3', 'request_id': 'req-93ac1acf-a92c-44dd-a86c-e3062939e664'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:57.302192 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-93ac1acf-a92c-44dd-a86c-e3062939e664 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '784745157f274cb5ae5654f9556bd7f3', 'request_id': 'req-93ac1acf-a92c-44dd-a86c-e3062939e664'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:57.312009 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-93ac1acf-a92c-44dd-a86c-e3062939e664 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '784745157f274cb5ae5654f9556bd7f3', 'request_id': 'req-93ac1acf-a92c-44dd-a86c-e3062939e664'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:57.326564 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-93ac1acf-a92c-44dd-a86c-e3062939e664 admin admin] The token cache is being invalidate because project 784745157f274cb5ae5654f9556bd7f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:29:57.327001 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-93ac1acf-a92c-44dd-a86c-e3062939e664 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:57.327672 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-93ac1acf-a92c-44dd-a86c-e3062939e664 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:57.329184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1122/2239] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:29:57 2022] DELETE /identity/v3/projects/784745157f274cb5ae5654f9556bd7f3 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:57.337213 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bebab4-7fc5-4494-9184-c9555fa04ee5 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:57.339471 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-53bebab4-7fc5-4494-9184-c9555fa04ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:57.357098 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bebab4-7fc5-4494-9184-c9555fa04ee5 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:57.466483 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6350b3-829a-4871-9df7-8691bc8264bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:57.467235 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6350b3-829a-4871-9df7-8691bc8264bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:57.467542 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6350b3-829a-4871-9df7-8691bc8264bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:57.467887 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6350b3-829a-4871-9df7-8691bc8264bf admin admin] PATH_INFO: `/v3/users/6a23dab4c1ee499f86dc392c25f2e08b` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:57.469334 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6350b3-829a-4871-9df7-8691bc8264bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a23dab4c1ee499f86dc392c25f2e08b)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:57.471749 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6350b3-829a-4871-9df7-8691bc8264bf admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:57.554749 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-cd6350b3-829a-4871-9df7-8691bc8264bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a23dab4c1ee499f86dc392c25f2e08b'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:57.555673 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-cd6350b3-829a-4871-9df7-8691bc8264bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a23dab4c1ee499f86dc392c25f2e08b'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:57.569601 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-cd6350b3-829a-4871-9df7-8691bc8264bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a23dab4c1ee499f86dc392c25f2e08b'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:57.581762 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-cd6350b3-829a-4871-9df7-8691bc8264bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a23dab4c1ee499f86dc392c25f2e08b'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:57.600882 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-cd6350b3-829a-4871-9df7-8691bc8264bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a23dab4c1ee499f86dc392c25f2e08b'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:57.612018 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1118/2240] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:29:57 2022] DELETE /identity/v3/users/6a23dab4c1ee499f86dc392c25f2e08b => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:58.234600 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac1acf-a92c-44dd-a86c-e3062939e664 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:58.237804 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-93ac1acf-a92c-44dd-a86c-e3062939e664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:58.268685 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac1acf-a92c-44dd-a86c-e3062939e664 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:58.367282 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:58.447470 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e2e72-0b61-418e-8f0c-8137e07a608a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:58.450692 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e2e72-0b61-418e-8f0c-8137e07a608a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:58.453835 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e2e72-0b61-418e-8f0c-8137e07a608a admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:58.455971 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e2e72-0b61-418e-8f0c-8137e07a608a admin admin] PATH_INFO: `/v3/projects/b13777b84e0443f6a30184fc845637d3` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:58.462624 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e2e72-0b61-418e-8f0c-8137e07a608a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b13777b84e0443f6a30184fc845637d3)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:58.470256 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e2e72-0b61-418e-8f0c-8137e07a608a admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:58.570275 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-253e2e72-0b61-418e-8f0c-8137e07a608a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b13777b84e0443f6a30184fc845637d3', 'request_id': 'req-253e2e72-0b61-418e-8f0c-8137e07a608a'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:58.607305 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-253e2e72-0b61-418e-8f0c-8137e07a608a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b13777b84e0443f6a30184fc845637d3', 'request_id': 'req-253e2e72-0b61-418e-8f0c-8137e07a608a'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:58.631402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-253e2e72-0b61-418e-8f0c-8137e07a608a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b13777b84e0443f6a30184fc845637d3', 'request_id': 'req-253e2e72-0b61-418e-8f0c-8137e07a608a'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:58.644651 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-253e2e72-0b61-418e-8f0c-8137e07a608a admin admin] The token cache is being invalidate because project b13777b84e0443f6a30184fc845637d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:29:58.645014 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-253e2e72-0b61-418e-8f0c-8137e07a608a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:58.645711 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-253e2e72-0b61-418e-8f0c-8137e07a608a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:58.647665 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1123/2241] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:29:58 2022] DELETE /identity/v3/projects/b13777b84e0443f6a30184fc845637d3 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:30:02.688824 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6350b3-829a-4871-9df7-8691bc8264bf admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:02.690968 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-cd6350b3-829a-4871-9df7-8691bc8264bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:02.713639 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6350b3-829a-4871-9df7-8691bc8264bf admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:02.719497 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:02.818757 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa03de5-5ab1-4125-9b4d-7b7783d2d343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:02.820027 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa03de5-5ab1-4125-9b4d-7b7783d2d343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:02.820540 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa03de5-5ab1-4125-9b4d-7b7783d2d343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:02.821241 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa03de5-5ab1-4125-9b4d-7b7783d2d343 admin admin] PATH_INFO: `/v3/users/759b06113b7247db8e3a1fe9ded23172` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:02.825114 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa03de5-5ab1-4125-9b4d-7b7783d2d343 admin admin] RBAC: Authorizing `identity:delete_user(user_id=759b06113b7247db8e3a1fe9ded23172)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:02.827154 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa03de5-5ab1-4125-9b4d-7b7783d2d343 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:02.901141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-3fa03de5-5ab1-4125-9b4d-7b7783d2d343 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '759b06113b7247db8e3a1fe9ded23172'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:02.902195 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-3fa03de5-5ab1-4125-9b4d-7b7783d2d343 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '759b06113b7247db8e3a1fe9ded23172'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:02.917654 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-3fa03de5-5ab1-4125-9b4d-7b7783d2d343 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '759b06113b7247db8e3a1fe9ded23172'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:02.928285 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-3fa03de5-5ab1-4125-9b4d-7b7783d2d343 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '759b06113b7247db8e3a1fe9ded23172'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:02.947175 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-3fa03de5-5ab1-4125-9b4d-7b7783d2d343 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '759b06113b7247db8e3a1fe9ded23172'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:02.956946 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1119/2242] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:30:02 2022] DELETE /identity/v3/users/759b06113b7247db8e3a1fe9ded23172 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:30:02.961726 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea63dc-016c-49e9-8fec-9f9e659da1fc None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:02.962684 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea63dc-016c-49e9-8fec-9f9e659da1fc None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:02.963176 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea63dc-016c-49e9-8fec-9f9e659da1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:02.989845 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-ebea63dc-016c-49e9-8fec-9f9e659da1fc None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:30:02.991298 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-ebea63dc-016c-49e9-8fec-9f9e659da1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:03.096553 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1124/2243] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:30:03.113287 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa03de5-5ab1-4125-9b4d-7b7783d2d343 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:03.115928 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-3fa03de5-5ab1-4125-9b4d-7b7783d2d343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:03.233990 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa03de5-5ab1-4125-9b4d-7b7783d2d343 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:03.238357 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e33cc-6b8f-4363-860b-91dcd5052e5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:03.239179 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e33cc-6b8f-4363-860b-91dcd5052e5c service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:03.239906 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e33cc-6b8f-4363-860b-91dcd5052e5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:03.240184 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e33cc-6b8f-4363-860b-91dcd5052e5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:03.253839 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e33cc-6b8f-4363-860b-91dcd5052e5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:03.255322 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e33cc-6b8f-4363-860b-91dcd5052e5c service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:03.270010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1120/2244] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:30:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:30:03.665797 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea63dc-016c-49e9-8fec-9f9e659da1fc None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:03.671761 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-ebea63dc-016c-49e9-8fec-9f9e659da1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:03.700592 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea63dc-016c-49e9-8fec-9f9e659da1fc None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:03.708044 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881977f1-5df7-4298-bf6c-409e818397db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:03.709029 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881977f1-5df7-4298-bf6c-409e818397db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:03.710048 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881977f1-5df7-4298-bf6c-409e818397db admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:03.710540 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881977f1-5df7-4298-bf6c-409e818397db admin admin] PATH_INFO: `/v3/projects/4fe05713f21042b4a78adaf547aae030` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:03.716660 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881977f1-5df7-4298-bf6c-409e818397db admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fe05713f21042b4a78adaf547aae030)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:03.722167 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881977f1-5df7-4298-bf6c-409e818397db admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:03.833016 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-881977f1-5df7-4298-bf6c-409e818397db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fe05713f21042b4a78adaf547aae030', 'request_id': 'req-881977f1-5df7-4298-bf6c-409e818397db'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:03.849574 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-881977f1-5df7-4298-bf6c-409e818397db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fe05713f21042b4a78adaf547aae030', 'request_id': 'req-881977f1-5df7-4298-bf6c-409e818397db'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:03.882965 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-881977f1-5df7-4298-bf6c-409e818397db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fe05713f21042b4a78adaf547aae030', 'request_id': 'req-881977f1-5df7-4298-bf6c-409e818397db'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:03.897949 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:03.939158 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-881977f1-5df7-4298-bf6c-409e818397db admin admin] The token cache is being invalidate because project 4fe05713f21042b4a78adaf547aae030 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:30:03.939523 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-881977f1-5df7-4298-bf6c-409e818397db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:03.941072 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-881977f1-5df7-4298-bf6c-409e818397db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:03.952712 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1125/2245] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:30:03 2022] DELETE /identity/v3/projects/4fe05713f21042b4a78adaf547aae030 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:30:03.959220 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdf08b-ca27-4c14-80ed-fe2c5376515f None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:03.959978 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdf08b-ca27-4c14-80ed-fe2c5376515f None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:03.960574 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdf08b-ca27-4c14-80ed-fe2c5376515f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:04.011952 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-9bfdf08b-ca27-4c14-80ed-fe2c5376515f None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:30:04.013302 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-9bfdf08b-ca27-4c14-80ed-fe2c5376515f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:04.134319 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:04.255127 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1121/2246] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:30:04.265559 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074e2d9-67e4-4524-8e83-7498851f4204 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:04.266421 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074e2d9-67e4-4524-8e83-7498851f4204 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:04.266835 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074e2d9-67e4-4524-8e83-7498851f4204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:04.295050 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-6074e2d9-67e4-4524-8e83-7498851f4204 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:30:04.296177 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-6074e2d9-67e4-4524-8e83-7498851f4204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:04.305959 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1126/2247] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:30:04.312782 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfdf08b-ca27-4c14-80ed-fe2c5376515f None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:04.327557 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfdf08b-ca27-4c14-80ed-fe2c5376515f None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:04.346528 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16aa6d7-d719-461c-b6a2-cbba8b8f8c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:04.348700 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16aa6d7-d719-461c-b6a2-cbba8b8f8c6a admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:04.349191 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16aa6d7-d719-461c-b6a2-cbba8b8f8c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:04.349722 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16aa6d7-d719-461c-b6a2-cbba8b8f8c6a admin admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:04.351040 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16aa6d7-d719-461c-b6a2-cbba8b8f8c6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:30:04.351592 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16aa6d7-d719-461c-b6a2-cbba8b8f8c6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:04.355645 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16aa6d7-d719-461c-b6a2-cbba8b8f8c6a admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:04.383604 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1122/2248] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:30:04.389802 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074e2d9-67e4-4524-8e83-7498851f4204 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:04.409133 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074e2d9-67e4-4524-8e83-7498851f4204 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:04.417947 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87463b-e446-4d52-bf06-f2e1105cd4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:04.419661 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87463b-e446-4d52-bf06-f2e1105cd4fe admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:04.420256 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87463b-e446-4d52-bf06-f2e1105cd4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:04.420787 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87463b-e446-4d52-bf06-f2e1105cd4fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:04.422100 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87463b-e446-4d52-bf06-f2e1105cd4fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:04.425688 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87463b-e446-4d52-bf06-f2e1105cd4fe admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:04.486682 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1127/2249] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:30:04 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:30:04.497267 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16aa6d7-d719-461c-b6a2-cbba8b8f8c6a admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:04.514698 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16aa6d7-d719-461c-b6a2-cbba8b8f8c6a admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:04.617424 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b4b21-e04e-4d3d-89cb-8c5588073643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:04.618148 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b4b21-e04e-4d3d-89cb-8c5588073643 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:04.618435 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b4b21-e04e-4d3d-89cb-8c5588073643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:04.618723 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b4b21-e04e-4d3d-89cb-8c5588073643 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:04.619356 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b4b21-e04e-4d3d-89cb-8c5588073643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:04.622007 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b4b21-e04e-4d3d-89cb-8c5588073643 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:04.653859 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1123/2250] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:30:04 2022] POST /identity/v3/users => generated 283 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:30:04.658687 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87463b-e446-4d52-bf06-f2e1105cd4fe admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:04.675403 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87463b-e446-4d52-bf06-f2e1105cd4fe admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:04.681890 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64417324-2e5a-47ce-ae19-e963435705ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:04.683965 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64417324-2e5a-47ce-ae19-e963435705ac admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:04.684442 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64417324-2e5a-47ce-ae19-e963435705ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:04.685002 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64417324-2e5a-47ce-ae19-e963435705ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:04.685922 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64417324-2e5a-47ce-ae19-e963435705ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:04.688307 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64417324-2e5a-47ce-ae19-e963435705ac admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:04.707570 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1128/2251] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:30:04.712501 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b4b21-e04e-4d3d-89cb-8c5588073643 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:04.725717 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b4b21-e04e-4d3d-89cb-8c5588073643 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:04.731947 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942b516-384c-484f-a264-ecd1de4b9a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:04.733163 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942b516-384c-484f-a264-ecd1de4b9a65 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:04.733663 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942b516-384c-484f-a264-ecd1de4b9a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:04.734132 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942b516-384c-484f-a264-ecd1de4b9a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:04.735180 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1942b516-384c-484f-a264-ecd1de4b9a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:04.737850 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1942b516-384c-484f-a264-ecd1de4b9a65 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:04.752696 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1124/2252] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:30:04.758697 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64417324-2e5a-47ce-ae19-e963435705ac admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:04.770563 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64417324-2e5a-47ce-ae19-e963435705ac admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:04.776253 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3056e1e-213f-4f41-8b1f-fc840640861e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:04.776939 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3056e1e-213f-4f41-8b1f-fc840640861e admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:04.777222 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3056e1e-213f-4f41-8b1f-fc840640861e admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:04.777548 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3056e1e-213f-4f41-8b1f-fc840640861e admin admin] PATH_INFO: `/v3/projects/f49ae05c6aa84e8f882b628e58d6c152/users/7618f81ca9444c399b7a39d6223eb8c2/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:04.806812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3056e1e-213f-4f41-8b1f-fc840640861e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f49ae05c6aa84e8f882b628e58d6c152, user_id=7618f81ca9444c399b7a39d6223eb8c2, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:04.814176 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3056e1e-213f-4f41-8b1f-fc840640861e admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:04.837299 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1129/2253] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:30:04 2022] PUT /identity/v3/projects/f49ae05c6aa84e8f882b628e58d6c152/users/7618f81ca9444c399b7a39d6223eb8c2/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:30:04.850929 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abc291-561f-43eb-b102-24c234b86802 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:04.851399 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abc291-561f-43eb-b102-24c234b86802 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:04.851613 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abc291-561f-43eb-b102-24c234b86802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:04.890363 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-c5abc291-561f-43eb-b102-24c234b86802 None None] MFA Rules not processed for user `7618f81ca9444c399b7a39d6223eb8c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:30:04.891961 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-c5abc291-561f-43eb-b102-24c234b86802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:04.992081 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1125/2254] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:30:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:30:05.006819 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3056e1e-213f-4f41-8b1f-fc840640861e admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:05.009585 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-a3056e1e-213f-4f41-8b1f-fc840640861e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:05.118872 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3056e1e-213f-4f41-8b1f-fc840640861e admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:05.126637 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858555d-5d3e-4f11-ae93-a08005be6baa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:05.127677 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858555d-5d3e-4f11-ae93-a08005be6baa service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:05.128701 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858555d-5d3e-4f11-ae93-a08005be6baa service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:05.128863 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858555d-5d3e-4f11-ae93-a08005be6baa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:05.146056 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a858555d-5d3e-4f11-ae93-a08005be6baa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:05.148900 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a858555d-5d3e-4f11-ae93-a08005be6baa service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:05.164109 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1130/2255] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:30:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:30:07.714980 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331465b9-7c0b-4ce7-a3de-f8cf7a0c3f47 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:07.715844 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331465b9-7c0b-4ce7-a3de-f8cf7a0c3f47 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:07.715844 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331465b9-7c0b-4ce7-a3de-f8cf7a0c3f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:07.756330 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-331465b9-7c0b-4ce7-a3de-f8cf7a0c3f47 None None] MFA Rules not processed for user `18c3a4375ded41c89c877077ceb4f46d`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:30:07.759843 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-331465b9-7c0b-4ce7-a3de-f8cf7a0c3f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:07.823395 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:07.955815 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1126/2256] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:30:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:30:11.089566 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858555d-5d3e-4f11-ae93-a08005be6baa service cinder] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:11.092609 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-a858555d-5d3e-4f11-ae93-a08005be6baa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:11.228442 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858555d-5d3e-4f11-ae93-a08005be6baa service cinder] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:11.234356 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0153a7-c187-48a0-987f-da4146ca700f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:11.235272 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0153a7-c187-48a0-987f-da4146ca700f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:11.235558 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0153a7-c187-48a0-987f-da4146ca700f admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:11.235874 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0153a7-c187-48a0-987f-da4146ca700f admin admin] PATH_INFO: `/v3/users/cd35bf04b96b42f0a4de7ad3d3c00175` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:11.237396 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0153a7-c187-48a0-987f-da4146ca700f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd35bf04b96b42f0a4de7ad3d3c00175)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:11.240488 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0153a7-c187-48a0-987f-da4146ca700f admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:11.310350 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:11.342873 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-7c0153a7-c187-48a0-987f-da4146ca700f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd35bf04b96b42f0a4de7ad3d3c00175'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:11.343612 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-7c0153a7-c187-48a0-987f-da4146ca700f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd35bf04b96b42f0a4de7ad3d3c00175'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:11.380877 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-7c0153a7-c187-48a0-987f-da4146ca700f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd35bf04b96b42f0a4de7ad3d3c00175'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:11.397698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-7c0153a7-c187-48a0-987f-da4146ca700f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd35bf04b96b42f0a4de7ad3d3c00175'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:11.398866 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-7c0153a7-c187-48a0-987f-da4146ca700f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd35bf04b96b42f0a4de7ad3d3c00175'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:11.438316 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1131/2257] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:30:11 2022] DELETE /identity/v3/users/cd35bf04b96b42f0a4de7ad3d3c00175 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:30:11.799289 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331465b9-7c0b-4ce7-a3de-f8cf7a0c3f47 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:11.846730 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331465b9-7c0b-4ce7-a3de-f8cf7a0c3f47 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:12.083460 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b3763-087e-478c-8a0d-886f4addddee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:12.084193 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b3763-087e-478c-8a0d-886f4addddee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:12.084475 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b3763-087e-478c-8a0d-886f4addddee admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:12.084858 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b3763-087e-478c-8a0d-886f4addddee admin admin] PATH_INFO: `/v3/projects/0eb1af7d072c4046aab28665240d53ec` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:12.086418 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b3763-087e-478c-8a0d-886f4addddee admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eb1af7d072c4046aab28665240d53ec)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:12.089185 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b3763-087e-478c-8a0d-886f4addddee admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:12.178609 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-314b3763-087e-478c-8a0d-886f4addddee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eb1af7d072c4046aab28665240d53ec', 'request_id': 'req-314b3763-087e-478c-8a0d-886f4addddee'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:12.189059 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-314b3763-087e-478c-8a0d-886f4addddee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eb1af7d072c4046aab28665240d53ec', 'request_id': 'req-314b3763-087e-478c-8a0d-886f4addddee'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:12.201143 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-314b3763-087e-478c-8a0d-886f4addddee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eb1af7d072c4046aab28665240d53ec', 'request_id': 'req-314b3763-087e-478c-8a0d-886f4addddee'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:12.223576 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-314b3763-087e-478c-8a0d-886f4addddee admin admin] The token cache is being invalidate because project 0eb1af7d072c4046aab28665240d53ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:30:12.224000 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-314b3763-087e-478c-8a0d-886f4addddee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:12.225076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-314b3763-087e-478c-8a0d-886f4addddee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:12.227825 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1127/2258] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:30:11 2022] DELETE /identity/v3/projects/0eb1af7d072c4046aab28665240d53ec => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:30:12.234723 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0153a7-c187-48a0-987f-da4146ca700f admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:12.237504 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-7c0153a7-c187-48a0-987f-da4146ca700f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:12.264688 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0153a7-c187-48a0-987f-da4146ca700f admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:12.365322 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a7bba-c8e5-4229-a148-c747a28cb1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:12.366039 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a7bba-c8e5-4229-a148-c747a28cb1c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:12.366323 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a7bba-c8e5-4229-a148-c747a28cb1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:12.366603 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a7bba-c8e5-4229-a148-c747a28cb1c5 admin admin] PATH_INFO: `/v3/users/63ed7644dcdd4c978152db8f2b6dfbbb` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:12.368371 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a7bba-c8e5-4229-a148-c747a28cb1c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63ed7644dcdd4c978152db8f2b6dfbbb)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:12.371245 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a7bba-c8e5-4229-a148-c747a28cb1c5 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:12.477323 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-866a7bba-c8e5-4229-a148-c747a28cb1c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63ed7644dcdd4c978152db8f2b6dfbbb'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:12.478439 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-866a7bba-c8e5-4229-a148-c747a28cb1c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63ed7644dcdd4c978152db8f2b6dfbbb'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:12.494824 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-866a7bba-c8e5-4229-a148-c747a28cb1c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63ed7644dcdd4c978152db8f2b6dfbbb'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:12.508514 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-866a7bba-c8e5-4229-a148-c747a28cb1c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63ed7644dcdd4c978152db8f2b6dfbbb'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:12.509732 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-866a7bba-c8e5-4229-a148-c747a28cb1c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63ed7644dcdd4c978152db8f2b6dfbbb'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:12.551138 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1132/2259] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:30:12 2022] DELETE /identity/v3/users/63ed7644dcdd4c978152db8f2b6dfbbb => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:30:12.873958 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b3763-087e-478c-8a0d-886f4addddee admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:12.876540 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-314b3763-087e-478c-8a0d-886f4addddee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:12.919924 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b3763-087e-478c-8a0d-886f4addddee admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:13.084665 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec6c78-6223-46cc-b4b1-6108ee802bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:13.086269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec6c78-6223-46cc-b4b1-6108ee802bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:13.087006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec6c78-6223-46cc-b4b1-6108ee802bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:13.087481 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec6c78-6223-46cc-b4b1-6108ee802bb3 admin admin] PATH_INFO: `/v3/projects/4dd4a60749aa44a183eaef0ddbcab697` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:13.090882 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec6c78-6223-46cc-b4b1-6108ee802bb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dd4a60749aa44a183eaef0ddbcab697)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:13.095553 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec6c78-6223-46cc-b4b1-6108ee802bb3 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:13.100840 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:13.338337 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-73ec6c78-6223-46cc-b4b1-6108ee802bb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dd4a60749aa44a183eaef0ddbcab697', 'request_id': 'req-73ec6c78-6223-46cc-b4b1-6108ee802bb3'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:13.376379 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-73ec6c78-6223-46cc-b4b1-6108ee802bb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dd4a60749aa44a183eaef0ddbcab697', 'request_id': 'req-73ec6c78-6223-46cc-b4b1-6108ee802bb3'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:13.422307 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-73ec6c78-6223-46cc-b4b1-6108ee802bb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dd4a60749aa44a183eaef0ddbcab697', 'request_id': 'req-73ec6c78-6223-46cc-b4b1-6108ee802bb3'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:13.468610 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-73ec6c78-6223-46cc-b4b1-6108ee802bb3 admin admin] The token cache is being invalidate because project 4dd4a60749aa44a183eaef0ddbcab697 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:30:13.475068 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-73ec6c78-6223-46cc-b4b1-6108ee802bb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:13.480702 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-73ec6c78-6223-46cc-b4b1-6108ee802bb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:13.485438 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1128/2260] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:30:12 2022] DELETE /identity/v3/projects/4dd4a60749aa44a183eaef0ddbcab697 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:30:13.498023 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cffe0-5654-4391-b71c-f420ba08573e None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:13.499063 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cffe0-5654-4391-b71c-f420ba08573e None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:13.500140 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cffe0-5654-4391-b71c-f420ba08573e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:13.559982 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-744cffe0-5654-4391-b71c-f420ba08573e None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:30:13.567083 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-744cffe0-5654-4391-b71c-f420ba08573e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:13.706310 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:13.860072 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1133/2261] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:30:13.873723 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0354d-49bd-4cee-bfd1-5be642c01bfc None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:13.874779 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0354d-49bd-4cee-bfd1-5be642c01bfc None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:13.876920 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0354d-49bd-4cee-bfd1-5be642c01bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:13.909883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-2ac0354d-49bd-4cee-bfd1-5be642c01bfc None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:30:13.911910 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-2ac0354d-49bd-4cee-bfd1-5be642c01bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:13.929512 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1129/2262] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:30:13.934558 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744cffe0-5654-4391-b71c-f420ba08573e None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:13.951426 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744cffe0-5654-4391-b71c-f420ba08573e None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:13.964967 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4ebbd-4c32-481e-907b-7d977e58e11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:13.966867 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4ebbd-4c32-481e-907b-7d977e58e11e admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:13.966867 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4ebbd-4c32-481e-907b-7d977e58e11e admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:13.967238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4ebbd-4c32-481e-907b-7d977e58e11e admin admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:13.968856 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4ebbd-4c32-481e-907b-7d977e58e11e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:30:13.979255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4ebbd-4c32-481e-907b-7d977e58e11e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:13.982253 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4ebbd-4c32-481e-907b-7d977e58e11e admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:14.028783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1134/2263] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:30:14.031421 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0354d-49bd-4cee-bfd1-5be642c01bfc None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:14.060363 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0354d-49bd-4cee-bfd1-5be642c01bfc None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:14.083601 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04147c9-4f0c-47af-b88d-c5533ca44253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:14.085975 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04147c9-4f0c-47af-b88d-c5533ca44253 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:14.086446 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04147c9-4f0c-47af-b88d-c5533ca44253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:14.086909 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04147c9-4f0c-47af-b88d-c5533ca44253 admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:14.102039 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04147c9-4f0c-47af-b88d-c5533ca44253 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:14.102039 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04147c9-4f0c-47af-b88d-c5533ca44253 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:14.208053 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1130/2264] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:30:14 2022] POST /identity/v3/projects => generated 383 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:30:14.209222 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4ebbd-4c32-481e-907b-7d977e58e11e admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:14.245556 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4ebbd-4c32-481e-907b-7d977e58e11e admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:14.467106 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf56f5-85f9-4015-9f17-5066ea1b24e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:14.470618 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf56f5-85f9-4015-9f17-5066ea1b24e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:14.471943 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf56f5-85f9-4015-9f17-5066ea1b24e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:14.473619 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf56f5-85f9-4015-9f17-5066ea1b24e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:14.475052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf56f5-85f9-4015-9f17-5066ea1b24e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:14.479999 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf56f5-85f9-4015-9f17-5066ea1b24e9 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:14.560558 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1135/2265] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:30:14 2022] POST /identity/v3/users => generated 292 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:30:14.564790 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04147c9-4f0c-47af-b88d-c5533ca44253 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:14.612639 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04147c9-4f0c-47af-b88d-c5533ca44253 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:14.632180 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1eb894-2cbb-48a8-b099-72f8b2a3e89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:14.634497 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1eb894-2cbb-48a8-b099-72f8b2a3e89b admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:14.636862 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1eb894-2cbb-48a8-b099-72f8b2a3e89b admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:14.637452 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1eb894-2cbb-48a8-b099-72f8b2a3e89b admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:14.638619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1eb894-2cbb-48a8-b099-72f8b2a3e89b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:14.644547 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1eb894-2cbb-48a8-b099-72f8b2a3e89b admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:14.677323 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1131/2266] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:30:14.682777 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf56f5-85f9-4015-9f17-5066ea1b24e9 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:14.700427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf56f5-85f9-4015-9f17-5066ea1b24e9 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:14.713901 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee8f40-adb3-4656-a054-e0e5b5250273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:14.717025 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee8f40-adb3-4656-a054-e0e5b5250273 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:14.720341 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee8f40-adb3-4656-a054-e0e5b5250273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:14.721769 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee8f40-adb3-4656-a054-e0e5b5250273 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:14.722651 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee8f40-adb3-4656-a054-e0e5b5250273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:14.724491 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee8f40-adb3-4656-a054-e0e5b5250273 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:14.740739 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1136/2267] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:30:14.746266 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1eb894-2cbb-48a8-b099-72f8b2a3e89b admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:14.770316 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1eb894-2cbb-48a8-b099-72f8b2a3e89b admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:14.777416 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7de72-1f3c-41d7-8f75-13c0bed879a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:14.778074 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7de72-1f3c-41d7-8f75-13c0bed879a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:14.778391 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7de72-1f3c-41d7-8f75-13c0bed879a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:14.778876 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7de72-1f3c-41d7-8f75-13c0bed879a6 admin admin] PATH_INFO: `/v3/projects/c09528058ccf454581c1bd44afcd81a6/users/32046b1f82994ac79148f81b5f70aa3d/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:14.800337 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc7de72-1f3c-41d7-8f75-13c0bed879a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c09528058ccf454581c1bd44afcd81a6, user_id=32046b1f82994ac79148f81b5f70aa3d, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:14.803880 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc7de72-1f3c-41d7-8f75-13c0bed879a6 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:14.829319 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1132/2268] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:30:14 2022] PUT /identity/v3/projects/c09528058ccf454581c1bd44afcd81a6/users/32046b1f82994ac79148f81b5f70aa3d/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:30:14.841644 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc86b11-cd81-4a03-82f3-75a974eb4562 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:14.841940 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc86b11-cd81-4a03-82f3-75a974eb4562 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:14.842220 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc86b11-cd81-4a03-82f3-75a974eb4562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:14.886962 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-3cc86b11-cd81-4a03-82f3-75a974eb4562 None None] MFA Rules not processed for user `32046b1f82994ac79148f81b5f70aa3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:30:14.888553 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-3cc86b11-cd81-4a03-82f3-75a974eb4562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:15.034852 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1137/2269] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:30:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:30:15.040516 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7de72-1f3c-41d7-8f75-13c0bed879a6 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:15.139150 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7de72-1f3c-41d7-8f75-13c0bed879a6 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:15.145302 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e45928-4440-4ce8-8448-5f7263d938be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:15.146102 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e45928-4440-4ce8-8448-5f7263d938be admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:15.146537 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e45928-4440-4ce8-8448-5f7263d938be admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:15.155211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e45928-4440-4ce8-8448-5f7263d938be admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:15.156090 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e45928-4440-4ce8-8448-5f7263d938be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:15.160587 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e45928-4440-4ce8-8448-5f7263d938be admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:15.225575 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1133/2270] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:30:15 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:30:15.230448 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc86b11-cd81-4a03-82f3-75a974eb4562 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:15.246898 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc86b11-cd81-4a03-82f3-75a974eb4562 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:15.302324 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:15.400380 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e1a13-0dcd-4677-8202-1ca721da6fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:15.402588 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e1a13-0dcd-4677-8202-1ca721da6fed admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:15.404602 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e1a13-0dcd-4677-8202-1ca721da6fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:15.406384 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e1a13-0dcd-4677-8202-1ca721da6fed admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:15.410944 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e1a13-0dcd-4677-8202-1ca721da6fed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:15.419181 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e1a13-0dcd-4677-8202-1ca721da6fed admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:15.522479 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1138/2271] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:30:15 2022] POST /identity/v3/users => generated 299 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:30:15.528178 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e45928-4440-4ce8-8448-5f7263d938be admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:15.593677 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e45928-4440-4ce8-8448-5f7263d938be admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:15.628361 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4d648-3fed-47a6-a4f2-44b70429ed25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:15.629115 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4d648-3fed-47a6-a4f2-44b70429ed25 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:15.629475 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4d648-3fed-47a6-a4f2-44b70429ed25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:15.629755 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4d648-3fed-47a6-a4f2-44b70429ed25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:15.630741 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4d648-3fed-47a6-a4f2-44b70429ed25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:15.633480 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4d648-3fed-47a6-a4f2-44b70429ed25 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:15.654009 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:15.675362 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1134/2272] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:30:15.686337 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e1a13-0dcd-4677-8202-1ca721da6fed admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:15.704143 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e1a13-0dcd-4677-8202-1ca721da6fed admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:15.709816 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b52e2e-cf46-4fff-b554-1f40731147dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:15.710510 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b52e2e-cf46-4fff-b554-1f40731147dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:15.710781 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b52e2e-cf46-4fff-b554-1f40731147dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:15.711062 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b52e2e-cf46-4fff-b554-1f40731147dc admin admin] PATH_INFO: `/v3/projects/65921a6363054d30972f2a889aa42d54/users/d08e45e30bc94a159645ba23652ba8c4/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:15.737789 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b52e2e-cf46-4fff-b554-1f40731147dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=65921a6363054d30972f2a889aa42d54, user_id=d08e45e30bc94a159645ba23652ba8c4, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:15.741222 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b52e2e-cf46-4fff-b554-1f40731147dc admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:15.773309 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1139/2273] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:30:15 2022] PUT /identity/v3/projects/65921a6363054d30972f2a889aa42d54/users/d08e45e30bc94a159645ba23652ba8c4/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:30:15.780870 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4d648-3fed-47a6-a4f2-44b70429ed25 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:15.798347 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4d648-3fed-47a6-a4f2-44b70429ed25 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:16.032350 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510cf08-bb19-4013-a76b-a26995f166d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:16.032350 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510cf08-bb19-4013-a76b-a26995f166d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:16.032350 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510cf08-bb19-4013-a76b-a26995f166d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:16.032350 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510cf08-bb19-4013-a76b-a26995f166d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:16.032770 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6510cf08-bb19-4013-a76b-a26995f166d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:16.039654 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6510cf08-bb19-4013-a76b-a26995f166d8 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:16.070786 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1135/2274] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:30:16.078808 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b52e2e-cf46-4fff-b554-1f40731147dc admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:16.110106 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b52e2e-cf46-4fff-b554-1f40731147dc admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:16.121159 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b377f-92af-4218-8d5a-808b4a41660f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:16.122717 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b377f-92af-4218-8d5a-808b4a41660f admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:16.123308 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b377f-92af-4218-8d5a-808b4a41660f admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:16.123882 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b377f-92af-4218-8d5a-808b4a41660f admin admin] PATH_INFO: `/v3/projects/65921a6363054d30972f2a889aa42d54/users/d08e45e30bc94a159645ba23652ba8c4/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:16.128107 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b377f-92af-4218-8d5a-808b4a41660f admin admin] RBAC: Authorizing `identity:create_grant(project_id=65921a6363054d30972f2a889aa42d54, user_id=d08e45e30bc94a159645ba23652ba8c4, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:16.134340 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b377f-92af-4218-8d5a-808b4a41660f admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:16.171333 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1140/2275] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:30:16 2022] PUT /identity/v3/projects/65921a6363054d30972f2a889aa42d54/users/d08e45e30bc94a159645ba23652ba8c4/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:30:16.185600 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310de5a7-dabb-4df0-a6ac-35ea5585004d None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:16.186360 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310de5a7-dabb-4df0-a6ac-35ea5585004d None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:16.187139 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310de5a7-dabb-4df0-a6ac-35ea5585004d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:16.279649 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-310de5a7-dabb-4df0-a6ac-35ea5585004d None None] MFA Rules not processed for user `d08e45e30bc94a159645ba23652ba8c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:30:16.283375 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-310de5a7-dabb-4df0-a6ac-35ea5585004d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:16.503732 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1136/2276] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:30:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:30:16.527962 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b377f-92af-4218-8d5a-808b4a41660f admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:16.531752 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-cc8b377f-92af-4218-8d5a-808b4a41660f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:16.640929 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b377f-92af-4218-8d5a-808b4a41660f admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:16.646130 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acd697-f2da-4125-82c3-139cc2c26f1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:16.647273 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acd697-f2da-4125-82c3-139cc2c26f1e service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:16.647645 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acd697-f2da-4125-82c3-139cc2c26f1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:16.647979 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acd697-f2da-4125-82c3-139cc2c26f1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:16.764897 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acd697-f2da-4125-82c3-139cc2c26f1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:16.767701 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acd697-f2da-4125-82c3-139cc2c26f1e service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:16.788180 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1141/2277] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:30:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:30:18.841733 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f314b-3713-4be2-9f44-2aa267451b8e None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:18.842957 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f314b-3713-4be2-9f44-2aa267451b8e None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:18.843238 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f314b-3713-4be2-9f44-2aa267451b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:18.865866 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-090f314b-3713-4be2-9f44-2aa267451b8e None None] MFA Rules not processed for user `035cc211744f457f9fe65bd7d0e6bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:30:18.867162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-090f314b-3713-4be2-9f44-2aa267451b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:18.968784 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1137/2278] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:30:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:30:22.480780 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acd697-f2da-4125-82c3-139cc2c26f1e service cinder] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:22.485111 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-22acd697-f2da-4125-82c3-139cc2c26f1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:22.514273 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acd697-f2da-4125-82c3-139cc2c26f1e service cinder] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:22.520900 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674f686-9796-4b5b-ae53-f478b9239e2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:22.521615 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674f686-9796-4b5b-ae53-f478b9239e2a service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:22.522227 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674f686-9796-4b5b-ae53-f478b9239e2a service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:22.522227 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674f686-9796-4b5b-ae53-f478b9239e2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:22.548513 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674f686-9796-4b5b-ae53-f478b9239e2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:22.552142 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674f686-9796-4b5b-ae53-f478b9239e2a service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:22.587311 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1142/2279] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:30:22 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:30:28.745570 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f314b-3713-4be2-9f44-2aa267451b8e None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:28.827816 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:28.907126 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f314b-3713-4be2-9f44-2aa267451b8e None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:28.916444 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68851e7d-ad35-4a9b-bcd5-6f1b4ad78e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:28.919058 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68851e7d-ad35-4a9b-bcd5-6f1b4ad78e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:28.919058 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68851e7d-ad35-4a9b-bcd5-6f1b4ad78e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:28.919058 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68851e7d-ad35-4a9b-bcd5-6f1b4ad78e59 admin admin] PATH_INFO: `/v3/users/32046b1f82994ac79148f81b5f70aa3d` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:28.920735 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68851e7d-ad35-4a9b-bcd5-6f1b4ad78e59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32046b1f82994ac79148f81b5f70aa3d)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:28.924205 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68851e7d-ad35-4a9b-bcd5-6f1b4ad78e59 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:29.160123 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-68851e7d-ad35-4a9b-bcd5-6f1b4ad78e59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32046b1f82994ac79148f81b5f70aa3d'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:29.161358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-68851e7d-ad35-4a9b-bcd5-6f1b4ad78e59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32046b1f82994ac79148f81b5f70aa3d'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:29.183541 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-68851e7d-ad35-4a9b-bcd5-6f1b4ad78e59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32046b1f82994ac79148f81b5f70aa3d'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:29.204932 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-68851e7d-ad35-4a9b-bcd5-6f1b4ad78e59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32046b1f82994ac79148f81b5f70aa3d'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:29.279873 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-68851e7d-ad35-4a9b-bcd5-6f1b4ad78e59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32046b1f82994ac79148f81b5f70aa3d'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:29.297519 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1138/2280] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:30:28 2022] DELETE /identity/v3/users/32046b1f82994ac79148f81b5f70aa3d => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:30:29.303209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe9d90-6eb8-445e-8b18-d868405b7a8f None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:29.303811 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe9d90-6eb8-445e-8b18-d868405b7a8f None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:29.304201 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe9d90-6eb8-445e-8b18-d868405b7a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:29.339705 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-61fe9d90-6eb8-445e-8b18-d868405b7a8f None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:30:29.346909 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-61fe9d90-6eb8-445e-8b18-d868405b7a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:29.363096 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:29.479900 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1143/2281] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:30:29.498270 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68851e7d-ad35-4a9b-bcd5-6f1b4ad78e59 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:29.504785 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-68851e7d-ad35-4a9b-bcd5-6f1b4ad78e59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:29.652587 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68851e7d-ad35-4a9b-bcd5-6f1b4ad78e59 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:29.662865 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a650184b-3e01-495e-92a0-3ed29f2fddef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:29.663814 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650184b-3e01-495e-92a0-3ed29f2fddef service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:29.664231 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650184b-3e01-495e-92a0-3ed29f2fddef service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:29.664636 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650184b-3e01-495e-92a0-3ed29f2fddef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:29.689829 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a650184b-3e01-495e-92a0-3ed29f2fddef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:29.692358 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a650184b-3e01-495e-92a0-3ed29f2fddef service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:29.713481 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1139/2282] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:30:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:30:30.409596 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe9d90-6eb8-445e-8b18-d868405b7a8f None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:30.414783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-61fe9d90-6eb8-445e-8b18-d868405b7a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:30.465972 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe9d90-6eb8-445e-8b18-d868405b7a8f None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:30.494461 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc8791-7956-4097-a6c6-8746d6910eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:30.495824 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc8791-7956-4097-a6c6-8746d6910eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:30.496297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc8791-7956-4097-a6c6-8746d6910eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:30.496819 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc8791-7956-4097-a6c6-8746d6910eaf admin admin] PATH_INFO: `/v3/projects/c09528058ccf454581c1bd44afcd81a6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:30.499467 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc8791-7956-4097-a6c6-8746d6910eaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c09528058ccf454581c1bd44afcd81a6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:30.503299 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc8791-7956-4097-a6c6-8746d6910eaf admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:30.657028 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f5cc8791-7956-4097-a6c6-8746d6910eaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c09528058ccf454581c1bd44afcd81a6', 'request_id': 'req-f5cc8791-7956-4097-a6c6-8746d6910eaf'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:30.677545 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f5cc8791-7956-4097-a6c6-8746d6910eaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c09528058ccf454581c1bd44afcd81a6', 'request_id': 'req-f5cc8791-7956-4097-a6c6-8746d6910eaf'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:30.700451 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f5cc8791-7956-4097-a6c6-8746d6910eaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c09528058ccf454581c1bd44afcd81a6', 'request_id': 'req-f5cc8791-7956-4097-a6c6-8746d6910eaf'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:30.737756 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f5cc8791-7956-4097-a6c6-8746d6910eaf admin admin] The token cache is being invalidate because project c09528058ccf454581c1bd44afcd81a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:30:30.738397 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f5cc8791-7956-4097-a6c6-8746d6910eaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:30.739741 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f5cc8791-7956-4097-a6c6-8746d6910eaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:30.745762 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1144/2283] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:30:30 2022] DELETE /identity/v3/projects/c09528058ccf454581c1bd44afcd81a6 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:30:30.750881 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a650184b-3e01-495e-92a0-3ed29f2fddef service neutron] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:30.789646 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a650184b-3e01-495e-92a0-3ed29f2fddef service neutron] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:30.954079 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:30.991279 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71279d40-7797-45b3-86d2-3e727473f577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:30.997579 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71279d40-7797-45b3-86d2-3e727473f577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:30.998563 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71279d40-7797-45b3-86d2-3e727473f577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:31.000643 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71279d40-7797-45b3-86d2-3e727473f577 admin admin] PATH_INFO: `/v3/users/d08e45e30bc94a159645ba23652ba8c4` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:31.004452 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71279d40-7797-45b3-86d2-3e727473f577 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d08e45e30bc94a159645ba23652ba8c4)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:31.010621 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71279d40-7797-45b3-86d2-3e727473f577 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:31.098842 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-71279d40-7797-45b3-86d2-3e727473f577 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd08e45e30bc94a159645ba23652ba8c4'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:31.099900 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-71279d40-7797-45b3-86d2-3e727473f577 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd08e45e30bc94a159645ba23652ba8c4'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:31.110128 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-71279d40-7797-45b3-86d2-3e727473f577 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd08e45e30bc94a159645ba23652ba8c4'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:31.137500 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-71279d40-7797-45b3-86d2-3e727473f577 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd08e45e30bc94a159645ba23652ba8c4'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:31.196547 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-71279d40-7797-45b3-86d2-3e727473f577 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd08e45e30bc94a159645ba23652ba8c4'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:31.219504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1140/2284] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:30:30 2022] DELETE /identity/v3/users/d08e45e30bc94a159645ba23652ba8c4 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:30:31.881395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc8791-7956-4097-a6c6-8746d6910eaf admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:31.884578 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-f5cc8791-7956-4097-a6c6-8746d6910eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:31.918711 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc8791-7956-4097-a6c6-8746d6910eaf admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:32.160502 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3a789-e9f6-461f-b99e-7b0c2cd486ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:32.162375 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3a789-e9f6-461f-b99e-7b0c2cd486ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:32.163243 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3a789-e9f6-461f-b99e-7b0c2cd486ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:32.163993 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3a789-e9f6-461f-b99e-7b0c2cd486ce admin admin] PATH_INFO: `/v3/projects/65921a6363054d30972f2a889aa42d54` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:32.166422 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3a789-e9f6-461f-b99e-7b0c2cd486ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=65921a6363054d30972f2a889aa42d54)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:32.168934 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3a789-e9f6-461f-b99e-7b0c2cd486ce admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:32.292433 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:32.305055 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-e2a3a789-e9f6-461f-b99e-7b0c2cd486ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65921a6363054d30972f2a889aa42d54', 'request_id': 'req-e2a3a789-e9f6-461f-b99e-7b0c2cd486ce'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:32.330231 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-e2a3a789-e9f6-461f-b99e-7b0c2cd486ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65921a6363054d30972f2a889aa42d54', 'request_id': 'req-e2a3a789-e9f6-461f-b99e-7b0c2cd486ce'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:32.364059 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-e2a3a789-e9f6-461f-b99e-7b0c2cd486ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65921a6363054d30972f2a889aa42d54', 'request_id': 'req-e2a3a789-e9f6-461f-b99e-7b0c2cd486ce'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:32.435949 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-e2a3a789-e9f6-461f-b99e-7b0c2cd486ce admin admin] The token cache is being invalidate because project 65921a6363054d30972f2a889aa42d54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:30:32.436483 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-e2a3a789-e9f6-461f-b99e-7b0c2cd486ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:32.438179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-e2a3a789-e9f6-461f-b99e-7b0c2cd486ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:32.443565 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1145/2285] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:30:31 2022] DELETE /identity/v3/projects/65921a6363054d30972f2a889aa42d54 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:30:32.456227 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee214bb-823c-4e7e-962e-85258f644815 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:32.458886 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee214bb-823c-4e7e-962e-85258f644815 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:32.459867 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee214bb-823c-4e7e-962e-85258f644815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:32.553534 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-7ee214bb-823c-4e7e-962e-85258f644815 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:30:32.562689 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-7ee214bb-823c-4e7e-962e-85258f644815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:32.733643 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1141/2286] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:30:32.746933 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84196069-9d8a-4546-a5a4-b75183937f49 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:32.747481 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84196069-9d8a-4546-a5a4-b75183937f49 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:32.749257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84196069-9d8a-4546-a5a4-b75183937f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:32.792929 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-84196069-9d8a-4546-a5a4-b75183937f49 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:30:32.797033 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-84196069-9d8a-4546-a5a4-b75183937f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:32.824560 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1146/2287] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:30:32.825323 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee214bb-823c-4e7e-962e-85258f644815 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:32.844621 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee214bb-823c-4e7e-962e-85258f644815 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:32.856057 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484decb-f5b4-4eef-bde1-1d1eb4237f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:32.856991 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484decb-f5b4-4eef-bde1-1d1eb4237f5e admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:32.857269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484decb-f5b4-4eef-bde1-1d1eb4237f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:32.858474 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484decb-f5b4-4eef-bde1-1d1eb4237f5e admin admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:32.858474 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484decb-f5b4-4eef-bde1-1d1eb4237f5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:30:32.858802 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484decb-f5b4-4eef-bde1-1d1eb4237f5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:32.860296 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484decb-f5b4-4eef-bde1-1d1eb4237f5e admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:32.887644 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1142/2288] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:30:32.894322 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84196069-9d8a-4546-a5a4-b75183937f49 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:32.910036 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84196069-9d8a-4546-a5a4-b75183937f49 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:32.919036 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbd658-114a-4161-a825-fc330eaea923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:32.919946 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbd658-114a-4161-a825-fc330eaea923 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:32.920229 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbd658-114a-4161-a825-fc330eaea923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:32.921484 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbd658-114a-4161-a825-fc330eaea923 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:32.922145 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dbd658-114a-4161-a825-fc330eaea923 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:32.925240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dbd658-114a-4161-a825-fc330eaea923 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:33.005411 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484decb-f5b4-4eef-bde1-1d1eb4237f5e admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:33.022968 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1147/2289] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:30:32 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:30:33.037555 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484decb-f5b4-4eef-bde1-1d1eb4237f5e admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:33.242886 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:33.271896 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185ba3e-ffcf-430c-8607-3dc156d4afe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:33.277745 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185ba3e-ffcf-430c-8607-3dc156d4afe0 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:33.278437 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185ba3e-ffcf-430c-8607-3dc156d4afe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:33.279276 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185ba3e-ffcf-430c-8607-3dc156d4afe0 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:33.280601 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f185ba3e-ffcf-430c-8607-3dc156d4afe0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:33.289015 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f185ba3e-ffcf-430c-8607-3dc156d4afe0 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:33.360337 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1143/2290] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:30:33 2022] POST /identity/v3/users => generated 287 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:30:33.366769 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbd658-114a-4161-a825-fc330eaea923 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:33.420971 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbd658-114a-4161-a825-fc330eaea923 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:33.436565 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74a890-ef2e-4c50-9777-79f188d0a67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:33.439583 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74a890-ef2e-4c50-9777-79f188d0a67a admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:33.441467 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74a890-ef2e-4c50-9777-79f188d0a67a admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:33.449827 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74a890-ef2e-4c50-9777-79f188d0a67a admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:33.451184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74a890-ef2e-4c50-9777-79f188d0a67a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:33.455095 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74a890-ef2e-4c50-9777-79f188d0a67a admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:33.506543 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1148/2291] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:30:33.508266 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185ba3e-ffcf-430c-8607-3dc156d4afe0 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:33.533276 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185ba3e-ffcf-430c-8607-3dc156d4afe0 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:33.545404 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117f00e-5a15-42d9-97b7-0dfa7ca40ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:33.547795 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117f00e-5a15-42d9-97b7-0dfa7ca40ccf admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:33.548307 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117f00e-5a15-42d9-97b7-0dfa7ca40ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:33.548816 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117f00e-5a15-42d9-97b7-0dfa7ca40ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:33.550158 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117f00e-5a15-42d9-97b7-0dfa7ca40ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:33.553481 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117f00e-5a15-42d9-97b7-0dfa7ca40ccf admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:33.590688 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1144/2292] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:30:33.594656 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74a890-ef2e-4c50-9777-79f188d0a67a admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:33.625205 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74a890-ef2e-4c50-9777-79f188d0a67a admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:33.634674 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f474a-7b9d-49c3-ba96-129b2b63aba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:33.636170 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f474a-7b9d-49c3-ba96-129b2b63aba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:33.636691 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f474a-7b9d-49c3-ba96-129b2b63aba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:33.637208 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f474a-7b9d-49c3-ba96-129b2b63aba0 admin admin] PATH_INFO: `/v3/projects/2441ce7554bb40609a682abfc9a43930/users/8c768d81eeb142779378a864542287b0/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:33.687223 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f474a-7b9d-49c3-ba96-129b2b63aba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2441ce7554bb40609a682abfc9a43930, user_id=8c768d81eeb142779378a864542287b0, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:33.704510 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f474a-7b9d-49c3-ba96-129b2b63aba0 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:33.757499 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1149/2293] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:30:33 2022] PUT /identity/v3/projects/2441ce7554bb40609a682abfc9a43930/users/8c768d81eeb142779378a864542287b0/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:30:33.795379 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637500d9-e0b3-430b-afdd-8795bbbb958b None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:33.796134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637500d9-e0b3-430b-afdd-8795bbbb958b None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:33.797680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637500d9-e0b3-430b-afdd-8795bbbb958b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:33.984918 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-637500d9-e0b3-430b-afdd-8795bbbb958b None None] MFA Rules not processed for user `8c768d81eeb142779378a864542287b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:30:33.992138 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-637500d9-e0b3-430b-afdd-8795bbbb958b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:34.228134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1145/2294] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:30:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:30:34.247412 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f474a-7b9d-49c3-ba96-129b2b63aba0 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:34.250961 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-ed7f474a-7b9d-49c3-ba96-129b2b63aba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:34.367931 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f474a-7b9d-49c3-ba96-129b2b63aba0 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:34.372427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796decf-ac24-4ec2-81b9-97cc35a1950f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:34.373164 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796decf-ac24-4ec2-81b9-97cc35a1950f service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:34.373482 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796decf-ac24-4ec2-81b9-97cc35a1950f service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:34.373759 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796decf-ac24-4ec2-81b9-97cc35a1950f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:34.385011 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796decf-ac24-4ec2-81b9-97cc35a1950f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:34.386928 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796decf-ac24-4ec2-81b9-97cc35a1950f service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:34.402219 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1150/2295] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:30:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:30:38.374174 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637500d9-e0b3-430b-afdd-8795bbbb958b None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:38.519251 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637500d9-e0b3-430b-afdd-8795bbbb958b None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:38.530513 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b336aee-6189-45de-a3a5-a40294551025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:38.531473 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b336aee-6189-45de-a3a5-a40294551025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:38.532119 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b336aee-6189-45de-a3a5-a40294551025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:38.532676 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b336aee-6189-45de-a3a5-a40294551025 admin admin] PATH_INFO: `/v3/users/8c768d81eeb142779378a864542287b0` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:38.534637 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b336aee-6189-45de-a3a5-a40294551025 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c768d81eeb142779378a864542287b0)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:38.538235 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b336aee-6189-45de-a3a5-a40294551025 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:38.672777 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-5b336aee-6189-45de-a3a5-a40294551025 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c768d81eeb142779378a864542287b0'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:38.674618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-5b336aee-6189-45de-a3a5-a40294551025 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c768d81eeb142779378a864542287b0'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:38.691878 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-5b336aee-6189-45de-a3a5-a40294551025 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c768d81eeb142779378a864542287b0'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:38.710488 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-5b336aee-6189-45de-a3a5-a40294551025 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c768d81eeb142779378a864542287b0'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:38.715745 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:38.746867 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-5b336aee-6189-45de-a3a5-a40294551025 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c768d81eeb142779378a864542287b0'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:38.757792 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1146/2296] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:30:38 2022] DELETE /identity/v3/users/8c768d81eeb142779378a864542287b0 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:30:38.764541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4466c9c-b2ac-4892-a586-ca01b88a0a4a None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:38.765361 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4466c9c-b2ac-4892-a586-ca01b88a0a4a None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:38.765576 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4466c9c-b2ac-4892-a586-ca01b88a0a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:38.815423 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-b4466c9c-b2ac-4892-a586-ca01b88a0a4a None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:30:38.821578 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-b4466c9c-b2ac-4892-a586-ca01b88a0a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:38.964590 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1151/2297] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:30:38.983424 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b336aee-6189-45de-a3a5-a40294551025 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:38.989448 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-5b336aee-6189-45de-a3a5-a40294551025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:39.127568 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b336aee-6189-45de-a3a5-a40294551025 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:39.133868 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33ac87-7cf1-471e-b2a1-826742a48529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:39.134800 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33ac87-7cf1-471e-b2a1-826742a48529 service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:39.134932 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33ac87-7cf1-471e-b2a1-826742a48529 service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:39.135881 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33ac87-7cf1-471e-b2a1-826742a48529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:39.155440 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33ac87-7cf1-471e-b2a1-826742a48529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:39.159458 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33ac87-7cf1-471e-b2a1-826742a48529 service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:39.183746 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1147/2298] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:30:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:30:39.864548 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4466c9c-b2ac-4892-a586-ca01b88a0a4a None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:39.878575 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-b4466c9c-b2ac-4892-a586-ca01b88a0a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:39.927230 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4466c9c-b2ac-4892-a586-ca01b88a0a4a None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:39.945795 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7035809-9095-4499-a1af-d4ae2405bb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:39.945795 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7035809-9095-4499-a1af-d4ae2405bb52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:39.945795 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7035809-9095-4499-a1af-d4ae2405bb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:39.945795 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7035809-9095-4499-a1af-d4ae2405bb52 admin admin] PATH_INFO: `/v3/projects/2441ce7554bb40609a682abfc9a43930` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:39.948090 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7035809-9095-4499-a1af-d4ae2405bb52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2441ce7554bb40609a682abfc9a43930)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:39.950494 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7035809-9095-4499-a1af-d4ae2405bb52 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:39.965259 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:40.032593 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-c7035809-9095-4499-a1af-d4ae2405bb52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2441ce7554bb40609a682abfc9a43930', 'request_id': 'req-c7035809-9095-4499-a1af-d4ae2405bb52'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:40.047703 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-c7035809-9095-4499-a1af-d4ae2405bb52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2441ce7554bb40609a682abfc9a43930', 'request_id': 'req-c7035809-9095-4499-a1af-d4ae2405bb52'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:40.059364 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-c7035809-9095-4499-a1af-d4ae2405bb52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2441ce7554bb40609a682abfc9a43930', 'request_id': 'req-c7035809-9095-4499-a1af-d4ae2405bb52'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:40.113195 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-c7035809-9095-4499-a1af-d4ae2405bb52 admin admin] The token cache is being invalidate because project 2441ce7554bb40609a682abfc9a43930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:30:40.113959 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-c7035809-9095-4499-a1af-d4ae2405bb52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:40.115180 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-c7035809-9095-4499-a1af-d4ae2405bb52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:40.120823 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1152/2299] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:30:39 2022] DELETE /identity/v3/projects/2441ce7554bb40609a682abfc9a43930 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:30:40.131637 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ec21a-da0d-4940-86d1-e6ac5e5be3f5 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:40.132395 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ec21a-da0d-4940-86d1-e6ac5e5be3f5 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:40.132395 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ec21a-da0d-4940-86d1-e6ac5e5be3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:40.164912 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-f29ec21a-da0d-4940-86d1-e6ac5e5be3f5 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:30:40.167201 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-f29ec21a-da0d-4940-86d1-e6ac5e5be3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:40.292051 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1148/2300] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:30:40.304716 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d8b83-ff8e-4f25-b6d7-fa2e06231383 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:40.305004 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d8b83-ff8e-4f25-b6d7-fa2e06231383 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:40.305285 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d8b83-ff8e-4f25-b6d7-fa2e06231383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:40.353334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-c47d8b83-ff8e-4f25-b6d7-fa2e06231383 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:30:40.356168 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-c47d8b83-ff8e-4f25-b6d7-fa2e06231383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:40.389974 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ec21a-da0d-4940-86d1-e6ac5e5be3f5 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:40.400914 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1153/2301] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:30:40.419210 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ec21a-da0d-4940-86d1-e6ac5e5be3f5 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:40.436924 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae462e-b231-4c08-bc16-b94511c9bd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:40.438438 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae462e-b231-4c08-bc16-b94511c9bd2d admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:40.439379 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae462e-b231-4c08-bc16-b94511c9bd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:40.440774 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae462e-b231-4c08-bc16-b94511c9bd2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:40.443163 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae462e-b231-4c08-bc16-b94511c9bd2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:30:40.443763 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae462e-b231-4c08-bc16-b94511c9bd2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:40.451245 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae462e-b231-4c08-bc16-b94511c9bd2d admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:40.488476 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1149/2302] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:30:40.507233 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d8b83-ff8e-4f25-b6d7-fa2e06231383 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:40.528428 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d8b83-ff8e-4f25-b6d7-fa2e06231383 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:40.541809 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482aa99c-4719-47d1-9945-e9b3b35982f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:40.541809 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482aa99c-4719-47d1-9945-e9b3b35982f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:40.541809 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482aa99c-4719-47d1-9945-e9b3b35982f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:40.541809 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482aa99c-4719-47d1-9945-e9b3b35982f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:40.542534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482aa99c-4719-47d1-9945-e9b3b35982f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:40.551604 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482aa99c-4719-47d1-9945-e9b3b35982f7 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:40.664661 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1154/2303] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:30:40 2022] POST /identity/v3/projects => generated 371 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:30:40.673974 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae462e-b231-4c08-bc16-b94511c9bd2d admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:40.714879 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae462e-b231-4c08-bc16-b94511c9bd2d admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:40.871078 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23361888-4738-4a55-bb58-f83708ab62c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:40.871742 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23361888-4738-4a55-bb58-f83708ab62c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:40.872032 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23361888-4738-4a55-bb58-f83708ab62c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:40.872318 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23361888-4738-4a55-bb58-f83708ab62c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:40.872993 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23361888-4738-4a55-bb58-f83708ab62c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:40.875122 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23361888-4738-4a55-bb58-f83708ab62c2 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:40.926179 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1150/2304] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:30:40 2022] POST /identity/v3/users => generated 286 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:30:40.929588 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482aa99c-4719-47d1-9945-e9b3b35982f7 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:40.953602 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482aa99c-4719-47d1-9945-e9b3b35982f7 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:40.968404 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506030dd-733f-45d1-b6b0-c0c7ed1ce6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:40.971238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506030dd-733f-45d1-b6b0-c0c7ed1ce6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:40.972166 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506030dd-733f-45d1-b6b0-c0c7ed1ce6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:40.972884 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506030dd-733f-45d1-b6b0-c0c7ed1ce6f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:40.974125 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506030dd-733f-45d1-b6b0-c0c7ed1ce6f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:40.976971 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506030dd-733f-45d1-b6b0-c0c7ed1ce6f7 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:40.997220 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1155/2305] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:30:41.002929 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23361888-4738-4a55-bb58-f83708ab62c2 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:41.014007 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:41.027545 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23361888-4738-4a55-bb58-f83708ab62c2 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:41.046888 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b93186-9860-4eb2-a1fb-37b71b5347ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:41.048137 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b93186-9860-4eb2-a1fb-37b71b5347ae admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:41.048847 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b93186-9860-4eb2-a1fb-37b71b5347ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:41.051472 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b93186-9860-4eb2-a1fb-37b71b5347ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:41.052450 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b93186-9860-4eb2-a1fb-37b71b5347ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:41.058280 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b93186-9860-4eb2-a1fb-37b71b5347ae admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:41.086186 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1151/2306] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:30:41.093237 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506030dd-733f-45d1-b6b0-c0c7ed1ce6f7 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:41.114901 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506030dd-733f-45d1-b6b0-c0c7ed1ce6f7 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:41.126603 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960482a-0d19-442b-89cc-82b368bc91c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:41.128027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960482a-0d19-442b-89cc-82b368bc91c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:41.128679 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960482a-0d19-442b-89cc-82b368bc91c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:41.129189 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960482a-0d19-442b-89cc-82b368bc91c1 admin admin] PATH_INFO: `/v3/projects/3a827c4255f142be96a0e0f26f7316be/users/37f4b18e5bd24c6c92ecfe33760c5fdb/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:41.162246 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960482a-0d19-442b-89cc-82b368bc91c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a827c4255f142be96a0e0f26f7316be, user_id=37f4b18e5bd24c6c92ecfe33760c5fdb, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:41.165883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960482a-0d19-442b-89cc-82b368bc91c1 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:41.187631 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1156/2307] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:30:41 2022] PUT /identity/v3/projects/3a827c4255f142be96a0e0f26f7316be/users/37f4b18e5bd24c6c92ecfe33760c5fdb/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:30:41.195619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f673250-d847-45cb-b50f-e3e787311d99 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:41.196754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f673250-d847-45cb-b50f-e3e787311d99 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:41.197425 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f673250-d847-45cb-b50f-e3e787311d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:41.222985 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-6f673250-d847-45cb-b50f-e3e787311d99 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:30:41.224969 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-6f673250-d847-45cb-b50f-e3e787311d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:41.394128 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1152/2308] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:30:41.410815 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960482a-0d19-442b-89cc-82b368bc91c1 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:41.415832 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-9960482a-0d19-442b-89cc-82b368bc91c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:41.577273 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960482a-0d19-442b-89cc-82b368bc91c1 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:41.582716 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9a4b4-19bc-4841-acf5-86215c1c2be7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:41.583449 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9a4b4-19bc-4841-acf5-86215c1c2be7 service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:41.583734 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9a4b4-19bc-4841-acf5-86215c1c2be7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:41.584144 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9a4b4-19bc-4841-acf5-86215c1c2be7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:41.608144 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9a4b4-19bc-4841-acf5-86215c1c2be7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:41.610496 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9a4b4-19bc-4841-acf5-86215c1c2be7 service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:41.628772 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1157/2309] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:30:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:30:46.028821 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f673250-d847-45cb-b50f-e3e787311d99 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:46.031210 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-6f673250-d847-45cb-b50f-e3e787311d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:46.074954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f673250-d847-45cb-b50f-e3e787311d99 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:46.098734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78c19f-db78-411c-a59f-c06461cfa65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:46.100062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78c19f-db78-411c-a59f-c06461cfa65c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:46.100348 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78c19f-db78-411c-a59f-c06461cfa65c admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:46.100797 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78c19f-db78-411c-a59f-c06461cfa65c admin admin] PATH_INFO: `/v3/users/7618f81ca9444c399b7a39d6223eb8c2` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:46.103755 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78c19f-db78-411c-a59f-c06461cfa65c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7618f81ca9444c399b7a39d6223eb8c2)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:46.109524 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78c19f-db78-411c-a59f-c06461cfa65c admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:46.279266 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-dd78c19f-db78-411c-a59f-c06461cfa65c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7618f81ca9444c399b7a39d6223eb8c2'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:46.280474 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-dd78c19f-db78-411c-a59f-c06461cfa65c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7618f81ca9444c399b7a39d6223eb8c2'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:46.302353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-dd78c19f-db78-411c-a59f-c06461cfa65c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7618f81ca9444c399b7a39d6223eb8c2'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:46.340951 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-dd78c19f-db78-411c-a59f-c06461cfa65c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7618f81ca9444c399b7a39d6223eb8c2'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:46.393145 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-dd78c19f-db78-411c-a59f-c06461cfa65c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7618f81ca9444c399b7a39d6223eb8c2'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:46.408731 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1153/2310] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:30:46 2022] DELETE /identity/v3/users/7618f81ca9444c399b7a39d6223eb8c2 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:30:46.416925 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c7363-6c4b-43c5-8ec6-6247b65af5d6 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:46.417851 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c7363-6c4b-43c5-8ec6-6247b65af5d6 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:46.418401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c7363-6c4b-43c5-8ec6-6247b65af5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:46.457667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-cc6c7363-6c4b-43c5-8ec6-6247b65af5d6 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:30:46.460452 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-cc6c7363-6c4b-43c5-8ec6-6247b65af5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:46.536060 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:46.636865 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1158/2311] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:30:46.649879 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78c19f-db78-411c-a59f-c06461cfa65c admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:46.653575 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-dd78c19f-db78-411c-a59f-c06461cfa65c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:46.787434 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78c19f-db78-411c-a59f-c06461cfa65c admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:46.796242 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e4fea-ffd9-4780-8026-abae6c1b3ff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:46.797355 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e4fea-ffd9-4780-8026-abae6c1b3ff5 service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:46.797892 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e4fea-ffd9-4780-8026-abae6c1b3ff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:46.798342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e4fea-ffd9-4780-8026-abae6c1b3ff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:46.822843 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e4fea-ffd9-4780-8026-abae6c1b3ff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:46.825878 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e4fea-ffd9-4780-8026-abae6c1b3ff5 service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:46.848304 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1154/2312] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:30:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:30:47.476168 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c7363-6c4b-43c5-8ec6-6247b65af5d6 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:47.479820 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-cc6c7363-6c4b-43c5-8ec6-6247b65af5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:47.506722 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c7363-6c4b-43c5-8ec6-6247b65af5d6 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:47.516434 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a97601-ca65-46ee-87f5-e42ab8e53c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:47.517593 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a97601-ca65-46ee-87f5-e42ab8e53c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:47.518116 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a97601-ca65-46ee-87f5-e42ab8e53c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:47.518586 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a97601-ca65-46ee-87f5-e42ab8e53c05 admin admin] PATH_INFO: `/v3/projects/f49ae05c6aa84e8f882b628e58d6c152` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:47.521435 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a97601-ca65-46ee-87f5-e42ab8e53c05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f49ae05c6aa84e8f882b628e58d6c152)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:47.529223 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a97601-ca65-46ee-87f5-e42ab8e53c05 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:47.629482 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-02a97601-ca65-46ee-87f5-e42ab8e53c05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f49ae05c6aa84e8f882b628e58d6c152', 'request_id': 'req-02a97601-ca65-46ee-87f5-e42ab8e53c05'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:47.646048 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-02a97601-ca65-46ee-87f5-e42ab8e53c05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f49ae05c6aa84e8f882b628e58d6c152', 'request_id': 'req-02a97601-ca65-46ee-87f5-e42ab8e53c05'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:47.661261 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-02a97601-ca65-46ee-87f5-e42ab8e53c05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f49ae05c6aa84e8f882b628e58d6c152', 'request_id': 'req-02a97601-ca65-46ee-87f5-e42ab8e53c05'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:47.688175 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-02a97601-ca65-46ee-87f5-e42ab8e53c05 admin admin] The token cache is being invalidate because project f49ae05c6aa84e8f882b628e58d6c152 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:30:47.688813 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-02a97601-ca65-46ee-87f5-e42ab8e53c05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:47.690161 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-02a97601-ca65-46ee-87f5-e42ab8e53c05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:47.693544 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1159/2313] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:30:47 2022] DELETE /identity/v3/projects/f49ae05c6aa84e8f882b628e58d6c152 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:30:47.701641 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f8d5a-9773-4452-b751-4ccf0e1a3547 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:47.703209 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f8d5a-9773-4452-b751-4ccf0e1a3547 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:47.703485 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f8d5a-9773-4452-b751-4ccf0e1a3547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:47.725307 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:47.734001 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-4c7f8d5a-9773-4452-b751-4ccf0e1a3547 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:30:47.735434 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-4c7f8d5a-9773-4452-b751-4ccf0e1a3547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:47.849978 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1155/2314] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:30:47.859873 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa44f1-9ccc-4ca0-9068-60a1b3384592 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:47.860330 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa44f1-9ccc-4ca0-9068-60a1b3384592 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:47.860605 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa44f1-9ccc-4ca0-9068-60a1b3384592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:47.891820 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-81aa44f1-9ccc-4ca0-9068-60a1b3384592 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:30:47.894053 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-81aa44f1-9ccc-4ca0-9068-60a1b3384592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:47.906620 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1160/2315] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:30:47.911719 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f8d5a-9773-4452-b751-4ccf0e1a3547 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:47.948370 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f8d5a-9773-4452-b751-4ccf0e1a3547 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:47.957691 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4150ea-a367-40ac-8d50-1cfc64505d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:47.958956 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4150ea-a367-40ac-8d50-1cfc64505d9b admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:47.959525 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4150ea-a367-40ac-8d50-1cfc64505d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:47.960688 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4150ea-a367-40ac-8d50-1cfc64505d9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:47.962275 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4150ea-a367-40ac-8d50-1cfc64505d9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:30:47.963516 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4150ea-a367-40ac-8d50-1cfc64505d9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:47.969922 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4150ea-a367-40ac-8d50-1cfc64505d9b admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:47.999510 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1156/2316] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:30:48.007493 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa44f1-9ccc-4ca0-9068-60a1b3384592 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:48.037247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa44f1-9ccc-4ca0-9068-60a1b3384592 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:48.049773 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a39f25-5a1a-4af7-be3b-c3c969b4c6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:48.052325 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a39f25-5a1a-4af7-be3b-c3c969b4c6f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:48.053675 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a39f25-5a1a-4af7-be3b-c3c969b4c6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:48.054162 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a39f25-5a1a-4af7-be3b-c3c969b4c6f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:48.055208 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a39f25-5a1a-4af7-be3b-c3c969b4c6f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:48.058522 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a39f25-5a1a-4af7-be3b-c3c969b4c6f9 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:48.128896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1161/2317] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:30:48 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:30:48.135058 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4150ea-a367-40ac-8d50-1cfc64505d9b admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:48.150190 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4150ea-a367-40ac-8d50-1cfc64505d9b admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:48.300594 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d48657-774c-40a0-9da3-c329da2114ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:48.302413 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d48657-774c-40a0-9da3-c329da2114ce admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:48.303406 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d48657-774c-40a0-9da3-c329da2114ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:48.303605 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d48657-774c-40a0-9da3-c329da2114ce admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:48.304868 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d48657-774c-40a0-9da3-c329da2114ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:48.310758 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d48657-774c-40a0-9da3-c329da2114ce admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:48.365494 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1157/2318] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:30:48 2022] POST /identity/v3/users => generated 288 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:30:48.370666 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a39f25-5a1a-4af7-be3b-c3c969b4c6f9 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:48.392486 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a39f25-5a1a-4af7-be3b-c3c969b4c6f9 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:48.403627 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848920c-e159-4768-bac9-9cc2981f37fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:48.405336 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848920c-e159-4768-bac9-9cc2981f37fd admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:48.406267 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848920c-e159-4768-bac9-9cc2981f37fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:48.406802 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848920c-e159-4768-bac9-9cc2981f37fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:48.407997 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848920c-e159-4768-bac9-9cc2981f37fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:48.411465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848920c-e159-4768-bac9-9cc2981f37fd admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:48.434978 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1162/2319] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:30:48.441709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d48657-774c-40a0-9da3-c329da2114ce admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:48.459704 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d48657-774c-40a0-9da3-c329da2114ce admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:48.471296 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2dcc6c-c260-4711-87d3-ae161c60b4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:48.471753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2dcc6c-c260-4711-87d3-ae161c60b4ed admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:48.472355 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2dcc6c-c260-4711-87d3-ae161c60b4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:48.472798 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2dcc6c-c260-4711-87d3-ae161c60b4ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:48.473880 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2dcc6c-c260-4711-87d3-ae161c60b4ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:48.476543 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2dcc6c-c260-4711-87d3-ae161c60b4ed admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:48.511687 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848920c-e159-4768-bac9-9cc2981f37fd admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:48.520483 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1158/2320] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:30:48.534464 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848920c-e159-4768-bac9-9cc2981f37fd admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:48.545825 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de7f05-d876-4d06-9d46-720c5f4f13c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:48.546993 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de7f05-d876-4d06-9d46-720c5f4f13c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:48.547742 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de7f05-d876-4d06-9d46-720c5f4f13c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:48.548435 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de7f05-d876-4d06-9d46-720c5f4f13c1 admin admin] PATH_INFO: `/v3/projects/6badb823c81a4d3cb34c92717b9a76f1/users/cd6e19ee3f2c4176a5b1d11bc3d79a26/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:48.581190 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de7f05-d876-4d06-9d46-720c5f4f13c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6badb823c81a4d3cb34c92717b9a76f1, user_id=cd6e19ee3f2c4176a5b1d11bc3d79a26, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:48.591076 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de7f05-d876-4d06-9d46-720c5f4f13c1 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:48.619272 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1163/2321] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:30:48 2022] PUT /identity/v3/projects/6badb823c81a4d3cb34c92717b9a76f1/users/cd6e19ee3f2c4176a5b1d11bc3d79a26/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:30:48.642510 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c13f3f-48a4-41a0-895e-e7c123fcf222 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:48.642795 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c13f3f-48a4-41a0-895e-e7c123fcf222 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:48.643132 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c13f3f-48a4-41a0-895e-e7c123fcf222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:48.720675 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-08c13f3f-48a4-41a0-895e-e7c123fcf222 None None] MFA Rules not processed for user `cd6e19ee3f2c4176a5b1d11bc3d79a26`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:30:48.723378 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-08c13f3f-48a4-41a0-895e-e7c123fcf222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:48.924802 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1159/2322] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:30:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:30:48.947133 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de7f05-d876-4d06-9d46-720c5f4f13c1 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:48.951298 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-44de7f05-d876-4d06-9d46-720c5f4f13c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:49.106906 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de7f05-d876-4d06-9d46-720c5f4f13c1 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:49.113839 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d10ccd-8406-4087-a175-238fd1a7f39c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:49.114736 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d10ccd-8406-4087-a175-238fd1a7f39c service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:49.115218 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d10ccd-8406-4087-a175-238fd1a7f39c service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:49.115699 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d10ccd-8406-4087-a175-238fd1a7f39c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:49.135212 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:49.145258 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d10ccd-8406-4087-a175-238fd1a7f39c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:49.149867 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d10ccd-8406-4087-a175-238fd1a7f39c service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:49.171982 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1164/2323] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:30:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:30:50.306725 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c86f1-1957-407f-b252-c67e67ddf75d None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:50.307538 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c86f1-1957-407f-b252-c67e67ddf75d None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:50.307538 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c86f1-1957-407f-b252-c67e67ddf75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:50.316101 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:50.353264 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-740c86f1-1957-407f-b252-c67e67ddf75d None None] MFA Rules not processed for user `37f4b18e5bd24c6c92ecfe33760c5fdb`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:30:50.355151 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-740c86f1-1957-407f-b252-c67e67ddf75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:50.497435 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1160/2324] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:30:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:30:50.503437 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d10ccd-8406-4087-a175-238fd1a7f39c service cinder] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:50.506305 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-24d10ccd-8406-4087-a175-238fd1a7f39c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:50.660485 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d10ccd-8406-4087-a175-238fd1a7f39c service cinder] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:50.667726 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44bedf-d845-4030-b309-da794d6e2188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:50.669079 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44bedf-d845-4030-b309-da794d6e2188 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:50.669653 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44bedf-d845-4030-b309-da794d6e2188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:50.670159 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44bedf-d845-4030-b309-da794d6e2188 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:50.670955 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44bedf-d845-4030-b309-da794d6e2188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:50.673920 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44bedf-d845-4030-b309-da794d6e2188 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:50.715493 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1165/2325] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:30:50 2022] POST /identity/v3/projects => generated 371 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:30:50.720737 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c86f1-1957-407f-b252-c67e67ddf75d None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:50.735061 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c86f1-1957-407f-b252-c67e67ddf75d None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:50.820410 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64e957-0d09-40bb-8ea3-025089826043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:50.821793 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64e957-0d09-40bb-8ea3-025089826043 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:50.822171 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64e957-0d09-40bb-8ea3-025089826043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:50.822592 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64e957-0d09-40bb-8ea3-025089826043 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:50.823551 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64e957-0d09-40bb-8ea3-025089826043 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:50.825966 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64e957-0d09-40bb-8ea3-025089826043 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:50.864236 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1161/2326] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:30:50 2022] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:30:50.866349 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44bedf-d845-4030-b309-da794d6e2188 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:50.891668 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44bedf-d845-4030-b309-da794d6e2188 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:50.914396 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638abcb-d12e-4944-b2d1-cd4eb06283b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:50.916201 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638abcb-d12e-4944-b2d1-cd4eb06283b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:50.916657 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638abcb-d12e-4944-b2d1-cd4eb06283b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:50.917084 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638abcb-d12e-4944-b2d1-cd4eb06283b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:50.918769 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638abcb-d12e-4944-b2d1-cd4eb06283b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:50.922077 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638abcb-d12e-4944-b2d1-cd4eb06283b8 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:50.941337 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1166/2327] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:30:50.948145 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64e957-0d09-40bb-8ea3-025089826043 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:50.966713 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64e957-0d09-40bb-8ea3-025089826043 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:50.974043 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c5dea-4bda-4734-94e1-2ceb8cde5b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:50.975105 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c5dea-4bda-4734-94e1-2ceb8cde5b34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:50.975498 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c5dea-4bda-4734-94e1-2ceb8cde5b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:50.975896 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c5dea-4bda-4734-94e1-2ceb8cde5b34 admin admin] PATH_INFO: `/v3/projects/212179c02fe943fca18cb5d24e58c0da/users/889201cdae5c466fac848670296f4789/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:51.010730 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c5dea-4bda-4734-94e1-2ceb8cde5b34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=212179c02fe943fca18cb5d24e58c0da, user_id=889201cdae5c466fac848670296f4789, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:51.016792 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c5dea-4bda-4734-94e1-2ceb8cde5b34 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:51.042707 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1162/2328] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:30:50 2022] PUT /identity/v3/projects/212179c02fe943fca18cb5d24e58c0da/users/889201cdae5c466fac848670296f4789/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:30:51.051464 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638abcb-d12e-4944-b2d1-cd4eb06283b8 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:51.070122 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638abcb-d12e-4944-b2d1-cd4eb06283b8 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:51.197911 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c01b19-ccde-4dda-b72c-3169ea2e5d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:51.198915 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c01b19-ccde-4dda-b72c-3169ea2e5d08 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:51.199328 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c01b19-ccde-4dda-b72c-3169ea2e5d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:51.199764 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c01b19-ccde-4dda-b72c-3169ea2e5d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:51.200988 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c01b19-ccde-4dda-b72c-3169ea2e5d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:51.204335 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c01b19-ccde-4dda-b72c-3169ea2e5d08 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:51.229472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1167/2329] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:30:51.231545 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c5dea-4bda-4734-94e1-2ceb8cde5b34 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:51.249342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c5dea-4bda-4734-94e1-2ceb8cde5b34 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:51.266548 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccec9aa-3bf0-4f50-97fa-69298cb96afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:51.267643 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccec9aa-3bf0-4f50-97fa-69298cb96afa admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:51.267996 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccec9aa-3bf0-4f50-97fa-69298cb96afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:51.268512 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccec9aa-3bf0-4f50-97fa-69298cb96afa admin admin] PATH_INFO: `/v3/projects/212179c02fe943fca18cb5d24e58c0da/users/889201cdae5c466fac848670296f4789/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:51.271773 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccec9aa-3bf0-4f50-97fa-69298cb96afa admin admin] RBAC: Authorizing `identity:create_grant(project_id=212179c02fe943fca18cb5d24e58c0da, user_id=889201cdae5c466fac848670296f4789, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:51.277608 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccec9aa-3bf0-4f50-97fa-69298cb96afa admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:51.296570 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1163/2330] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:30:51 2022] PUT /identity/v3/projects/212179c02fe943fca18cb5d24e58c0da/users/889201cdae5c466fac848670296f4789/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:31:00.527606 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac4dcb-4877-44bf-ae65-7241d61a5b6f None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:00.528257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac4dcb-4877-44bf-ae65-7241d61a5b6f None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:00.528257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac4dcb-4877-44bf-ae65-7241d61a5b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:00.576590 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-81ac4dcb-4877-44bf-ae65-7241d61a5b6f None None] MFA Rules not processed for user `889201cdae5c466fac848670296f4789`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:31:00.578001 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-81ac4dcb-4877-44bf-ae65-7241d61a5b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:00.672789 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:00.717769 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1168/2331] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:31:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:31:00.746662 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccec9aa-3bf0-4f50-97fa-69298cb96afa admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:00.748982 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-bccec9aa-3bf0-4f50-97fa-69298cb96afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:00.845492 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:00.940715 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccec9aa-3bf0-4f50-97fa-69298cb96afa admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:00.951197 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bdd2f-c30c-4c81-ad4e-d5ee7a4c573d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:00.951997 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bdd2f-c30c-4c81-ad4e-d5ee7a4c573d service nova] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:00.952280 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bdd2f-c30c-4c81-ad4e-d5ee7a4c573d service nova] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:00.952553 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bdd2f-c30c-4c81-ad4e-d5ee7a4c573d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:01.067631 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6bdd2f-c30c-4c81-ad4e-d5ee7a4c573d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:01.069639 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6bdd2f-c30c-4c81-ad4e-d5ee7a4c573d service nova] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:01.087177 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1164/2332] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:31:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:31:02.875626 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0afcb-0b9a-493f-b5c2-f79cd1098595 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:02.876421 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0afcb-0b9a-493f-b5c2-f79cd1098595 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:02.876421 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0afcb-0b9a-493f-b5c2-f79cd1098595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:02.905667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-adc0afcb-0b9a-493f-b5c2-f79cd1098595 None None] MFA Rules not processed for user `37f4b18e5bd24c6c92ecfe33760c5fdb`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:31:02.906916 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-adc0afcb-0b9a-493f-b5c2-f79cd1098595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:02.915051 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1169/2333] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:31:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:31:03.597768 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bdd2f-c30c-4c81-ad4e-d5ee7a4c573d service nova] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:03.854654 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bdd2f-c30c-4c81-ad4e-d5ee7a4c573d service nova] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:03.861327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214753c9-e756-45d5-8b43-fb76d20f6896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:03.862525 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214753c9-e756-45d5-8b43-fb76d20f6896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:03.862929 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214753c9-e756-45d5-8b43-fb76d20f6896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:03.863366 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214753c9-e756-45d5-8b43-fb76d20f6896 admin admin] PATH_INFO: `/v3/users/cd6e19ee3f2c4176a5b1d11bc3d79a26` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:03.865126 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214753c9-e756-45d5-8b43-fb76d20f6896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd6e19ee3f2c4176a5b1d11bc3d79a26)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:03.869544 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214753c9-e756-45d5-8b43-fb76d20f6896 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:03.964064 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-214753c9-e756-45d5-8b43-fb76d20f6896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd6e19ee3f2c4176a5b1d11bc3d79a26'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:03.964798 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-214753c9-e756-45d5-8b43-fb76d20f6896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd6e19ee3f2c4176a5b1d11bc3d79a26'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:03.975240 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-214753c9-e756-45d5-8b43-fb76d20f6896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd6e19ee3f2c4176a5b1d11bc3d79a26'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:03.987206 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-214753c9-e756-45d5-8b43-fb76d20f6896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd6e19ee3f2c4176a5b1d11bc3d79a26'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:04.004572 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-214753c9-e756-45d5-8b43-fb76d20f6896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd6e19ee3f2c4176a5b1d11bc3d79a26'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:04.008765 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:04.017422 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1165/2334] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:31:03 2022] DELETE /identity/v3/users/cd6e19ee3f2c4176a5b1d11bc3d79a26 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:31:04.025396 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbe3cc-386a-4909-b5f8-8ebdbe3cc277 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:04.026011 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbe3cc-386a-4909-b5f8-8ebdbe3cc277 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:04.026722 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbe3cc-386a-4909-b5f8-8ebdbe3cc277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:04.065403 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-3cfbe3cc-386a-4909-b5f8-8ebdbe3cc277 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:31:04.068451 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-3cfbe3cc-386a-4909-b5f8-8ebdbe3cc277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:04.202198 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1170/2335] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:31:04.223847 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214753c9-e756-45d5-8b43-fb76d20f6896 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:04.226660 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-214753c9-e756-45d5-8b43-fb76d20f6896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:04.397557 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214753c9-e756-45d5-8b43-fb76d20f6896 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:04.404869 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed1a33-3a04-4d47-a5fd-948e754feebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:04.405723 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed1a33-3a04-4d47-a5fd-948e754feebc service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:04.406852 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed1a33-3a04-4d47-a5fd-948e754feebc service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:04.406852 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed1a33-3a04-4d47-a5fd-948e754feebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:04.427883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed1a33-3a04-4d47-a5fd-948e754feebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:04.429617 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed1a33-3a04-4d47-a5fd-948e754feebc service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:04.459273 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1166/2336] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:31:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:31:05.087400 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbe3cc-386a-4909-b5f8-8ebdbe3cc277 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:05.090044 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-3cfbe3cc-386a-4909-b5f8-8ebdbe3cc277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:05.118348 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbe3cc-386a-4909-b5f8-8ebdbe3cc277 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:05.127898 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1afd8-239c-4ae8-a59a-62b9e3b537c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:05.129031 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1afd8-239c-4ae8-a59a-62b9e3b537c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:05.130211 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1afd8-239c-4ae8-a59a-62b9e3b537c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:05.130741 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1afd8-239c-4ae8-a59a-62b9e3b537c0 admin admin] PATH_INFO: `/v3/projects/6badb823c81a4d3cb34c92717b9a76f1` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:05.135027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea1afd8-239c-4ae8-a59a-62b9e3b537c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6badb823c81a4d3cb34c92717b9a76f1)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:05.138996 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea1afd8-239c-4ae8-a59a-62b9e3b537c0 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:05.247255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-cea1afd8-239c-4ae8-a59a-62b9e3b537c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6badb823c81a4d3cb34c92717b9a76f1', 'request_id': 'req-cea1afd8-239c-4ae8-a59a-62b9e3b537c0'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:05.262062 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-cea1afd8-239c-4ae8-a59a-62b9e3b537c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6badb823c81a4d3cb34c92717b9a76f1', 'request_id': 'req-cea1afd8-239c-4ae8-a59a-62b9e3b537c0'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:05.276614 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-cea1afd8-239c-4ae8-a59a-62b9e3b537c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6badb823c81a4d3cb34c92717b9a76f1', 'request_id': 'req-cea1afd8-239c-4ae8-a59a-62b9e3b537c0'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:05.302107 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-cea1afd8-239c-4ae8-a59a-62b9e3b537c0 admin admin] The token cache is being invalidate because project 6badb823c81a4d3cb34c92717b9a76f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:31:05.302107 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-cea1afd8-239c-4ae8-a59a-62b9e3b537c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:05.302107 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-cea1afd8-239c-4ae8-a59a-62b9e3b537c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:05.303361 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1171/2337] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:31:05 2022] DELETE /identity/v3/projects/6badb823c81a4d3cb34c92717b9a76f1 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:31:14.443437 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=26 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:15.292485 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=61,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:16.658316 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78138b-1a80-4112-b5bb-3fbdfd1c25ca None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:16.659153 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78138b-1a80-4112-b5bb-3fbdfd1c25ca None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:16.659153 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78138b-1a80-4112-b5bb-3fbdfd1c25ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:16.686661 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-7e78138b-1a80-4112-b5bb-3fbdfd1c25ca None None] MFA Rules not processed for user `02e415eb75984daa97ee79fc0146f318`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:31:16.687928 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-7e78138b-1a80-4112-b5bb-3fbdfd1c25ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:16.791134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1167/2338] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Aug 23 22:31:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:31:16.876576 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1afd8-239c-4ae8-a59a-62b9e3b537c0 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:16.878736 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-cea1afd8-239c-4ae8-a59a-62b9e3b537c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:16.992681 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1afd8-239c-4ae8-a59a-62b9e3b537c0 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:16.999817 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04186a-be35-414a-b23b-db6200826a99 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abda1f23a18c4c808483cd6b53952975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:17.000541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04186a-be35-414a-b23b-db6200826a99 service swift] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:17.001000 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04186a-be35-414a-b23b-db6200826a99 service swift] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:17.001528 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04186a-be35-414a-b23b-db6200826a99 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:17.017726 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f04186a-be35-414a-b23b-db6200826a99 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:17.020922 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f04186a-be35-414a-b23b-db6200826a99 service swift] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:17.039483 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1172/2339] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Aug 23 22:31:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 22:31:22.833840 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78138b-1a80-4112-b5bb-3fbdfd1c25ca None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:22.836648 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-7e78138b-1a80-4112-b5bb-3fbdfd1c25ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:23.083778 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78138b-1a80-4112-b5bb-3fbdfd1c25ca None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:23.092763 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef3d9f-af25-4031-8964-6ca8aeaf71f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2000b80e34ae45d2a8b658cd394419f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:23.093463 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef3d9f-af25-4031-8964-6ca8aeaf71f0 service placement] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:23.093741 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef3d9f-af25-4031-8964-6ca8aeaf71f0 service placement] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:23.093995 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef3d9f-af25-4031-8964-6ca8aeaf71f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:23.095902 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-eeef3d9f-af25-4031-8964-6ca8aeaf71f0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:23.116463 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef3d9f-af25-4031-8964-6ca8aeaf71f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:23.118390 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef3d9f-af25-4031-8964-6ca8aeaf71f0 service placement] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:23.144829 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1168/2340] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:31:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:31:27.031379 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=32 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:33.126198 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=57 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:37.142899 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b202d1-2377-484b-a410-99f1febd208c None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:37.143570 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b202d1-2377-484b-a410-99f1febd208c None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:37.143570 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b202d1-2377-484b-a410-99f1febd208c None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:37.145616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1173/2341] 10.222.0.77 () {54 vars in 921 bytes} [Tue Aug 23 22:31:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:31:37.154401 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8dfe8-047b-4704-af66-a04bf71d098b None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:37.155043 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8dfe8-047b-4704-af66-a04bf71d098b None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:37.155043 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8dfe8-047b-4704-af66-a04bf71d098b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:37.180999 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-b0c8dfe8-047b-4704-af66-a04bf71d098b None None] MFA Rules not processed for user `1a0af5bf009b48a8915c7320b16d08dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:31:37.182973 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-b0c8dfe8-047b-4704-af66-a04bf71d098b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:37.311789 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1169/2342] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Aug 23 22:31:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:31:37.343162 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b202d1-2377-484b-a410-99f1febd208c None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:37.346863 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-44b202d1-2377-484b-a410-99f1febd208c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:37.509047 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b202d1-2377-484b-a410-99f1febd208c None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:37.513893 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7d178-78da-4ba9-a3e8-c959f6dca794 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '855cbc7a992d4c6697632d2d4d74abfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:37.514680 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7d178-78da-4ba9-a3e8-c959f6dca794 service glance] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:37.514962 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7d178-78da-4ba9-a3e8-c959f6dca794 service glance] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:37.515338 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7d178-78da-4ba9-a3e8-c959f6dca794 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:37.546209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7d178-78da-4ba9-a3e8-c959f6dca794 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:37.548230 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7d178-78da-4ba9-a3e8-c959f6dca794 service glance] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:37.564297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1174/2343] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:31:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:31:37.708382 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad10ef-aa10-41a8-827f-cd159c3cbc1c None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:37.709785 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad10ef-aa10-41a8-827f-cd159c3cbc1c None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:37.710549 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad10ef-aa10-41a8-827f-cd159c3cbc1c None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:37.714929 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1170/2344] 10.222.0.77 () {54 vars in 921 bytes} [Tue Aug 23 22:31:37 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:31:37.729726 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155ad8f-3d33-47c4-b0bc-4225e913de5b None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:37.732270 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155ad8f-3d33-47c4-b0bc-4225e913de5b None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:37.732857 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155ad8f-3d33-47c4-b0bc-4225e913de5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:37.782102 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-0155ad8f-3d33-47c4-b0bc-4225e913de5b None None] MFA Rules not processed for user `84ea6fbc3de84b7db9e62b9ee6055c52`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:31:37.784935 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-0155ad8f-3d33-47c4-b0bc-4225e913de5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:37.908029 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1175/2345] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Aug 23 22:31:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:31:37.926702 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad10ef-aa10-41a8-827f-cd159c3cbc1c None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:37.928956 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-baad10ef-aa10-41a8-827f-cd159c3cbc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:37.950786 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad10ef-aa10-41a8-827f-cd159c3cbc1c None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:37.955250 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248dedf6-3ff9-417b-bfd7-1f8c4fa90dc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:37.955923 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248dedf6-3ff9-417b-bfd7-1f8c4fa90dc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:37.956303 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248dedf6-3ff9-417b-bfd7-1f8c4fa90dc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:37.956722 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248dedf6-3ff9-417b-bfd7-1f8c4fa90dc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:37.981542 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248dedf6-3ff9-417b-bfd7-1f8c4fa90dc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:37.981542 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248dedf6-3ff9-417b-bfd7-1f8c4fa90dc4 service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:37.990463 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1171/2346] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:31:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:31:38.134216 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87936689-d4d8-4979-937a-87f7f00ff022 None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:38.134655 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87936689-d4d8-4979-937a-87f7f00ff022 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:38.134838 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87936689-d4d8-4979-937a-87f7f00ff022 None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:38.137025 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1176/2347] 10.222.0.77 () {54 vars in 921 bytes} [Tue Aug 23 22:31:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:31:38.145797 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afbb02-5767-48d4-976e-15dbd198b8d8 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:38.146107 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afbb02-5767-48d4-976e-15dbd198b8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:38.146665 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afbb02-5767-48d4-976e-15dbd198b8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:38.178993 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-36afbb02-5767-48d4-976e-15dbd198b8d8 None None] MFA Rules not processed for user `1a0af5bf009b48a8915c7320b16d08dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:31:38.180831 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-36afbb02-5767-48d4-976e-15dbd198b8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:38.244149 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87936689-d4d8-4979-937a-87f7f00ff022 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:38.256982 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1172/2348] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Aug 23 22:31:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:31:38.270689 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87936689-d4d8-4979-937a-87f7f00ff022 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:38.281974 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1c891-650f-4152-9593-64a19a5892ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:38.286900 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1c891-650f-4152-9593-64a19a5892ba service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:38.288138 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1c891-650f-4152-9593-64a19a5892ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:38.288725 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1c891-650f-4152-9593-64a19a5892ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:38.319207 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1c891-650f-4152-9593-64a19a5892ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:38.321793 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1c891-650f-4152-9593-64a19a5892ba service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:38.336519 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1177/2349] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:31:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:31:43.463011 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36afbb02-5767-48d4-976e-15dbd198b8d8 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:43.480336 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36afbb02-5767-48d4-976e-15dbd198b8d8 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:43.486973 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee5754-de33-4d0b-9c42-f323f3f83ba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:43.488144 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee5754-de33-4d0b-9c42-f323f3f83ba4 service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:43.488718 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee5754-de33-4d0b-9c42-f323f3f83ba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:43.489284 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee5754-de33-4d0b-9c42-f323f3f83ba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:43.492760 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-10ee5754-de33-4d0b-9c42-f323f3f83ba4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:43.607724 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee5754-de33-4d0b-9c42-f323f3f83ba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:43.608955 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee5754-de33-4d0b-9c42-f323f3f83ba4 service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:43.622026 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1173/2350] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:31:43 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:31:44.570548 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be255a2b-8c8b-47b4-8497-1497fbc47783 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:44.571145 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be255a2b-8c8b-47b4-8497-1497fbc47783 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:44.571145 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be255a2b-8c8b-47b4-8497-1497fbc47783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:44.600880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-be255a2b-8c8b-47b4-8497-1497fbc47783 None None] MFA Rules not processed for user `02e415eb75984daa97ee79fc0146f318`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:31:44.602343 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-be255a2b-8c8b-47b4-8497-1497fbc47783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:44.611804 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1178/2351] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Aug 23 22:31:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:31:44.630507 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee5754-de33-4d0b-9c42-f323f3f83ba4 service neutron] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:44.644335 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee5754-de33-4d0b-9c42-f323f3f83ba4 service neutron] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:44.654043 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a3cb0-8fad-4f16-b2e6-f408ac643ec6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abda1f23a18c4c808483cd6b53952975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:44.656648 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a3cb0-8fad-4f16-b2e6-f408ac643ec6 service swift] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:44.657512 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a3cb0-8fad-4f16-b2e6-f408ac643ec6 service swift] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:44.658232 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a3cb0-8fad-4f16-b2e6-f408ac643ec6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:44.677983 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a3cb0-8fad-4f16-b2e6-f408ac643ec6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:44.680076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a3cb0-8fad-4f16-b2e6-f408ac643ec6 service swift] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:44.691471 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1174/2352] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Aug 23 22:31:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 22:31:49.267182 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d9f8b-7135-4b73-9aba-e85b5a61de55 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:49.267810 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d9f8b-7135-4b73-9aba-e85b5a61de55 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:49.267913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d9f8b-7135-4b73-9aba-e85b5a61de55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:49.299789 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-a28d9f8b-7135-4b73-9aba-e85b5a61de55 None None] MFA Rules not processed for user `18c3a4375ded41c89c877077ceb4f46d`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:31:49.301576 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-a28d9f8b-7135-4b73-9aba-e85b5a61de55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:49.444592 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1179/2353] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:31:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:31:54.686802 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=76 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:59.431794 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=83 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:00.336453 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fbef8-3fa4-49e1-ac73-138c461e66fd None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:00.337592 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fbef8-3fa4-49e1-ac73-138c461e66fd None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:00.338000 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fbef8-3fa4-49e1-ac73-138c461e66fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:00.387200 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-795fbef8-3fa4-49e1-ac73-138c461e66fd None None] MFA Rules not processed for user `035cc211744f457f9fe65bd7d0e6bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:32:00.391417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-795fbef8-3fa4-49e1-ac73-138c461e66fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:00.553101 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1175/2354] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:32:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:32:03.851480 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad9093-19a7-4621-8cd5-2ae04c8565ee None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:03.852353 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad9093-19a7-4621-8cd5-2ae04c8565ee None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:03.852353 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad9093-19a7-4621-8cd5-2ae04c8565ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:03.888967 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-84ad9093-19a7-4621-8cd5-2ae04c8565ee None None] MFA Rules not processed for user `02e415eb75984daa97ee79fc0146f318`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:32:03.891949 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-84ad9093-19a7-4621-8cd5-2ae04c8565ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:03.908000 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1180/2355] 10.222.0.77 () {58 vars in 967 bytes} [Tue Aug 23 22:32:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:32:03.936038 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795fbef8-3fa4-49e1-ac73-138c461e66fd None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:03.956884 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795fbef8-3fa4-49e1-ac73-138c461e66fd None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:03.966801 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee3c38-40af-4015-bf2d-a9302dd64568 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abda1f23a18c4c808483cd6b53952975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:03.967767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee3c38-40af-4015-bf2d-a9302dd64568 service swift] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:03.968446 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee3c38-40af-4015-bf2d-a9302dd64568 service swift] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:03.968893 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee3c38-40af-4015-bf2d-a9302dd64568 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:03.987669 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee3c38-40af-4015-bf2d-a9302dd64568 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:03.991522 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee3c38-40af-4015-bf2d-a9302dd64568 service swift] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:04.008418 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1176/2356] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Aug 23 22:32:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 22:32:13.876237 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:14.000874 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=31 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:30.427469 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed8722-631f-4350-aff8-9c08a3125f91 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:30.428067 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed8722-631f-4350-aff8-9c08a3125f91 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:30.428586 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed8722-631f-4350-aff8-9c08a3125f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:30.448992 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-98ed8722-631f-4350-aff8-9c08a3125f91 None None] MFA Rules not processed for user `388f72ff05784e6bae5ca4f085d7c55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:32:30.450305 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-98ed8722-631f-4350-aff8-9c08a3125f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:30.512497 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1181/2357] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:32:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:32:40.505028 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=25 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:42.970471 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee3c38-40af-4015-bf2d-a9302dd64568 service swift] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:42.983070 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee3c38-40af-4015-bf2d-a9302dd64568 service swift] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:42.987741 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f1991-9f9c-480d-8c7e-90bdd3dcb0b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:42.988420 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f1991-9f9c-480d-8c7e-90bdd3dcb0b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:42.989275 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f1991-9f9c-480d-8c7e-90bdd3dcb0b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:42.989712 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f1991-9f9c-480d-8c7e-90bdd3dcb0b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:42.991985 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-328f1991-9f9c-480d-8c7e-90bdd3dcb0b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:43.010737 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f1991-9f9c-480d-8c7e-90bdd3dcb0b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:43.012192 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f1991-9f9c-480d-8c7e-90bdd3dcb0b7 service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:43.029875 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1177/2358] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:32:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:32:49.488184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed8722-631f-4350-aff8-9c08a3125f91 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:49.490534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-98ed8722-631f-4350-aff8-9c08a3125f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:49.557774 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed8722-631f-4350-aff8-9c08a3125f91 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:49.561727 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a22d7c-2b67-46a8-ad47-0bb68439a1bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:49.562277 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a22d7c-2b67-46a8-ad47-0bb68439a1bc service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:49.562556 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a22d7c-2b67-46a8-ad47-0bb68439a1bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:49.562832 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a22d7c-2b67-46a8-ad47-0bb68439a1bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:49.564920 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-a9a22d7c-2b67-46a8-ad47-0bb68439a1bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:49.582149 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a22d7c-2b67-46a8-ad47-0bb68439a1bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:49.585875 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a22d7c-2b67-46a8-ad47-0bb68439a1bc service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:49.599469 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1182/2359] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:32:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:32:53.023553 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=6 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:59.593566 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=26 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:01.374716 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba87ec-9400-4a58-8986-3e1e9d46f981 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:01.375312 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba87ec-9400-4a58-8986-3e1e9d46f981 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:01.375583 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba87ec-9400-4a58-8986-3e1e9d46f981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:01.421518 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-93ba87ec-9400-4a58-8986-3e1e9d46f981 None None] MFA Rules not processed for user `c4aa1c394e8445adbb4bf668ce056a38`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:01.423400 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-93ba87ec-9400-4a58-8986-3e1e9d46f981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:01.512551 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1178/2360] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:33:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:06.468468 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a22d7c-2b67-46a8-ad47-0bb68439a1bc service cinder] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:06.471061 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-a9a22d7c-2b67-46a8-ad47-0bb68439a1bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:06.496047 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a22d7c-2b67-46a8-ad47-0bb68439a1bc service cinder] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:06.502993 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e956e86-1964-4041-b550-6f842abba29b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:06.504461 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e956e86-1964-4041-b550-6f842abba29b service nova] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:06.504874 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e956e86-1964-4041-b550-6f842abba29b service nova] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:06.505291 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e956e86-1964-4041-b550-6f842abba29b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:06.507668 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-2e956e86-1964-4041-b550-6f842abba29b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:06.527085 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e956e86-1964-4041-b550-6f842abba29b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:06.528831 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e956e86-1964-4041-b550-6f842abba29b service nova] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:06.540559 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1183/2361] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:33:11.426845 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3401d82-35f0-482a-96b6-0f7a1af7cef7 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:11.428912 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3401d82-35f0-482a-96b6-0f7a1af7cef7 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:11.428912 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3401d82-35f0-482a-96b6-0f7a1af7cef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:11.449093 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-a3401d82-35f0-482a-96b6-0f7a1af7cef7 None None] MFA Rules not processed for user `18c3a4375ded41c89c877077ceb4f46d`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:11.450357 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-a3401d82-35f0-482a-96b6-0f7a1af7cef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:11.457495 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1179/2362] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:33:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:11.827639 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e956e86-1964-4041-b550-6f842abba29b service nova] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:11.830430 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-2e956e86-1964-4041-b550-6f842abba29b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:11.845742 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e956e86-1964-4041-b550-6f842abba29b service nova] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:11.851643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f07ba4-27f2-416d-8e34-5cce2870dd9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:11.852244 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f07ba4-27f2-416d-8e34-5cce2870dd9f service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:11.852522 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f07ba4-27f2-416d-8e34-5cce2870dd9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:11.852820 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f07ba4-27f2-416d-8e34-5cce2870dd9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:11.854586 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-81f07ba4-27f2-416d-8e34-5cce2870dd9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:11.865272 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f07ba4-27f2-416d-8e34-5cce2870dd9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:11.866943 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f07ba4-27f2-416d-8e34-5cce2870dd9f service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:11.876650 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1184/2363] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:33:12.027919 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3401d82-35f0-482a-96b6-0f7a1af7cef7 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:12.029467 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-a3401d82-35f0-482a-96b6-0f7a1af7cef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:12.050876 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3401d82-35f0-482a-96b6-0f7a1af7cef7 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:12.057558 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805f562-8110-4785-8b4b-a2da2ba814bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:12.058429 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805f562-8110-4785-8b4b-a2da2ba814bd service nova] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:12.058702 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805f562-8110-4785-8b4b-a2da2ba814bd service nova] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:12.059035 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805f562-8110-4785-8b4b-a2da2ba814bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:12.062963 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-7805f562-8110-4785-8b4b-a2da2ba814bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:12.080915 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7805f562-8110-4785-8b4b-a2da2ba814bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:12.083452 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7805f562-8110-4785-8b4b-a2da2ba814bd service nova] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:12.095512 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1180/2364] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:12 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:33:15.906926 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f07ba4-27f2-416d-8e34-5cce2870dd9f service neutron] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:15.918218 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f07ba4-27f2-416d-8e34-5cce2870dd9f service neutron] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:15.924259 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14051647-fa13-44f3-b1ce-93dc0c196a55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:15.925729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14051647-fa13-44f3-b1ce-93dc0c196a55 service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:15.926058 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14051647-fa13-44f3-b1ce-93dc0c196a55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:15.926345 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14051647-fa13-44f3-b1ce-93dc0c196a55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:15.928755 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-14051647-fa13-44f3-b1ce-93dc0c196a55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:16.040612 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14051647-fa13-44f3-b1ce-93dc0c196a55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:16.042778 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14051647-fa13-44f3-b1ce-93dc0c196a55 service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:16.062360 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1185/2365] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:33:20.669909 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805f562-8110-4785-8b4b-a2da2ba814bd service nova] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:20.688495 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805f562-8110-4785-8b4b-a2da2ba814bd service nova] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:20.697746 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3c6f8-0b10-4fed-bbad-4f82bd390850 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:20.698992 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3c6f8-0b10-4fed-bbad-4f82bd390850 service nova] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:20.699724 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3c6f8-0b10-4fed-bbad-4f82bd390850 service nova] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:20.700057 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3c6f8-0b10-4fed-bbad-4f82bd390850 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:20.704463 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-8ba3c6f8-0b10-4fed-bbad-4f82bd390850 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:20.718498 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3c6f8-0b10-4fed-bbad-4f82bd390850 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:20.720786 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3c6f8-0b10-4fed-bbad-4f82bd390850 service nova] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:20.739249 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1181/2366] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:33:21.897269 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14051647-fa13-44f3-b1ce-93dc0c196a55 service neutron] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:21.915460 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14051647-fa13-44f3-b1ce-93dc0c196a55 service neutron] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:21.922967 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a96f22-368e-4aba-b634-22124e5ceb4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2000b80e34ae45d2a8b658cd394419f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:21.923680 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a96f22-368e-4aba-b634-22124e5ceb4c service placement] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:21.924019 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a96f22-368e-4aba-b634-22124e5ceb4c service placement] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:21.925053 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a96f22-368e-4aba-b634-22124e5ceb4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:21.927326 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-e8a96f22-368e-4aba-b634-22124e5ceb4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:21.949166 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a96f22-368e-4aba-b634-22124e5ceb4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:21.953271 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a96f22-368e-4aba-b634-22124e5ceb4c service placement] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:21.976216 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1186/2367] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:33:21.989357 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3c6f8-0b10-4fed-bbad-4f82bd390850 service nova] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:21.992058 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-8ba3c6f8-0b10-4fed-bbad-4f82bd390850 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:22.028921 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3c6f8-0b10-4fed-bbad-4f82bd390850 service nova] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:22.035276 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5385099-de1a-47cf-bee7-6be4c403c2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:22.036243 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5385099-de1a-47cf-bee7-6be4c403c2ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:22.036571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5385099-de1a-47cf-bee7-6be4c403c2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:22.036844 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5385099-de1a-47cf-bee7-6be4c403c2ff admin admin] PATH_INFO: `/v3/users/035cc211744f457f9fe65bd7d0e6bb79` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:22.038327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5385099-de1a-47cf-bee7-6be4c403c2ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=035cc211744f457f9fe65bd7d0e6bb79)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:22.040585 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5385099-de1a-47cf-bee7-6be4c403c2ff admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:22.121671 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-a5385099-de1a-47cf-bee7-6be4c403c2ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '035cc211744f457f9fe65bd7d0e6bb79'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:22.122456 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-a5385099-de1a-47cf-bee7-6be4c403c2ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '035cc211744f457f9fe65bd7d0e6bb79'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:22.134497 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-a5385099-de1a-47cf-bee7-6be4c403c2ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '035cc211744f457f9fe65bd7d0e6bb79'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:22.145600 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-a5385099-de1a-47cf-bee7-6be4c403c2ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '035cc211744f457f9fe65bd7d0e6bb79'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:22.178448 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-a5385099-de1a-47cf-bee7-6be4c403c2ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '035cc211744f457f9fe65bd7d0e6bb79'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:22.192297 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1182/2368] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:33:21 2022] DELETE /identity/v3/users/035cc211744f457f9fe65bd7d0e6bb79 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:33:22.684515 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a96f22-368e-4aba-b634-22124e5ceb4c service placement] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:22.709680 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a96f22-368e-4aba-b634-22124e5ceb4c service placement] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:22.861210 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f6181-62b8-44f0-bfa2-d568c61e8e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:22.864288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f6181-62b8-44f0-bfa2-d568c61e8e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:22.864797 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f6181-62b8-44f0-bfa2-d568c61e8e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:22.865297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f6181-62b8-44f0-bfa2-d568c61e8e58 admin admin] PATH_INFO: `/v3/projects/079a1eed97ef4e6187c9f285d409149f` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:22.871380 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f6181-62b8-44f0-bfa2-d568c61e8e58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=079a1eed97ef4e6187c9f285d409149f)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:22.878600 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f6181-62b8-44f0-bfa2-d568c61e8e58 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:22.992231 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-337f6181-62b8-44f0-bfa2-d568c61e8e58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '079a1eed97ef4e6187c9f285d409149f', 'request_id': 'req-337f6181-62b8-44f0-bfa2-d568c61e8e58'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:23.004308 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-337f6181-62b8-44f0-bfa2-d568c61e8e58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '079a1eed97ef4e6187c9f285d409149f', 'request_id': 'req-337f6181-62b8-44f0-bfa2-d568c61e8e58'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:23.008661 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:23.021038 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-337f6181-62b8-44f0-bfa2-d568c61e8e58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '079a1eed97ef4e6187c9f285d409149f', 'request_id': 'req-337f6181-62b8-44f0-bfa2-d568c61e8e58'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:23.045358 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-337f6181-62b8-44f0-bfa2-d568c61e8e58 admin admin] The token cache is being invalidate because project 079a1eed97ef4e6187c9f285d409149f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:33:23.045628 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-337f6181-62b8-44f0-bfa2-d568c61e8e58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:23.046817 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-337f6181-62b8-44f0-bfa2-d568c61e8e58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:23.048962 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1187/2369] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:33:22 2022] DELETE /identity/v3/projects/079a1eed97ef4e6187c9f285d409149f => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:33:23.055866 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe370f0-51bb-4323-a8fe-7284a11808cd None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:23.056588 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe370f0-51bb-4323-a8fe-7284a11808cd None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:23.056588 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe370f0-51bb-4323-a8fe-7284a11808cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:23.073677 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=70,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:23.110377 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-7fe370f0-51bb-4323-a8fe-7284a11808cd None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:23.114459 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-7fe370f0-51bb-4323-a8fe-7284a11808cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:23.265705 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1183/2370] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:23.287132 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506030c-8129-4798-8545-2969b16ebbfc None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:23.287132 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506030c-8129-4798-8545-2969b16ebbfc None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:23.287132 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506030c-8129-4798-8545-2969b16ebbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:23.316700 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-2506030c-8129-4798-8545-2969b16ebbfc None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:23.318403 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-2506030c-8129-4798-8545-2969b16ebbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:23.331996 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1188/2371] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:23.336001 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe370f0-51bb-4323-a8fe-7284a11808cd None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:23.351295 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe370f0-51bb-4323-a8fe-7284a11808cd None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:23.372313 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab61080-5eb4-47cf-8d82-717112e8c93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:23.373429 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab61080-5eb4-47cf-8d82-717112e8c93b admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:23.373940 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab61080-5eb4-47cf-8d82-717112e8c93b admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:23.374467 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab61080-5eb4-47cf-8d82-717112e8c93b admin admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:23.375757 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab61080-5eb4-47cf-8d82-717112e8c93b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:33:23.376293 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab61080-5eb4-47cf-8d82-717112e8c93b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:23.380458 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab61080-5eb4-47cf-8d82-717112e8c93b admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:23.408305 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1184/2372] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:33:23.419761 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506030c-8129-4798-8545-2969b16ebbfc None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:23.433110 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506030c-8129-4798-8545-2969b16ebbfc None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:23.439416 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114a320-974a-4dce-9770-5cc48e118b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:23.440915 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114a320-974a-4dce-9770-5cc48e118b61 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:23.441987 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114a320-974a-4dce-9770-5cc48e118b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:23.441987 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114a320-974a-4dce-9770-5cc48e118b61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:23.445119 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114a320-974a-4dce-9770-5cc48e118b61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:23.445119 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114a320-974a-4dce-9770-5cc48e118b61 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:23.480952 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1189/2373] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:33:23 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:33:23.486194 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab61080-5eb4-47cf-8d82-717112e8c93b admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:23.500177 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab61080-5eb4-47cf-8d82-717112e8c93b admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:23.584543 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e78a55-58e5-440e-b684-dd0bdc210552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:23.585084 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e78a55-58e5-440e-b684-dd0bdc210552 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:23.585392 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e78a55-58e5-440e-b684-dd0bdc210552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:23.585671 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e78a55-58e5-440e-b684-dd0bdc210552 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:23.586326 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e78a55-58e5-440e-b684-dd0bdc210552 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:23.588324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e78a55-58e5-440e-b684-dd0bdc210552 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:23.621209 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1185/2374] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:33:23 2022] POST /identity/v3/users => generated 286 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:33:23.626599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114a320-974a-4dce-9770-5cc48e118b61 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:23.645696 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114a320-974a-4dce-9770-5cc48e118b61 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:23.650809 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361aa16-18a5-4700-9113-b94e6768b05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:23.651436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361aa16-18a5-4700-9113-b94e6768b05d admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:23.651715 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361aa16-18a5-4700-9113-b94e6768b05d admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:23.651985 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361aa16-18a5-4700-9113-b94e6768b05d admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:23.652652 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361aa16-18a5-4700-9113-b94e6768b05d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:23.654588 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361aa16-18a5-4700-9113-b94e6768b05d admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:23.682641 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1190/2375] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:33:23.687068 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e78a55-58e5-440e-b684-dd0bdc210552 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:23.699424 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e78a55-58e5-440e-b684-dd0bdc210552 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:23.707713 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822b132-f7a2-480b-b270-533037b8b502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:23.708647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822b132-f7a2-480b-b270-533037b8b502 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:23.709064 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822b132-f7a2-480b-b270-533037b8b502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:23.709571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822b132-f7a2-480b-b270-533037b8b502 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:23.710633 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822b132-f7a2-480b-b270-533037b8b502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:23.712990 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822b132-f7a2-480b-b270-533037b8b502 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:23.732155 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1186/2376] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:33:23.738566 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361aa16-18a5-4700-9113-b94e6768b05d admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:23.750495 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361aa16-18a5-4700-9113-b94e6768b05d admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:23.757740 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b4431-5801-45f2-a0a9-a3b2cec95765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:23.758866 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b4431-5801-45f2-a0a9-a3b2cec95765 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:23.759362 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b4431-5801-45f2-a0a9-a3b2cec95765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:23.759787 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b4431-5801-45f2-a0a9-a3b2cec95765 admin admin] PATH_INFO: `/v3/projects/5f3438a54f164c47bf40ffb723d6920b/users/03d289fd8bbd444eb197f3a3c7c034b1/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:23.791820 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b4431-5801-45f2-a0a9-a3b2cec95765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f3438a54f164c47bf40ffb723d6920b, user_id=03d289fd8bbd444eb197f3a3c7c034b1, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:23.794666 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b4431-5801-45f2-a0a9-a3b2cec95765 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:23.829976 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1191/2377] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:33:23 2022] PUT /identity/v3/projects/5f3438a54f164c47bf40ffb723d6920b/users/03d289fd8bbd444eb197f3a3c7c034b1/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:33:23.857040 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92384ce-41de-44f8-a704-e64a10fe1bbf None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:23.857515 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92384ce-41de-44f8-a704-e64a10fe1bbf None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:23.857515 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92384ce-41de-44f8-a704-e64a10fe1bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:23.905748 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-f92384ce-41de-44f8-a704-e64a10fe1bbf None None] MFA Rules not processed for user `03d289fd8bbd444eb197f3a3c7c034b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:23.907674 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-f92384ce-41de-44f8-a704-e64a10fe1bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:23.992267 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:24.009579 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1187/2378] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:33:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:24.019068 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b4431-5801-45f2-a0a9-a3b2cec95765 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:24.021599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-bf8b4431-5801-45f2-a0a9-a3b2cec95765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:24.137228 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b4431-5801-45f2-a0a9-a3b2cec95765 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:24.148579 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e8183-d56c-4316-ad67-7c019f5c7820 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:24.149311 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e8183-d56c-4316-ad67-7c019f5c7820 service nova] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:24.149631 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e8183-d56c-4316-ad67-7c019f5c7820 service nova] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:24.149905 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e8183-d56c-4316-ad67-7c019f5c7820 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:24.159950 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e8183-d56c-4316-ad67-7c019f5c7820 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:24.161651 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e8183-d56c-4316-ad67-7c019f5c7820 service nova] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:24.177473 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1192/2379] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:33:27.824568 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92384ce-41de-44f8-a704-e64a10fe1bbf None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:27.945036 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92384ce-41de-44f8-a704-e64a10fe1bbf None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:27.950811 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a979e-215d-4526-9122-6051cc7144e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:27.951988 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a979e-215d-4526-9122-6051cc7144e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:27.952448 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a979e-215d-4526-9122-6051cc7144e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:27.952860 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a979e-215d-4526-9122-6051cc7144e4 admin admin] PATH_INFO: `/v3/users/03d289fd8bbd444eb197f3a3c7c034b1` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:27.954047 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a979e-215d-4526-9122-6051cc7144e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03d289fd8bbd444eb197f3a3c7c034b1)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:27.957415 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a979e-215d-4526-9122-6051cc7144e4 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:28.048158 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-af2a979e-215d-4526-9122-6051cc7144e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03d289fd8bbd444eb197f3a3c7c034b1'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:28.049967 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-af2a979e-215d-4526-9122-6051cc7144e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03d289fd8bbd444eb197f3a3c7c034b1'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:28.063865 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-af2a979e-215d-4526-9122-6051cc7144e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03d289fd8bbd444eb197f3a3c7c034b1'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:28.074023 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-af2a979e-215d-4526-9122-6051cc7144e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03d289fd8bbd444eb197f3a3c7c034b1'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:28.097586 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-af2a979e-215d-4526-9122-6051cc7144e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03d289fd8bbd444eb197f3a3c7c034b1'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:28.109852 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1188/2380] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:33:27 2022] DELETE /identity/v3/users/03d289fd8bbd444eb197f3a3c7c034b1 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:33:28.115978 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e9236-c3f7-4618-bbe6-ed7680f5dc49 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:28.116565 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e9236-c3f7-4618-bbe6-ed7680f5dc49 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:28.116931 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e9236-c3f7-4618-bbe6-ed7680f5dc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:28.150384 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-cc9e9236-c3f7-4618-bbe6-ed7680f5dc49 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:28.151735 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-cc9e9236-c3f7-4618-bbe6-ed7680f5dc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:28.264265 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1193/2381] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:28.278094 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a979e-215d-4526-9122-6051cc7144e4 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:28.279791 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-af2a979e-215d-4526-9122-6051cc7144e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:28.386616 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a979e-215d-4526-9122-6051cc7144e4 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:28.391428 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d8b14-eeed-404d-a825-e37b4e3b05c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:28.392093 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d8b14-eeed-404d-a825-e37b4e3b05c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:28.394057 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d8b14-eeed-404d-a825-e37b4e3b05c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:28.394057 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d8b14-eeed-404d-a825-e37b4e3b05c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:28.406001 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d8b14-eeed-404d-a825-e37b4e3b05c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:28.408285 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d8b14-eeed-404d-a825-e37b4e3b05c9 service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:28.422655 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1189/2382] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:33:29.038781 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e9236-c3f7-4618-bbe6-ed7680f5dc49 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:29.040242 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-cc9e9236-c3f7-4618-bbe6-ed7680f5dc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:29.059035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e9236-c3f7-4618-bbe6-ed7680f5dc49 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:29.064498 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992ed07-5719-4d47-aac7-96d189a10cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:29.065276 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992ed07-5719-4d47-aac7-96d189a10cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:29.065580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992ed07-5719-4d47-aac7-96d189a10cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:29.065853 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992ed07-5719-4d47-aac7-96d189a10cbd admin admin] PATH_INFO: `/v3/projects/5f3438a54f164c47bf40ffb723d6920b` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:29.067021 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992ed07-5719-4d47-aac7-96d189a10cbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f3438a54f164c47bf40ffb723d6920b)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:29.068969 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992ed07-5719-4d47-aac7-96d189a10cbd admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:29.070684 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:29.134191 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-8992ed07-5719-4d47-aac7-96d189a10cbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f3438a54f164c47bf40ffb723d6920b', 'request_id': 'req-8992ed07-5719-4d47-aac7-96d189a10cbd'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:29.140624 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-8992ed07-5719-4d47-aac7-96d189a10cbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f3438a54f164c47bf40ffb723d6920b', 'request_id': 'req-8992ed07-5719-4d47-aac7-96d189a10cbd'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:29.150558 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-8992ed07-5719-4d47-aac7-96d189a10cbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f3438a54f164c47bf40ffb723d6920b', 'request_id': 'req-8992ed07-5719-4d47-aac7-96d189a10cbd'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:29.162453 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-8992ed07-5719-4d47-aac7-96d189a10cbd admin admin] The token cache is being invalidate because project 5f3438a54f164c47bf40ffb723d6920b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:33:29.162745 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-8992ed07-5719-4d47-aac7-96d189a10cbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:29.163654 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-8992ed07-5719-4d47-aac7-96d189a10cbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:29.165160 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1194/2383] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:33:29 2022] DELETE /identity/v3/projects/5f3438a54f164c47bf40ffb723d6920b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:33:29.170287 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad0352-10fb-43a5-9af1-b7632f0347ea None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:29.170826 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad0352-10fb-43a5-9af1-b7632f0347ea None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:29.170826 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad0352-10fb-43a5-9af1-b7632f0347ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:29.194702 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-62ad0352-10fb-43a5-9af1-b7632f0347ea None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:29.195902 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-62ad0352-10fb-43a5-9af1-b7632f0347ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:29.210972 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:29.266283 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1190/2384] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:33:29.275450 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347484f-1d34-4a25-81eb-f7677acd4b51 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:29.275791 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347484f-1d34-4a25-81eb-f7677acd4b51 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:29.276139 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347484f-1d34-4a25-81eb-f7677acd4b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:29.298188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-0347484f-1d34-4a25-81eb-f7677acd4b51 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:29.299806 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-0347484f-1d34-4a25-81eb-f7677acd4b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:29.309714 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1195/2385] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:29.314256 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad0352-10fb-43a5-9af1-b7632f0347ea None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:29.329631 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad0352-10fb-43a5-9af1-b7632f0347ea None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:29.341923 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e53d2b-5667-4741-abba-e5ce901d745e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:29.342567 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e53d2b-5667-4741-abba-e5ce901d745e admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:29.342851 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e53d2b-5667-4741-abba-e5ce901d745e admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:29.343126 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e53d2b-5667-4741-abba-e5ce901d745e admin admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:29.343795 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e53d2b-5667-4741-abba-e5ce901d745e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:33:29.344102 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e53d2b-5667-4741-abba-e5ce901d745e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:29.347454 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e53d2b-5667-4741-abba-e5ce901d745e admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:29.364292 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1191/2386] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:33:29.367746 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0347484f-1d34-4a25-81eb-f7677acd4b51 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:29.384075 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0347484f-1d34-4a25-81eb-f7677acd4b51 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:29.389595 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece73625-66f6-445e-a4e5-cedc825facf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:29.390270 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece73625-66f6-445e-a4e5-cedc825facf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:29.390555 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece73625-66f6-445e-a4e5-cedc825facf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:29.390834 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece73625-66f6-445e-a4e5-cedc825facf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:29.391506 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece73625-66f6-445e-a4e5-cedc825facf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:29.394801 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece73625-66f6-445e-a4e5-cedc825facf4 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:29.436554 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1196/2387] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:33:29 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:33:29.440391 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e53d2b-5667-4741-abba-e5ce901d745e admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:29.451922 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e53d2b-5667-4741-abba-e5ce901d745e admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:29.542240 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8a01f-7a45-4326-bb4a-03665bc199e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:29.543048 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8a01f-7a45-4326-bb4a-03665bc199e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:29.543447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8a01f-7a45-4326-bb4a-03665bc199e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:29.543918 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8a01f-7a45-4326-bb4a-03665bc199e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:29.545101 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8a01f-7a45-4326-bb4a-03665bc199e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:29.547399 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8a01f-7a45-4326-bb4a-03665bc199e2 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:29.590287 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1192/2388] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:33:29 2022] POST /identity/v3/users => generated 287 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:33:29.591643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece73625-66f6-445e-a4e5-cedc825facf4 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:29.607672 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece73625-66f6-445e-a4e5-cedc825facf4 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:29.614471 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640ae79-1caa-4f06-80d7-b784ae203676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:29.615028 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640ae79-1caa-4f06-80d7-b784ae203676 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:29.615307 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640ae79-1caa-4f06-80d7-b784ae203676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:29.615583 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640ae79-1caa-4f06-80d7-b784ae203676 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:29.616324 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640ae79-1caa-4f06-80d7-b784ae203676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:29.617975 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640ae79-1caa-4f06-80d7-b784ae203676 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:29.630561 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1197/2389] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:33:29.634978 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8a01f-7a45-4326-bb4a-03665bc199e2 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:29.647660 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8a01f-7a45-4326-bb4a-03665bc199e2 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:29.653730 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c62747-4c3a-4b87-9f3b-59dda5e46721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:29.654601 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c62747-4c3a-4b87-9f3b-59dda5e46721 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:29.654964 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c62747-4c3a-4b87-9f3b-59dda5e46721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:29.655313 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c62747-4c3a-4b87-9f3b-59dda5e46721 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:29.656060 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c62747-4c3a-4b87-9f3b-59dda5e46721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:29.657799 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c62747-4c3a-4b87-9f3b-59dda5e46721 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:29.672981 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1193/2390] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:33:29.678717 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640ae79-1caa-4f06-80d7-b784ae203676 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:29.689624 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640ae79-1caa-4f06-80d7-b784ae203676 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:29.695080 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae4724-418d-4ead-9d35-f0431bcaadc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:29.695866 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae4724-418d-4ead-9d35-f0431bcaadc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:29.696122 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae4724-418d-4ead-9d35-f0431bcaadc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:29.696356 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae4724-418d-4ead-9d35-f0431bcaadc4 admin admin] PATH_INFO: `/v3/projects/a4d0917934fa49ee950c355a8ca79354/users/ddb3d2547dfd4ab29ebf4cd40189b564/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:29.724497 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae4724-418d-4ead-9d35-f0431bcaadc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4d0917934fa49ee950c355a8ca79354, user_id=ddb3d2547dfd4ab29ebf4cd40189b564, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:29.729356 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae4724-418d-4ead-9d35-f0431bcaadc4 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:29.749419 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1198/2391] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:33:29 2022] PUT /identity/v3/projects/a4d0917934fa49ee950c355a8ca79354/users/ddb3d2547dfd4ab29ebf4cd40189b564/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:33:29.759847 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2afa3a-56ad-4199-a216-5d2e85301d95 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:29.760158 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2afa3a-56ad-4199-a216-5d2e85301d95 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:29.760405 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2afa3a-56ad-4199-a216-5d2e85301d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:29.798114 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-cf2afa3a-56ad-4199-a216-5d2e85301d95 None None] MFA Rules not processed for user `ddb3d2547dfd4ab29ebf4cd40189b564`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:29.799484 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-cf2afa3a-56ad-4199-a216-5d2e85301d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:29.916809 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1194/2392] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:33:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:29.928119 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae4724-418d-4ead-9d35-f0431bcaadc4 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:29.929910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-edae4724-418d-4ead-9d35-f0431bcaadc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:30.038380 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae4724-418d-4ead-9d35-f0431bcaadc4 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:30.046169 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed87612-34c7-475d-bfc9-1011bd83da15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:30.048604 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed87612-34c7-475d-bfc9-1011bd83da15 service nova] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:30.049315 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed87612-34c7-475d-bfc9-1011bd83da15 service nova] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:30.049840 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed87612-34c7-475d-bfc9-1011bd83da15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:30.072793 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed87612-34c7-475d-bfc9-1011bd83da15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:30.075492 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed87612-34c7-475d-bfc9-1011bd83da15 service nova] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:30.089645 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1199/2393] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:33:30.411717 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2afa3a-56ad-4199-a216-5d2e85301d95 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:30.439305 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:30.519998 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2afa3a-56ad-4199-a216-5d2e85301d95 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:30.528326 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b484ffc-6fdd-4f87-9a8d-3773e191b335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:30.529677 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b484ffc-6fdd-4f87-9a8d-3773e191b335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:30.530434 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b484ffc-6fdd-4f87-9a8d-3773e191b335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:30.531100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b484ffc-6fdd-4f87-9a8d-3773e191b335 admin admin] PATH_INFO: `/v3/users/ddb3d2547dfd4ab29ebf4cd40189b564` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:30.534343 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b484ffc-6fdd-4f87-9a8d-3773e191b335 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddb3d2547dfd4ab29ebf4cd40189b564)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:30.538395 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b484ffc-6fdd-4f87-9a8d-3773e191b335 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:30.622130 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2b484ffc-6fdd-4f87-9a8d-3773e191b335 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddb3d2547dfd4ab29ebf4cd40189b564'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:30.622832 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2b484ffc-6fdd-4f87-9a8d-3773e191b335 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddb3d2547dfd4ab29ebf4cd40189b564'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:30.645033 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2b484ffc-6fdd-4f87-9a8d-3773e191b335 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddb3d2547dfd4ab29ebf4cd40189b564'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:30.660928 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2b484ffc-6fdd-4f87-9a8d-3773e191b335 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddb3d2547dfd4ab29ebf4cd40189b564'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:30.680013 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2b484ffc-6fdd-4f87-9a8d-3773e191b335 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddb3d2547dfd4ab29ebf4cd40189b564'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:30.690899 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1195/2394] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:33:30 2022] DELETE /identity/v3/users/ddb3d2547dfd4ab29ebf4cd40189b564 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:33:30.692572 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e8f48-3300-42dc-b73c-e557a9830eb3 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:30.693076 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e8f48-3300-42dc-b73c-e557a9830eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:30.693175 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e8f48-3300-42dc-b73c-e557a9830eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:30.721049 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-7e6e8f48-3300-42dc-b73c-e557a9830eb3 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:30.722574 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-7e6e8f48-3300-42dc-b73c-e557a9830eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:30.732401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:30.820962 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1200/2395] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:30.832060 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b484ffc-6fdd-4f87-9a8d-3773e191b335 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:30.834415 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-2b484ffc-6fdd-4f87-9a8d-3773e191b335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:30.909124 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b484ffc-6fdd-4f87-9a8d-3773e191b335 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:30.914749 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df5cd9-51f8-4a15-a758-5598f569dfd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:30.915388 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df5cd9-51f8-4a15-a758-5598f569dfd4 service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:30.915698 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df5cd9-51f8-4a15-a758-5598f569dfd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:30.916046 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df5cd9-51f8-4a15-a758-5598f569dfd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:30.928148 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df5cd9-51f8-4a15-a758-5598f569dfd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:30.929941 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df5cd9-51f8-4a15-a758-5598f569dfd4 service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:30.942865 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1196/2396] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:33:31.285389 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e8f48-3300-42dc-b73c-e557a9830eb3 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:31.286954 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-7e6e8f48-3300-42dc-b73c-e557a9830eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:31.300763 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e8f48-3300-42dc-b73c-e557a9830eb3 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:31.306498 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb34cf-114f-4e37-8b81-bb07c0097d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:31.307173 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb34cf-114f-4e37-8b81-bb07c0097d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:31.307469 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb34cf-114f-4e37-8b81-bb07c0097d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:31.307724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb34cf-114f-4e37-8b81-bb07c0097d0a admin admin] PATH_INFO: `/v3/projects/a4d0917934fa49ee950c355a8ca79354` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:31.308871 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb34cf-114f-4e37-8b81-bb07c0097d0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4d0917934fa49ee950c355a8ca79354)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:31.310853 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb34cf-114f-4e37-8b81-bb07c0097d0a admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:31.359907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-0ecb34cf-114f-4e37-8b81-bb07c0097d0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4d0917934fa49ee950c355a8ca79354', 'request_id': 'req-0ecb34cf-114f-4e37-8b81-bb07c0097d0a'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:31.366494 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-0ecb34cf-114f-4e37-8b81-bb07c0097d0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4d0917934fa49ee950c355a8ca79354', 'request_id': 'req-0ecb34cf-114f-4e37-8b81-bb07c0097d0a'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:31.375078 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-0ecb34cf-114f-4e37-8b81-bb07c0097d0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4d0917934fa49ee950c355a8ca79354', 'request_id': 'req-0ecb34cf-114f-4e37-8b81-bb07c0097d0a'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:31.386800 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-0ecb34cf-114f-4e37-8b81-bb07c0097d0a admin admin] The token cache is being invalidate because project a4d0917934fa49ee950c355a8ca79354 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:33:31.387094 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-0ecb34cf-114f-4e37-8b81-bb07c0097d0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:31.387788 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-0ecb34cf-114f-4e37-8b81-bb07c0097d0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:31.389329 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1201/2397] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:33:31 2022] DELETE /identity/v3/projects/a4d0917934fa49ee950c355a8ca79354 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:33:31.394853 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772025a9-d5b5-444d-8db8-818211578690 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:31.395132 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772025a9-d5b5-444d-8db8-818211578690 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:31.395403 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772025a9-d5b5-444d-8db8-818211578690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:31.417906 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-772025a9-d5b5-444d-8db8-818211578690 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:31.419244 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-772025a9-d5b5-444d-8db8-818211578690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:31.454846 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:31.484292 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1197/2398] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:31.492781 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84909d-4b43-430e-b18e-53c5d5b93073 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:31.493117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84909d-4b43-430e-b18e-53c5d5b93073 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:31.493344 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84909d-4b43-430e-b18e-53c5d5b93073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:31.515778 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-1a84909d-4b43-430e-b18e-53c5d5b93073 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:31.516996 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-1a84909d-4b43-430e-b18e-53c5d5b93073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:31.526014 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1202/2399] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:31.530582 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772025a9-d5b5-444d-8db8-818211578690 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:31.542125 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772025a9-d5b5-444d-8db8-818211578690 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:31.547161 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bf46c-ea0d-41b1-862c-754b06d8254c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:31.547777 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bf46c-ea0d-41b1-862c-754b06d8254c admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:31.548055 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bf46c-ea0d-41b1-862c-754b06d8254c admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:31.548321 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bf46c-ea0d-41b1-862c-754b06d8254c admin admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:31.549008 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0bf46c-ea0d-41b1-862c-754b06d8254c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:33:31.549398 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0bf46c-ea0d-41b1-862c-754b06d8254c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:31.551059 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0bf46c-ea0d-41b1-862c-754b06d8254c admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:31.566176 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1198/2400] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:33:31.570508 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84909d-4b43-430e-b18e-53c5d5b93073 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:31.581039 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84909d-4b43-430e-b18e-53c5d5b93073 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:31.586239 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44a273-4b1e-491e-b321-4d8b16f68970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:31.586826 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44a273-4b1e-491e-b321-4d8b16f68970 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:31.587107 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44a273-4b1e-491e-b321-4d8b16f68970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:31.587385 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44a273-4b1e-491e-b321-4d8b16f68970 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:31.588035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44a273-4b1e-491e-b321-4d8b16f68970 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:31.590434 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44a273-4b1e-491e-b321-4d8b16f68970 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:31.625616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1203/2401] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:33:31 2022] POST /identity/v3/projects => generated 363 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:33:31.627585 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bf46c-ea0d-41b1-862c-754b06d8254c admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:31.638279 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bf46c-ea0d-41b1-862c-754b06d8254c admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:31.718918 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93112186-8c09-4de0-9951-ea2b2753b770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:31.719648 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93112186-8c09-4de0-9951-ea2b2753b770 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:31.719995 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93112186-8c09-4de0-9951-ea2b2753b770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:31.721874 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93112186-8c09-4de0-9951-ea2b2753b770 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:31.722649 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93112186-8c09-4de0-9951-ea2b2753b770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:31.725226 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93112186-8c09-4de0-9951-ea2b2753b770 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:31.755627 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1199/2402] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:33:31 2022] POST /identity/v3/users => generated 282 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:33:31.756921 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44a273-4b1e-491e-b321-4d8b16f68970 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:31.770931 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44a273-4b1e-491e-b321-4d8b16f68970 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:31.776080 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af3e3c-07d5-47cc-9a15-1dc8f454a7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:31.776790 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af3e3c-07d5-47cc-9a15-1dc8f454a7ea admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:31.777068 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af3e3c-07d5-47cc-9a15-1dc8f454a7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:31.777754 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af3e3c-07d5-47cc-9a15-1dc8f454a7ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:31.778833 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af3e3c-07d5-47cc-9a15-1dc8f454a7ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:31.780940 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af3e3c-07d5-47cc-9a15-1dc8f454a7ea admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:31.801442 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1204/2403] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:33:31.804876 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93112186-8c09-4de0-9951-ea2b2753b770 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:31.826940 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93112186-8c09-4de0-9951-ea2b2753b770 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:31.833832 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86a705-f9a6-4237-92f7-2e39616f54f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:31.834112 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86a705-f9a6-4237-92f7-2e39616f54f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:31.834252 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86a705-f9a6-4237-92f7-2e39616f54f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:31.834529 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86a705-f9a6-4237-92f7-2e39616f54f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:31.835383 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86a705-f9a6-4237-92f7-2e39616f54f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:31.836993 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86a705-f9a6-4237-92f7-2e39616f54f7 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:31.849270 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1200/2404] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:33:31.860786 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af3e3c-07d5-47cc-9a15-1dc8f454a7ea admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:31.874079 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af3e3c-07d5-47cc-9a15-1dc8f454a7ea admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:31.882457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef40f50-58c1-4864-a336-0d3cff434a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:31.883963 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef40f50-58c1-4864-a336-0d3cff434a91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:31.884465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef40f50-58c1-4864-a336-0d3cff434a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:31.886064 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef40f50-58c1-4864-a336-0d3cff434a91 admin admin] PATH_INFO: `/v3/projects/c329c2b8dd7f428ab1d1110308528a1d/users/3e925af946024816abc4f703eacc121f/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:31.910890 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef40f50-58c1-4864-a336-0d3cff434a91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c329c2b8dd7f428ab1d1110308528a1d, user_id=3e925af946024816abc4f703eacc121f, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:31.914327 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef40f50-58c1-4864-a336-0d3cff434a91 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:31.932932 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1205/2405] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:33:31 2022] PUT /identity/v3/projects/c329c2b8dd7f428ab1d1110308528a1d/users/3e925af946024816abc4f703eacc121f/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:33:31.947415 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b112272-311c-455a-b58e-78be17ee5327 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:31.947914 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b112272-311c-455a-b58e-78be17ee5327 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:31.948415 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b112272-311c-455a-b58e-78be17ee5327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:31.985117 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-5b112272-311c-455a-b58e-78be17ee5327 None None] MFA Rules not processed for user `3e925af946024816abc4f703eacc121f`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:31.988084 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-5b112272-311c-455a-b58e-78be17ee5327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:32.081497 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1201/2406] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:33:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:32.086682 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef40f50-58c1-4864-a336-0d3cff434a91 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:32.141045 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:32.188849 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef40f50-58c1-4864-a336-0d3cff434a91 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:32.194533 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5030b0-fa8a-4edc-9c3b-6a7d923a7639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:32.195231 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5030b0-fa8a-4edc-9c3b-6a7d923a7639 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:32.195581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5030b0-fa8a-4edc-9c3b-6a7d923a7639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:32.195839 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5030b0-fa8a-4edc-9c3b-6a7d923a7639 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:32.196491 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5030b0-fa8a-4edc-9c3b-6a7d923a7639 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:32.198513 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5030b0-fa8a-4edc-9c3b-6a7d923a7639 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:32.250345 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1206/2407] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:33:32 2022] POST /identity/v3/projects => generated 365 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:33:32.256893 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b112272-311c-455a-b58e-78be17ee5327 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:32.270136 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b112272-311c-455a-b58e-78be17ee5327 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:32.306956 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:32.339848 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977aa7c-8cb6-4fc4-9266-c207cb920d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:32.340576 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977aa7c-8cb6-4fc4-9266-c207cb920d79 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:32.340859 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977aa7c-8cb6-4fc4-9266-c207cb920d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:32.341135 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977aa7c-8cb6-4fc4-9266-c207cb920d79 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:32.341822 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977aa7c-8cb6-4fc4-9266-c207cb920d79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:32.343823 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977aa7c-8cb6-4fc4-9266-c207cb920d79 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:32.368890 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1202/2408] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:33:32 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:33:32.373549 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5030b0-fa8a-4edc-9c3b-6a7d923a7639 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:32.384446 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5030b0-fa8a-4edc-9c3b-6a7d923a7639 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:32.389841 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf100b8-1d65-489b-9fc1-3ff32fba03f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:32.390457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf100b8-1d65-489b-9fc1-3ff32fba03f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:32.390734 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf100b8-1d65-489b-9fc1-3ff32fba03f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:32.391010 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf100b8-1d65-489b-9fc1-3ff32fba03f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:32.391652 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf100b8-1d65-489b-9fc1-3ff32fba03f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:32.393422 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf100b8-1d65-489b-9fc1-3ff32fba03f1 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:32.404918 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1207/2409] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:33:32.410180 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977aa7c-8cb6-4fc4-9266-c207cb920d79 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:32.421060 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977aa7c-8cb6-4fc4-9266-c207cb920d79 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:32.426915 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f867e-fb07-40be-88c1-8b464683fe93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:32.427587 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f867e-fb07-40be-88c1-8b464683fe93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:32.427871 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f867e-fb07-40be-88c1-8b464683fe93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:32.428175 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f867e-fb07-40be-88c1-8b464683fe93 admin admin] PATH_INFO: `/v3/projects/4d5dc3b2d19745d8bd5c356547971d49/users/ade6f2a726fb430883c47d4ac06ff8a0/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:32.444923 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f867e-fb07-40be-88c1-8b464683fe93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d5dc3b2d19745d8bd5c356547971d49, user_id=ade6f2a726fb430883c47d4ac06ff8a0, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:32.447613 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f867e-fb07-40be-88c1-8b464683fe93 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:32.466779 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1203/2410] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:33:32 2022] PUT /identity/v3/projects/4d5dc3b2d19745d8bd5c356547971d49/users/ade6f2a726fb430883c47d4ac06ff8a0/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:33:32.471178 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf100b8-1d65-489b-9fc1-3ff32fba03f1 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:32.482709 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf100b8-1d65-489b-9fc1-3ff32fba03f1 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:32.543638 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335b4d3-6f60-4944-af35-cd10f4a1e4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:32.544272 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335b4d3-6f60-4944-af35-cd10f4a1e4dc admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:32.544550 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335b4d3-6f60-4944-af35-cd10f4a1e4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:32.544821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335b4d3-6f60-4944-af35-cd10f4a1e4dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:32.545495 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335b4d3-6f60-4944-af35-cd10f4a1e4dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:32.547096 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335b4d3-6f60-4944-af35-cd10f4a1e4dc admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:32.558806 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1208/2411] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:33:32.563277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f867e-fb07-40be-88c1-8b464683fe93 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:32.574980 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f867e-fb07-40be-88c1-8b464683fe93 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:32.579924 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f44c3-39f1-46a8-80bf-df0011b2905d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:32.580661 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f44c3-39f1-46a8-80bf-df0011b2905d admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:32.580943 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f44c3-39f1-46a8-80bf-df0011b2905d admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:32.581222 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f44c3-39f1-46a8-80bf-df0011b2905d admin admin] PATH_INFO: `/v3/projects/4d5dc3b2d19745d8bd5c356547971d49/users/ade6f2a726fb430883c47d4ac06ff8a0/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:32.583387 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f44c3-39f1-46a8-80bf-df0011b2905d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d5dc3b2d19745d8bd5c356547971d49, user_id=ade6f2a726fb430883c47d4ac06ff8a0, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:32.586122 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f44c3-39f1-46a8-80bf-df0011b2905d admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:32.598188 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1204/2412] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:33:32 2022] PUT /identity/v3/projects/4d5dc3b2d19745d8bd5c356547971d49/users/ade6f2a726fb430883c47d4ac06ff8a0/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:33:32.608926 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a3cfa-a2b7-4743-bf2d-d2e1f6079a21 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:32.609214 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a3cfa-a2b7-4743-bf2d-d2e1f6079a21 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:32.609552 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a3cfa-a2b7-4743-bf2d-d2e1f6079a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:32.641690 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-ee1a3cfa-a2b7-4743-bf2d-d2e1f6079a21 None None] MFA Rules not processed for user `ade6f2a726fb430883c47d4ac06ff8a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:32.642917 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-ee1a3cfa-a2b7-4743-bf2d-d2e1f6079a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:32.717136 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1209/2413] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:33:32 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:33:32.729918 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f44c3-39f1-46a8-80bf-df0011b2905d admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:32.731697 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-0c3f44c3-39f1-46a8-80bf-df0011b2905d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:32.801604 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f44c3-39f1-46a8-80bf-df0011b2905d admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:32.805794 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dac853-10fa-48fa-9389-ce5082ca1194 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:32.807072 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dac853-10fa-48fa-9389-ce5082ca1194 service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:32.807636 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dac853-10fa-48fa-9389-ce5082ca1194 service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:32.808111 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dac853-10fa-48fa-9389-ce5082ca1194 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:32.820315 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dac853-10fa-48fa-9389-ce5082ca1194 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:32.822149 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dac853-10fa-48fa-9389-ce5082ca1194 service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:32.836799 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1205/2414] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:32 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:33:32.926526 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a3cfa-a2b7-4743-bf2d-d2e1f6079a21 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:32.938616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a3cfa-a2b7-4743-bf2d-d2e1f6079a21 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:32.944516 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da752af7-8ff6-4e02-bfad-552c5b7e0064 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:32.945241 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da752af7-8ff6-4e02-bfad-552c5b7e0064 service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:32.945615 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da752af7-8ff6-4e02-bfad-552c5b7e0064 service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:32.946107 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da752af7-8ff6-4e02-bfad-552c5b7e0064 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:32.976752 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:33.018948 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da752af7-8ff6-4e02-bfad-552c5b7e0064 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:33.020311 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da752af7-8ff6-4e02-bfad-552c5b7e0064 service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:33.031190 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1210/2415] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:33:35.907836 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dac853-10fa-48fa-9389-ce5082ca1194 service cinder] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:35.979941 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dac853-10fa-48fa-9389-ce5082ca1194 service cinder] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:35.987214 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b546718-473b-4069-85f1-4ace634ad889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:35.987928 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b546718-473b-4069-85f1-4ace634ad889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:35.988272 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b546718-473b-4069-85f1-4ace634ad889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:35.988672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b546718-473b-4069-85f1-4ace634ad889 admin admin] PATH_INFO: `/v3/users/3e925af946024816abc4f703eacc121f` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:35.990068 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b546718-473b-4069-85f1-4ace634ad889 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e925af946024816abc4f703eacc121f)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:35.992867 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b546718-473b-4069-85f1-4ace634ad889 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:36.042923 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:36.071683 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2b546718-473b-4069-85f1-4ace634ad889 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e925af946024816abc4f703eacc121f'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:36.072440 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2b546718-473b-4069-85f1-4ace634ad889 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e925af946024816abc4f703eacc121f'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:36.085000 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2b546718-473b-4069-85f1-4ace634ad889 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e925af946024816abc4f703eacc121f'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:36.101115 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2b546718-473b-4069-85f1-4ace634ad889 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e925af946024816abc4f703eacc121f'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:36.116070 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2b546718-473b-4069-85f1-4ace634ad889 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e925af946024816abc4f703eacc121f'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:36.125861 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1206/2416] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:33:35 2022] DELETE /identity/v3/users/3e925af946024816abc4f703eacc121f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:33:36.131341 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c61df-813f-401d-aeb0-fe44eedec5e7 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:36.131849 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c61df-813f-401d-aeb0-fe44eedec5e7 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:36.132200 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c61df-813f-401d-aeb0-fe44eedec5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:36.156300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-932c61df-813f-401d-aeb0-fe44eedec5e7 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:36.157715 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-932c61df-813f-401d-aeb0-fe44eedec5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:36.242752 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1211/2417] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:36.257983 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b546718-473b-4069-85f1-4ace634ad889 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:36.259608 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-2b546718-473b-4069-85f1-4ace634ad889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:36.332025 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b546718-473b-4069-85f1-4ace634ad889 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:36.337206 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a8694-4985-406c-9d90-1e155a2658b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:36.337870 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a8694-4985-406c-9d90-1e155a2658b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:36.338146 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a8694-4985-406c-9d90-1e155a2658b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:36.338414 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a8694-4985-406c-9d90-1e155a2658b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:36.348975 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a8694-4985-406c-9d90-1e155a2658b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:36.350526 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a8694-4985-406c-9d90-1e155a2658b9 service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:36.362075 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1207/2418] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:33:36.712887 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c61df-813f-401d-aeb0-fe44eedec5e7 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:36.715523 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-932c61df-813f-401d-aeb0-fe44eedec5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:36.729412 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c61df-813f-401d-aeb0-fe44eedec5e7 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:36.742126 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b28069-a4a2-4bec-9c9c-d50651b5e3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:36.742866 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b28069-a4a2-4bec-9c9c-d50651b5e3ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:36.743280 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b28069-a4a2-4bec-9c9c-d50651b5e3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:36.744674 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b28069-a4a2-4bec-9c9c-d50651b5e3ec admin admin] PATH_INFO: `/v3/projects/c329c2b8dd7f428ab1d1110308528a1d` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:36.746272 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b28069-a4a2-4bec-9c9c-d50651b5e3ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=c329c2b8dd7f428ab1d1110308528a1d)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:36.748358 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b28069-a4a2-4bec-9c9c-d50651b5e3ec admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:36.832577 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-27b28069-a4a2-4bec-9c9c-d50651b5e3ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c329c2b8dd7f428ab1d1110308528a1d', 'request_id': 'req-27b28069-a4a2-4bec-9c9c-d50651b5e3ec'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:36.840768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-27b28069-a4a2-4bec-9c9c-d50651b5e3ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c329c2b8dd7f428ab1d1110308528a1d', 'request_id': 'req-27b28069-a4a2-4bec-9c9c-d50651b5e3ec'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:36.853963 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-27b28069-a4a2-4bec-9c9c-d50651b5e3ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c329c2b8dd7f428ab1d1110308528a1d', 'request_id': 'req-27b28069-a4a2-4bec-9c9c-d50651b5e3ec'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:36.880906 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-27b28069-a4a2-4bec-9c9c-d50651b5e3ec admin admin] The token cache is being invalidate because project c329c2b8dd7f428ab1d1110308528a1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:33:36.880906 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-27b28069-a4a2-4bec-9c9c-d50651b5e3ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:36.882067 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-27b28069-a4a2-4bec-9c9c-d50651b5e3ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:36.884617 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1212/2419] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:33:36 2022] DELETE /identity/v3/projects/c329c2b8dd7f428ab1d1110308528a1d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:33:36.890455 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a8694-4985-406c-9d90-1e155a2658b9 service neutron] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:36.908373 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a8694-4985-406c-9d90-1e155a2658b9 service neutron] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:37.012283 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d15bf3-b9b8-4c8c-80f7-45ac113e59a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:37.014875 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d15bf3-b9b8-4c8c-80f7-45ac113e59a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:37.015925 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d15bf3-b9b8-4c8c-80f7-45ac113e59a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:37.015925 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d15bf3-b9b8-4c8c-80f7-45ac113e59a2 admin admin] PATH_INFO: `/v3/users/ade6f2a726fb430883c47d4ac06ff8a0` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:37.019760 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d15bf3-b9b8-4c8c-80f7-45ac113e59a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ade6f2a726fb430883c47d4ac06ff8a0)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:37.023647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d15bf3-b9b8-4c8c-80f7-45ac113e59a2 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:37.105815 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-46d15bf3-b9b8-4c8c-80f7-45ac113e59a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ade6f2a726fb430883c47d4ac06ff8a0'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:37.106977 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-46d15bf3-b9b8-4c8c-80f7-45ac113e59a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ade6f2a726fb430883c47d4ac06ff8a0'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:37.113622 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:37.126799 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-46d15bf3-b9b8-4c8c-80f7-45ac113e59a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ade6f2a726fb430883c47d4ac06ff8a0'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:37.139095 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-46d15bf3-b9b8-4c8c-80f7-45ac113e59a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ade6f2a726fb430883c47d4ac06ff8a0'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:37.157133 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-46d15bf3-b9b8-4c8c-80f7-45ac113e59a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ade6f2a726fb430883c47d4ac06ff8a0'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:37.167503 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1208/2420] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:33:36 2022] DELETE /identity/v3/users/ade6f2a726fb430883c47d4ac06ff8a0 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:33:37.599866 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b28069-a4a2-4bec-9c9c-d50651b5e3ec admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:37.600973 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-27b28069-a4a2-4bec-9c9c-d50651b5e3ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:37.617314 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b28069-a4a2-4bec-9c9c-d50651b5e3ec admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:37.695507 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:37.715192 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056bb552-e15c-4429-8ab1-f5f8456a0943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:37.715906 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bb552-e15c-4429-8ab1-f5f8456a0943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:37.716409 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bb552-e15c-4429-8ab1-f5f8456a0943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:37.716712 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bb552-e15c-4429-8ab1-f5f8456a0943 admin admin] PATH_INFO: `/v3/projects/4d5dc3b2d19745d8bd5c356547971d49` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:37.718038 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056bb552-e15c-4429-8ab1-f5f8456a0943 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d5dc3b2d19745d8bd5c356547971d49)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:37.720044 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056bb552-e15c-4429-8ab1-f5f8456a0943 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:37.785875 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-056bb552-e15c-4429-8ab1-f5f8456a0943 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d5dc3b2d19745d8bd5c356547971d49', 'request_id': 'req-056bb552-e15c-4429-8ab1-f5f8456a0943'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:37.797411 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-056bb552-e15c-4429-8ab1-f5f8456a0943 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d5dc3b2d19745d8bd5c356547971d49', 'request_id': 'req-056bb552-e15c-4429-8ab1-f5f8456a0943'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:37.806560 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-056bb552-e15c-4429-8ab1-f5f8456a0943 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d5dc3b2d19745d8bd5c356547971d49', 'request_id': 'req-056bb552-e15c-4429-8ab1-f5f8456a0943'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:37.820636 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-056bb552-e15c-4429-8ab1-f5f8456a0943 admin admin] The token cache is being invalidate because project 4d5dc3b2d19745d8bd5c356547971d49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:33:37.820860 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-056bb552-e15c-4429-8ab1-f5f8456a0943 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:37.827087 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-056bb552-e15c-4429-8ab1-f5f8456a0943 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:37.829697 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1213/2421] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:33:37 2022] DELETE /identity/v3/projects/4d5dc3b2d19745d8bd5c356547971d49 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:33:37.837359 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28376007-b223-4a03-8fbf-fb77ed5e764a None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:37.838616 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28376007-b223-4a03-8fbf-fb77ed5e764a None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:37.838616 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28376007-b223-4a03-8fbf-fb77ed5e764a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:37.863218 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-28376007-b223-4a03-8fbf-fb77ed5e764a None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:37.864471 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-28376007-b223-4a03-8fbf-fb77ed5e764a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:37.946221 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1209/2422] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:37.954481 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e71ef-a363-44d3-8bb8-2b373bf2b3b0 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:37.954945 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e71ef-a363-44d3-8bb8-2b373bf2b3b0 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:37.955436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e71ef-a363-44d3-8bb8-2b373bf2b3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:37.981300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-0d2e71ef-a363-44d3-8bb8-2b373bf2b3b0 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:37.982597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-0d2e71ef-a363-44d3-8bb8-2b373bf2b3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:37.993581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1214/2423] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:37.997878 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28376007-b223-4a03-8fbf-fb77ed5e764a None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:38.009973 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28376007-b223-4a03-8fbf-fb77ed5e764a None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:38.015946 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fde4b-d83c-4244-918e-9512191f5815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:38.016795 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fde4b-d83c-4244-918e-9512191f5815 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:38.017128 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fde4b-d83c-4244-918e-9512191f5815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:38.018143 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fde4b-d83c-4244-918e-9512191f5815 admin admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:38.018832 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fde4b-d83c-4244-918e-9512191f5815 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:33:38.019143 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fde4b-d83c-4244-918e-9512191f5815 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:38.020845 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fde4b-d83c-4244-918e-9512191f5815 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:38.036319 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1210/2424] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:33:38.041072 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e71ef-a363-44d3-8bb8-2b373bf2b3b0 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:38.053507 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e71ef-a363-44d3-8bb8-2b373bf2b3b0 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:38.058474 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51681b40-cc0c-4f02-a1fd-ba460813cc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:38.059079 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51681b40-cc0c-4f02-a1fd-ba460813cc3c admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:38.059389 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51681b40-cc0c-4f02-a1fd-ba460813cc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:38.059654 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51681b40-cc0c-4f02-a1fd-ba460813cc3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:38.060308 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51681b40-cc0c-4f02-a1fd-ba460813cc3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:38.062548 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51681b40-cc0c-4f02-a1fd-ba460813cc3c admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:38.098134 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1215/2425] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:33:38 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:33:38.102787 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fde4b-d83c-4244-918e-9512191f5815 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:38.117538 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fde4b-d83c-4244-918e-9512191f5815 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:38.208573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3da92f-16ec-4658-a98d-4cd9aab5b0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:38.209183 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3da92f-16ec-4658-a98d-4cd9aab5b0a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:38.209504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3da92f-16ec-4658-a98d-4cd9aab5b0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:38.209820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3da92f-16ec-4658-a98d-4cd9aab5b0a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:38.210422 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3da92f-16ec-4658-a98d-4cd9aab5b0a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:38.212383 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3da92f-16ec-4658-a98d-4cd9aab5b0a3 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:38.246265 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1211/2426] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:33:38 2022] POST /identity/v3/users => generated 289 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:33:38.248563 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51681b40-cc0c-4f02-a1fd-ba460813cc3c admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:38.265459 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51681b40-cc0c-4f02-a1fd-ba460813cc3c admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:38.271622 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43172c-7307-4673-b30f-615daed9ebf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:38.272396 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43172c-7307-4673-b30f-615daed9ebf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:38.272675 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43172c-7307-4673-b30f-615daed9ebf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:38.272948 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43172c-7307-4673-b30f-615daed9ebf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:38.273645 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43172c-7307-4673-b30f-615daed9ebf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:38.275264 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43172c-7307-4673-b30f-615daed9ebf0 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:38.287375 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1216/2427] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:33:38.292125 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3da92f-16ec-4658-a98d-4cd9aab5b0a3 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:38.304611 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3da92f-16ec-4658-a98d-4cd9aab5b0a3 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:38.311437 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec321f20-ce05-445c-aec7-f1f40bfc2ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:38.312204 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec321f20-ce05-445c-aec7-f1f40bfc2ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:38.312575 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec321f20-ce05-445c-aec7-f1f40bfc2ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:38.312937 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec321f20-ce05-445c-aec7-f1f40bfc2ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:38.313778 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec321f20-ce05-445c-aec7-f1f40bfc2ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:38.316589 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec321f20-ce05-445c-aec7-f1f40bfc2ad8 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:38.333190 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1212/2428] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:33:38.337776 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43172c-7307-4673-b30f-615daed9ebf0 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:38.351741 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43172c-7307-4673-b30f-615daed9ebf0 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:38.357282 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadc4dd-4ee2-424f-a85f-3acc0a948044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:38.358014 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadc4dd-4ee2-424f-a85f-3acc0a948044 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:38.358298 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadc4dd-4ee2-424f-a85f-3acc0a948044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:38.358581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadc4dd-4ee2-424f-a85f-3acc0a948044 admin admin] PATH_INFO: `/v3/projects/d966f262984e44afaf9603a9784ff55b/users/4c868e6db47345319f68546587a456eb/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:38.378991 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cadc4dd-4ee2-424f-a85f-3acc0a948044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d966f262984e44afaf9603a9784ff55b, user_id=4c868e6db47345319f68546587a456eb, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:38.381826 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cadc4dd-4ee2-424f-a85f-3acc0a948044 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:38.398575 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1217/2429] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:33:38 2022] PUT /identity/v3/projects/d966f262984e44afaf9603a9784ff55b/users/4c868e6db47345319f68546587a456eb/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:33:38.411792 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dcc9ca-55c2-41e7-a8a4-9c5e7b7b3950 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:38.412083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dcc9ca-55c2-41e7-a8a4-9c5e7b7b3950 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:38.412361 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dcc9ca-55c2-41e7-a8a4-9c5e7b7b3950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:38.444604 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-a5dcc9ca-55c2-41e7-a8a4-9c5e7b7b3950 None None] MFA Rules not processed for user `4c868e6db47345319f68546587a456eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:38.445976 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-a5dcc9ca-55c2-41e7-a8a4-9c5e7b7b3950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:38.474493 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:38.527896 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1213/2430] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:33:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:38.554147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadc4dd-4ee2-424f-a85f-3acc0a948044 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:38.556122 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-1cadc4dd-4ee2-424f-a85f-3acc0a948044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:38.639912 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadc4dd-4ee2-424f-a85f-3acc0a948044 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:38.651373 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846b385-684e-4aec-b60c-4caa73a32473 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:38.652188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846b385-684e-4aec-b60c-4caa73a32473 service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:38.655928 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846b385-684e-4aec-b60c-4caa73a32473 service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:38.655928 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846b385-684e-4aec-b60c-4caa73a32473 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:38.664615 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846b385-684e-4aec-b60c-4caa73a32473 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:38.666153 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846b385-684e-4aec-b60c-4caa73a32473 service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:38.681721 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1218/2431] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:33:43.184325 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dcc9ca-55c2-41e7-a8a4-9c5e7b7b3950 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:43.186252 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-a5dcc9ca-55c2-41e7-a8a4-9c5e7b7b3950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:43.307283 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dcc9ca-55c2-41e7-a8a4-9c5e7b7b3950 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:43.313913 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474c9f1-b22d-4eb8-8481-6f08b002b7dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:43.315048 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474c9f1-b22d-4eb8-8481-6f08b002b7dc service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:43.315564 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474c9f1-b22d-4eb8-8481-6f08b002b7dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:43.316080 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474c9f1-b22d-4eb8-8481-6f08b002b7dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:43.319381 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-8474c9f1-b22d-4eb8-8481-6f08b002b7dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:43.415426 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474c9f1-b22d-4eb8-8481-6f08b002b7dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:43.416914 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474c9f1-b22d-4eb8-8481-6f08b002b7dc service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:43.429026 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1214/2432] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:33:48.156690 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846b385-684e-4aec-b60c-4caa73a32473 service cinder] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:48.159313 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-0846b385-684e-4aec-b60c-4caa73a32473 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:48.176927 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846b385-684e-4aec-b60c-4caa73a32473 service cinder] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:48.182900 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d99ebe-7918-4450-8fa2-69104b799005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:48.183602 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d99ebe-7918-4450-8fa2-69104b799005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:48.184415 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d99ebe-7918-4450-8fa2-69104b799005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:48.184701 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d99ebe-7918-4450-8fa2-69104b799005 admin admin] PATH_INFO: `/v3/users/388f72ff05784e6bae5ca4f085d7c55b` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:48.186067 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d99ebe-7918-4450-8fa2-69104b799005 admin admin] RBAC: Authorizing `identity:delete_user(user_id=388f72ff05784e6bae5ca4f085d7c55b)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:48.187971 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d99ebe-7918-4450-8fa2-69104b799005 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:48.207491 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:48.252876 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f7d99ebe-7918-4450-8fa2-69104b799005 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '388f72ff05784e6bae5ca4f085d7c55b'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:48.253637 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f7d99ebe-7918-4450-8fa2-69104b799005 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '388f72ff05784e6bae5ca4f085d7c55b'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:48.262792 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f7d99ebe-7918-4450-8fa2-69104b799005 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '388f72ff05784e6bae5ca4f085d7c55b'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:48.272763 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f7d99ebe-7918-4450-8fa2-69104b799005 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '388f72ff05784e6bae5ca4f085d7c55b'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:48.273609 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f7d99ebe-7918-4450-8fa2-69104b799005 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '388f72ff05784e6bae5ca4f085d7c55b'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:48.297391 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1219/2433] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:33:48 2022] DELETE /identity/v3/users/388f72ff05784e6bae5ca4f085d7c55b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:33:48.536597 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474c9f1-b22d-4eb8-8481-6f08b002b7dc service neutron] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:48.549841 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474c9f1-b22d-4eb8-8481-6f08b002b7dc service neutron] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:48.653193 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afde19e-5e6c-4a7a-a7ce-619374866be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:48.654233 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afde19e-5e6c-4a7a-a7ce-619374866be3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:48.654696 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afde19e-5e6c-4a7a-a7ce-619374866be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:48.655369 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afde19e-5e6c-4a7a-a7ce-619374866be3 admin admin] PATH_INFO: `/v3/projects/ce26e09d1d3c43379d4a119f322f5a52` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:48.657303 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afde19e-5e6c-4a7a-a7ce-619374866be3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce26e09d1d3c43379d4a119f322f5a52)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:48.661345 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afde19e-5e6c-4a7a-a7ce-619374866be3 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:48.686522 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:48.741030 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-6afde19e-5e6c-4a7a-a7ce-619374866be3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce26e09d1d3c43379d4a119f322f5a52', 'request_id': 'req-6afde19e-5e6c-4a7a-a7ce-619374866be3'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:48.747815 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-6afde19e-5e6c-4a7a-a7ce-619374866be3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce26e09d1d3c43379d4a119f322f5a52', 'request_id': 'req-6afde19e-5e6c-4a7a-a7ce-619374866be3'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:48.756493 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-6afde19e-5e6c-4a7a-a7ce-619374866be3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce26e09d1d3c43379d4a119f322f5a52', 'request_id': 'req-6afde19e-5e6c-4a7a-a7ce-619374866be3'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:48.774886 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-6afde19e-5e6c-4a7a-a7ce-619374866be3 admin admin] The token cache is being invalidate because project ce26e09d1d3c43379d4a119f322f5a52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:33:48.775290 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-6afde19e-5e6c-4a7a-a7ce-619374866be3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:48.776054 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-6afde19e-5e6c-4a7a-a7ce-619374866be3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:48.777770 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1215/2434] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:33:48 2022] DELETE /identity/v3/projects/ce26e09d1d3c43379d4a119f322f5a52 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:33:48.783163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53a82d-bb4a-4225-80d8-7816287c8860 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:48.783532 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53a82d-bb4a-4225-80d8-7816287c8860 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:48.783833 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53a82d-bb4a-4225-80d8-7816287c8860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:48.806495 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-5e53a82d-bb4a-4225-80d8-7816287c8860 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:48.807896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-5e53a82d-bb4a-4225-80d8-7816287c8860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:48.893988 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1220/2435] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:48.901712 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb2938-1fb9-4ff7-b95d-00c23b1150cf None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:48.901997 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb2938-1fb9-4ff7-b95d-00c23b1150cf None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:48.902271 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb2938-1fb9-4ff7-b95d-00c23b1150cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:48.922780 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-efbb2938-1fb9-4ff7-b95d-00c23b1150cf None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:48.924026 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-efbb2938-1fb9-4ff7-b95d-00c23b1150cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:48.932317 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1216/2436] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:48.937067 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53a82d-bb4a-4225-80d8-7816287c8860 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:48.948917 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53a82d-bb4a-4225-80d8-7816287c8860 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:48.953734 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34dae15-c162-4b15-92d8-a62bf752cf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:48.954345 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34dae15-c162-4b15-92d8-a62bf752cf9e admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:48.955351 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34dae15-c162-4b15-92d8-a62bf752cf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:48.955631 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34dae15-c162-4b15-92d8-a62bf752cf9e admin admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:48.956380 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34dae15-c162-4b15-92d8-a62bf752cf9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:33:48.956690 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34dae15-c162-4b15-92d8-a62bf752cf9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:48.958341 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34dae15-c162-4b15-92d8-a62bf752cf9e admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:48.971846 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1221/2437] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:33:48.976747 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb2938-1fb9-4ff7-b95d-00c23b1150cf None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:48.989706 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb2938-1fb9-4ff7-b95d-00c23b1150cf None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:48.995762 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c33a1-a2db-4598-beb9-b8d631db562f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:48.996545 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c33a1-a2db-4598-beb9-b8d631db562f admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:48.996825 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c33a1-a2db-4598-beb9-b8d631db562f admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:48.997102 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c33a1-a2db-4598-beb9-b8d631db562f admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:48.997794 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c33a1-a2db-4598-beb9-b8d631db562f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:48.999704 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c33a1-a2db-4598-beb9-b8d631db562f admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:49.031793 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1217/2438] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:33:48 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:33:49.036382 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34dae15-c162-4b15-92d8-a62bf752cf9e admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:49.047892 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34dae15-c162-4b15-92d8-a62bf752cf9e admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:49.120049 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d8955-f185-4c78-8348-ce600b0dd8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:49.120671 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d8955-f185-4c78-8348-ce600b0dd8fb admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:49.120955 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d8955-f185-4c78-8348-ce600b0dd8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:49.121234 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d8955-f185-4c78-8348-ce600b0dd8fb admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:49.121910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d8955-f185-4c78-8348-ce600b0dd8fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:49.123890 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d8955-f185-4c78-8348-ce600b0dd8fb admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:49.166532 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1222/2439] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:33:49 2022] POST /identity/v3/users => generated 290 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:33:49.167809 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c33a1-a2db-4598-beb9-b8d631db562f admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:49.183887 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c33a1-a2db-4598-beb9-b8d631db562f admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:49.190762 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571e6f3-2bb3-4d34-babc-7b31bf1174b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:49.191812 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571e6f3-2bb3-4d34-babc-7b31bf1174b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:49.192294 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571e6f3-2bb3-4d34-babc-7b31bf1174b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:49.192769 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571e6f3-2bb3-4d34-babc-7b31bf1174b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:49.194159 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571e6f3-2bb3-4d34-babc-7b31bf1174b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:49.197380 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571e6f3-2bb3-4d34-babc-7b31bf1174b2 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:49.219165 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1218/2440] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:33:49.223877 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d8955-f185-4c78-8348-ce600b0dd8fb admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:49.237083 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d8955-f185-4c78-8348-ce600b0dd8fb admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:49.242539 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff108bf-2cfe-4b14-a439-f8f15fb4452d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:49.243356 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff108bf-2cfe-4b14-a439-f8f15fb4452d admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:49.243761 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff108bf-2cfe-4b14-a439-f8f15fb4452d admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:49.244164 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff108bf-2cfe-4b14-a439-f8f15fb4452d admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:49.244907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff108bf-2cfe-4b14-a439-f8f15fb4452d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:49.246637 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff108bf-2cfe-4b14-a439-f8f15fb4452d admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:49.248245 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:49.265572 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1223/2441] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:33:49.269404 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571e6f3-2bb3-4d34-babc-7b31bf1174b2 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:49.280551 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571e6f3-2bb3-4d34-babc-7b31bf1174b2 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:49.286313 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabe005-4bd6-4fa7-9b98-3033817350c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:49.286990 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabe005-4bd6-4fa7-9b98-3033817350c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:49.287274 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabe005-4bd6-4fa7-9b98-3033817350c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:49.287805 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabe005-4bd6-4fa7-9b98-3033817350c9 admin admin] PATH_INFO: `/v3/projects/c8604090875c4ef5953938521a8fc4f9/users/df2ab6c091024890adbf31e9bbc80add/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:49.305014 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fabe005-4bd6-4fa7-9b98-3033817350c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8604090875c4ef5953938521a8fc4f9, user_id=df2ab6c091024890adbf31e9bbc80add, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:49.309068 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fabe005-4bd6-4fa7-9b98-3033817350c9 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:49.324992 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1219/2442] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:33:49 2022] PUT /identity/v3/projects/c8604090875c4ef5953938521a8fc4f9/users/df2ab6c091024890adbf31e9bbc80add/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:33:49.335665 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662c140-1c44-4533-953d-14d0a673015a None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:49.335965 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662c140-1c44-4533-953d-14d0a673015a None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:49.336234 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662c140-1c44-4533-953d-14d0a673015a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:49.369699 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-9662c140-1c44-4533-953d-14d0a673015a None None] MFA Rules not processed for user `df2ab6c091024890adbf31e9bbc80add`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:49.370904 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-9662c140-1c44-4533-953d-14d0a673015a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:49.459966 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1224/2443] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:33:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:33:49.465963 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabe005-4bd6-4fa7-9b98-3033817350c9 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:49.580061 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabe005-4bd6-4fa7-9b98-3033817350c9 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:49.590285 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a330e-2821-41a9-a0dc-202222452b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:49.591416 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a330e-2821-41a9-a0dc-202222452b49 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:49.591740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a330e-2821-41a9-a0dc-202222452b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:49.592167 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a330e-2821-41a9-a0dc-202222452b49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:49.593421 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a330e-2821-41a9-a0dc-202222452b49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:49.599022 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a330e-2821-41a9-a0dc-202222452b49 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:49.647285 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1220/2444] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:33:49 2022] POST /identity/v3/projects => generated 381 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:33:49.658840 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662c140-1c44-4533-953d-14d0a673015a None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:49.672932 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662c140-1c44-4533-953d-14d0a673015a None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:49.777480 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef3db7-2f04-402e-9f7a-b8218392dcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:49.778262 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef3db7-2f04-402e-9f7a-b8218392dcae admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:49.778756 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef3db7-2f04-402e-9f7a-b8218392dcae admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:49.778989 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef3db7-2f04-402e-9f7a-b8218392dcae admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:49.780186 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef3db7-2f04-402e-9f7a-b8218392dcae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:49.783933 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef3db7-2f04-402e-9f7a-b8218392dcae admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:49.810279 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1225/2445] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:33:49 2022] POST /identity/v3/users => generated 297 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:33:49.819638 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a330e-2821-41a9-a0dc-202222452b49 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:49.835670 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a330e-2821-41a9-a0dc-202222452b49 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:49.840786 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e0534-71b7-4e24-9ea0-2489249fe1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:49.841491 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e0534-71b7-4e24-9ea0-2489249fe1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:49.841774 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e0534-71b7-4e24-9ea0-2489249fe1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:49.841983 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e0534-71b7-4e24-9ea0-2489249fe1c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:49.842780 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e0534-71b7-4e24-9ea0-2489249fe1c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:49.844425 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e0534-71b7-4e24-9ea0-2489249fe1c2 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:49.857454 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1221/2446] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:33:49.862810 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef3db7-2f04-402e-9f7a-b8218392dcae admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:49.876585 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef3db7-2f04-402e-9f7a-b8218392dcae admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:49.882188 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a9062-6f7a-4b3d-b676-0863fe71155a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:49.882920 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a9062-6f7a-4b3d-b676-0863fe71155a admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:49.883200 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a9062-6f7a-4b3d-b676-0863fe71155a admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:49.883477 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a9062-6f7a-4b3d-b676-0863fe71155a admin admin] PATH_INFO: `/v3/projects/26362a0572614318b620291885307bb3/users/5fad61510eeb4f47bbec471fa8a499cb/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:49.902274 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a9062-6f7a-4b3d-b676-0863fe71155a admin admin] RBAC: Authorizing `identity:create_grant(project_id=26362a0572614318b620291885307bb3, user_id=5fad61510eeb4f47bbec471fa8a499cb, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:49.905063 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a9062-6f7a-4b3d-b676-0863fe71155a admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:49.930397 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1226/2447] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:33:49 2022] PUT /identity/v3/projects/26362a0572614318b620291885307bb3/users/5fad61510eeb4f47bbec471fa8a499cb/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:33:49.936720 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e0534-71b7-4e24-9ea0-2489249fe1c2 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:49.956207 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e0534-71b7-4e24-9ea0-2489249fe1c2 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:49.979839 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:50.061978 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e8023-a24e-4b32-aa2c-cbbda1ca69ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:50.062708 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e8023-a24e-4b32-aa2c-cbbda1ca69ca admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:50.067034 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e8023-a24e-4b32-aa2c-cbbda1ca69ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:50.067034 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e8023-a24e-4b32-aa2c-cbbda1ca69ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:50.067034 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e8023-a24e-4b32-aa2c-cbbda1ca69ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:50.067570 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e8023-a24e-4b32-aa2c-cbbda1ca69ca admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:50.083575 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1222/2448] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:33:50.089267 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a9062-6f7a-4b3d-b676-0863fe71155a admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:50.108835 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a9062-6f7a-4b3d-b676-0863fe71155a admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:50.119886 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba061e-454a-45ad-8321-0df487d9fa99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:50.121014 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba061e-454a-45ad-8321-0df487d9fa99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:50.121546 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba061e-454a-45ad-8321-0df487d9fa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:50.122052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba061e-454a-45ad-8321-0df487d9fa99 admin admin] PATH_INFO: `/v3/projects/26362a0572614318b620291885307bb3/users/5fad61510eeb4f47bbec471fa8a499cb/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:50.127347 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba061e-454a-45ad-8321-0df487d9fa99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26362a0572614318b620291885307bb3, user_id=5fad61510eeb4f47bbec471fa8a499cb, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:50.132231 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba061e-454a-45ad-8321-0df487d9fa99 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:50.149172 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1227/2449] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:33:50 2022] PUT /identity/v3/projects/26362a0572614318b620291885307bb3/users/5fad61510eeb4f47bbec471fa8a499cb/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:33:50.164011 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca231e60-e8ce-4cf2-9d2c-73ebd86505dd None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:50.164011 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca231e60-e8ce-4cf2-9d2c-73ebd86505dd None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:50.164011 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca231e60-e8ce-4cf2-9d2c-73ebd86505dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:50.203291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-ca231e60-e8ce-4cf2-9d2c-73ebd86505dd None None] MFA Rules not processed for user `5fad61510eeb4f47bbec471fa8a499cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:50.205969 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-ca231e60-e8ce-4cf2-9d2c-73ebd86505dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:50.321612 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1223/2450] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:33:50 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:50.342493 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba061e-454a-45ad-8321-0df487d9fa99 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:50.346226 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-84ba061e-454a-45ad-8321-0df487d9fa99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:50.427117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:50.449354 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba061e-454a-45ad-8321-0df487d9fa99 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:50.456177 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7082b6-8de2-4fb0-81be-9f396b9816f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:50.456895 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7082b6-8de2-4fb0-81be-9f396b9816f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:50.457176 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7082b6-8de2-4fb0-81be-9f396b9816f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:50.457482 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7082b6-8de2-4fb0-81be-9f396b9816f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:50.472600 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7082b6-8de2-4fb0-81be-9f396b9816f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:50.475348 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7082b6-8de2-4fb0-81be-9f396b9816f7 service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:50.492443 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1228/2451] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:50 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:33:50.610145 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca231e60-e8ce-4cf2-9d2c-73ebd86505dd None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:50.627702 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca231e60-e8ce-4cf2-9d2c-73ebd86505dd None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:50.634164 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d8e0f-0ca6-4e25-83f5-d8b220b41c92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:50.635215 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d8e0f-0ca6-4e25-83f5-d8b220b41c92 service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:50.635670 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d8e0f-0ca6-4e25-83f5-d8b220b41c92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:50.636142 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d8e0f-0ca6-4e25-83f5-d8b220b41c92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:50.707924 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d8e0f-0ca6-4e25-83f5-d8b220b41c92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:50.709582 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d8e0f-0ca6-4e25-83f5-d8b220b41c92 service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:50.721188 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1224/2452] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:33:51.360731 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7082b6-8de2-4fb0-81be-9f396b9816f7 service cinder] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:51.362512 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-ae7082b6-8de2-4fb0-81be-9f396b9816f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:51.462107 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7082b6-8de2-4fb0-81be-9f396b9816f7 service cinder] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:51.466829 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1f9d8-03ea-4483-8e8f-64d1afcca77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:51.467496 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1f9d8-03ea-4483-8e8f-64d1afcca77a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:51.467771 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1f9d8-03ea-4483-8e8f-64d1afcca77a admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:51.468038 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1f9d8-03ea-4483-8e8f-64d1afcca77a admin admin] PATH_INFO: `/v3/users/4c868e6db47345319f68546587a456eb` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:51.469207 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1f9d8-03ea-4483-8e8f-64d1afcca77a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c868e6db47345319f68546587a456eb)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:51.471771 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1f9d8-03ea-4483-8e8f-64d1afcca77a admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:51.524728 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-e5a1f9d8-03ea-4483-8e8f-64d1afcca77a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c868e6db47345319f68546587a456eb'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:51.525458 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-e5a1f9d8-03ea-4483-8e8f-64d1afcca77a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c868e6db47345319f68546587a456eb'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:51.533917 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-e5a1f9d8-03ea-4483-8e8f-64d1afcca77a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c868e6db47345319f68546587a456eb'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:51.545296 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-e5a1f9d8-03ea-4483-8e8f-64d1afcca77a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c868e6db47345319f68546587a456eb'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:51.546083 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-e5a1f9d8-03ea-4483-8e8f-64d1afcca77a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c868e6db47345319f68546587a456eb'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:51.569617 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1229/2453] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:33:51 2022] DELETE /identity/v3/users/4c868e6db47345319f68546587a456eb => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:33:51.576018 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31326c97-c65c-415f-8892-304a0aebf2c3 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:51.576303 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31326c97-c65c-415f-8892-304a0aebf2c3 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:51.576579 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31326c97-c65c-415f-8892-304a0aebf2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:51.606778 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-31326c97-c65c-415f-8892-304a0aebf2c3 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:51.608068 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-31326c97-c65c-415f-8892-304a0aebf2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:51.645247 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:51.701490 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1225/2454] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:51.716677 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1f9d8-03ea-4483-8e8f-64d1afcca77a admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:51.718546 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-e5a1f9d8-03ea-4483-8e8f-64d1afcca77a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:51.815448 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1f9d8-03ea-4483-8e8f-64d1afcca77a admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:51.819650 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe52ee6-bf01-436c-ae64-d6d1244f480b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:51.820365 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe52ee6-bf01-436c-ae64-d6d1244f480b service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:51.820656 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe52ee6-bf01-436c-ae64-d6d1244f480b service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:51.820928 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe52ee6-bf01-436c-ae64-d6d1244f480b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:51.837961 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe52ee6-bf01-436c-ae64-d6d1244f480b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:51.839572 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe52ee6-bf01-436c-ae64-d6d1244f480b service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:51.853265 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1230/2455] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:33:52.271148 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31326c97-c65c-415f-8892-304a0aebf2c3 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:52.273859 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-31326c97-c65c-415f-8892-304a0aebf2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:52.312812 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31326c97-c65c-415f-8892-304a0aebf2c3 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:52.320423 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e804d-cad1-4a70-ad5b-7dc54df0fc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:52.321135 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e804d-cad1-4a70-ad5b-7dc54df0fc38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:52.321453 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e804d-cad1-4a70-ad5b-7dc54df0fc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:52.321737 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e804d-cad1-4a70-ad5b-7dc54df0fc38 admin admin] PATH_INFO: `/v3/projects/d966f262984e44afaf9603a9784ff55b` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:52.323229 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e804d-cad1-4a70-ad5b-7dc54df0fc38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d966f262984e44afaf9603a9784ff55b)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:52.325211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e804d-cad1-4a70-ad5b-7dc54df0fc38 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:52.434253 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-a76e804d-cad1-4a70-ad5b-7dc54df0fc38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd966f262984e44afaf9603a9784ff55b', 'request_id': 'req-a76e804d-cad1-4a70-ad5b-7dc54df0fc38'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:52.443016 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-a76e804d-cad1-4a70-ad5b-7dc54df0fc38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd966f262984e44afaf9603a9784ff55b', 'request_id': 'req-a76e804d-cad1-4a70-ad5b-7dc54df0fc38'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:52.453677 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-a76e804d-cad1-4a70-ad5b-7dc54df0fc38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd966f262984e44afaf9603a9784ff55b', 'request_id': 'req-a76e804d-cad1-4a70-ad5b-7dc54df0fc38'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:52.472763 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-a76e804d-cad1-4a70-ad5b-7dc54df0fc38 admin admin] The token cache is being invalidate because project d966f262984e44afaf9603a9784ff55b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:33:52.473118 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-a76e804d-cad1-4a70-ad5b-7dc54df0fc38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:52.473917 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-a76e804d-cad1-4a70-ad5b-7dc54df0fc38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:52.475855 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1226/2456] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:33:52 2022] DELETE /identity/v3/projects/d966f262984e44afaf9603a9784ff55b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:33:52.493703 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375ecc1-89ca-4db5-aab1-038c0037745b None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:52.494683 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375ecc1-89ca-4db5-aab1-038c0037745b None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:52.494683 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375ecc1-89ca-4db5-aab1-038c0037745b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:52.515089 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:52.541742 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-b375ecc1-89ca-4db5-aab1-038c0037745b None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:52.545809 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-b375ecc1-89ca-4db5-aab1-038c0037745b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:52.626879 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1231/2457] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:52.634840 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4341b06-3a85-4f66-8950-dd4b4bd0a23a None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:52.635125 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4341b06-3a85-4f66-8950-dd4b4bd0a23a None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:52.635447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4341b06-3a85-4f66-8950-dd4b4bd0a23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:52.655942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-d4341b06-3a85-4f66-8950-dd4b4bd0a23a None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:52.657174 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-d4341b06-3a85-4f66-8950-dd4b4bd0a23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:52.668668 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1227/2458] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:52.674212 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375ecc1-89ca-4db5-aab1-038c0037745b None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:52.686691 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375ecc1-89ca-4db5-aab1-038c0037745b None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:52.691856 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ec3a9-abe3-4683-aa6c-25cf790967bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:52.692498 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ec3a9-abe3-4683-aa6c-25cf790967bc admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:52.695117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ec3a9-abe3-4683-aa6c-25cf790967bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:52.695117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ec3a9-abe3-4683-aa6c-25cf790967bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:52.695117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ec3a9-abe3-4683-aa6c-25cf790967bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:33:52.695117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ec3a9-abe3-4683-aa6c-25cf790967bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:52.695717 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ec3a9-abe3-4683-aa6c-25cf790967bc admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:52.710119 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1232/2459] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:33:52.717792 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4341b06-3a85-4f66-8950-dd4b4bd0a23a None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:52.730866 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4341b06-3a85-4f66-8950-dd4b4bd0a23a None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:52.737844 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ffa45-3154-4656-9bed-39eeb6029d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:52.738524 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ffa45-3154-4656-9bed-39eeb6029d65 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:52.739004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ffa45-3154-4656-9bed-39eeb6029d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:52.739372 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ffa45-3154-4656-9bed-39eeb6029d65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:52.740123 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ffa45-3154-4656-9bed-39eeb6029d65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:52.742197 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ffa45-3154-4656-9bed-39eeb6029d65 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:52.774396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1228/2460] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:33:52 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:33:52.781135 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ec3a9-abe3-4683-aa6c-25cf790967bc admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:52.795919 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ec3a9-abe3-4683-aa6c-25cf790967bc admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:52.880459 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b8186-8011-4490-a643-40a820a0b0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:52.881317 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b8186-8011-4490-a643-40a820a0b0e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:52.881629 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b8186-8011-4490-a643-40a820a0b0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:52.881900 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b8186-8011-4490-a643-40a820a0b0e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:52.882579 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9b8186-8011-4490-a643-40a820a0b0e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:52.885825 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9b8186-8011-4490-a643-40a820a0b0e5 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:52.935167 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1233/2461] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:33:52 2022] POST /identity/v3/users => generated 291 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:33:52.940086 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ffa45-3154-4656-9bed-39eeb6029d65 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:52.952041 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ffa45-3154-4656-9bed-39eeb6029d65 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:52.958278 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d504c-0424-41f6-a716-9e4c0a77be87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:52.958917 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d504c-0424-41f6-a716-9e4c0a77be87 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:52.959202 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d504c-0424-41f6-a716-9e4c0a77be87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:52.959481 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d504c-0424-41f6-a716-9e4c0a77be87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:52.960150 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234d504c-0424-41f6-a716-9e4c0a77be87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:52.961853 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234d504c-0424-41f6-a716-9e4c0a77be87 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:52.977103 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1229/2462] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:33:52.982692 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b8186-8011-4490-a643-40a820a0b0e5 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:53.000689 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b8186-8011-4490-a643-40a820a0b0e5 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:53.009551 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d6252-7d8f-45f6-baa9-5d5ce25efc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:53.010602 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d6252-7d8f-45f6-baa9-5d5ce25efc7c admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:53.011096 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d6252-7d8f-45f6-baa9-5d5ce25efc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:53.011581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d6252-7d8f-45f6-baa9-5d5ce25efc7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:53.012817 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d6252-7d8f-45f6-baa9-5d5ce25efc7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:53.016799 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d6252-7d8f-45f6-baa9-5d5ce25efc7c admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:53.043525 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1234/2463] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:33:53.044912 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d504c-0424-41f6-a716-9e4c0a77be87 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:53.060819 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d504c-0424-41f6-a716-9e4c0a77be87 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:53.068899 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f3b69-a0df-4d2a-bc39-f41a92dc3858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:53.070564 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f3b69-a0df-4d2a-bc39-f41a92dc3858 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:53.071080 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f3b69-a0df-4d2a-bc39-f41a92dc3858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:53.071580 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f3b69-a0df-4d2a-bc39-f41a92dc3858 admin admin] PATH_INFO: `/v3/projects/26170ca9f4a34b6387b776d66c9525d7/users/c4aa03196af3474284bfaa19bef8e95b/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:53.101253 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f3b69-a0df-4d2a-bc39-f41a92dc3858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26170ca9f4a34b6387b776d66c9525d7, user_id=c4aa03196af3474284bfaa19bef8e95b, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:53.104033 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f3b69-a0df-4d2a-bc39-f41a92dc3858 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:53.127944 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1230/2464] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:33:53 2022] PUT /identity/v3/projects/26170ca9f4a34b6387b776d66c9525d7/users/c4aa03196af3474284bfaa19bef8e95b/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:33:53.134398 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b67b2-10af-4735-b6b3-3f92abf32f99 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:53.134648 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b67b2-10af-4735-b6b3-3f92abf32f99 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:53.135139 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b67b2-10af-4735-b6b3-3f92abf32f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:53.171130 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-310b67b2-10af-4735-b6b3-3f92abf32f99 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:53.174052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-310b67b2-10af-4735-b6b3-3f92abf32f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:53.261110 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1235/2465] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:33:53.273405 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f3b69-a0df-4d2a-bc39-f41a92dc3858 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:53.275365 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-af7f3b69-a0df-4d2a-bc39-f41a92dc3858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:53.354590 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f3b69-a0df-4d2a-bc39-f41a92dc3858 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:53.358687 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b64a70-3fa2-4433-9291-2cd2ee5ca227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:53.359318 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b64a70-3fa2-4433-9291-2cd2ee5ca227 service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:53.359602 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b64a70-3fa2-4433-9291-2cd2ee5ca227 service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:53.359871 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b64a70-3fa2-4433-9291-2cd2ee5ca227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:53.371013 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b64a70-3fa2-4433-9291-2cd2ee5ca227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:53.372481 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b64a70-3fa2-4433-9291-2cd2ee5ca227 service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:53.377753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:53.386573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1231/2466] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:33:58.784166 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b67b2-10af-4735-b6b3-3f92abf32f99 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:58.787051 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-310b67b2-10af-4735-b6b3-3f92abf32f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:58.798665 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b67b2-10af-4735-b6b3-3f92abf32f99 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:58.803806 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06777c57-8886-41f6-9eb9-8fa9e60085b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:58.804459 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06777c57-8886-41f6-9eb9-8fa9e60085b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:58.804740 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06777c57-8886-41f6-9eb9-8fa9e60085b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:58.805018 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06777c57-8886-41f6-9eb9-8fa9e60085b9 admin admin] PATH_INFO: `/v3/users/df2ab6c091024890adbf31e9bbc80add` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:58.806312 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06777c57-8886-41f6-9eb9-8fa9e60085b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df2ab6c091024890adbf31e9bbc80add)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:58.808303 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06777c57-8886-41f6-9eb9-8fa9e60085b9 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:58.811146 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:58.879980 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-06777c57-8886-41f6-9eb9-8fa9e60085b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df2ab6c091024890adbf31e9bbc80add'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:58.881017 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-06777c57-8886-41f6-9eb9-8fa9e60085b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df2ab6c091024890adbf31e9bbc80add'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:58.895733 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-06777c57-8886-41f6-9eb9-8fa9e60085b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df2ab6c091024890adbf31e9bbc80add'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:58.905993 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-06777c57-8886-41f6-9eb9-8fa9e60085b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df2ab6c091024890adbf31e9bbc80add'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:58.907401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-06777c57-8886-41f6-9eb9-8fa9e60085b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df2ab6c091024890adbf31e9bbc80add'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:58.936057 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1236/2467] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:33:58 2022] DELETE /identity/v3/users/df2ab6c091024890adbf31e9bbc80add => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:33:58.937824 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71611705-46ec-4787-b24d-24a4fdde5054 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:58.938846 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71611705-46ec-4787-b24d-24a4fdde5054 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:58.940530 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71611705-46ec-4787-b24d-24a4fdde5054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:58.972210 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-71611705-46ec-4787-b24d-24a4fdde5054 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:58.974413 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-71611705-46ec-4787-b24d-24a4fdde5054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:59.105300 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1232/2468] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:33:59.115597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06777c57-8886-41f6-9eb9-8fa9e60085b9 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:59.117254 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-06777c57-8886-41f6-9eb9-8fa9e60085b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:59.193002 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06777c57-8886-41f6-9eb9-8fa9e60085b9 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:59.197516 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc98783-1d99-44a1-b25b-9567926d432f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:59.198342 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc98783-1d99-44a1-b25b-9567926d432f service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:59.198724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc98783-1d99-44a1-b25b-9567926d432f service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:59.199103 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc98783-1d99-44a1-b25b-9567926d432f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:59.201853 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674f185-601f-457a-aeb9-216ad8a52abb None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:59.202366 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674f185-601f-457a-aeb9-216ad8a52abb None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:59.202941 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674f185-601f-457a-aeb9-216ad8a52abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:59.214529 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc98783-1d99-44a1-b25b-9567926d432f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:59.216586 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc98783-1d99-44a1-b25b-9567926d432f service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:59.231718 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1237/2469] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:33:59.243517 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-5674f185-601f-457a-aeb9-216ad8a52abb None None] MFA Rules not processed for user `c4aa03196af3474284bfaa19bef8e95b`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:59.244777 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-5674f185-601f-457a-aeb9-216ad8a52abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:59.357064 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1233/2470] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:33:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:59.363385 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc98783-1d99-44a1-b25b-9567926d432f service neutron] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:59.365016 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-2dc98783-1d99-44a1-b25b-9567926d432f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:59.381799 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc98783-1d99-44a1-b25b-9567926d432f service neutron] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:59.388841 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3de88-c7d6-4f9e-8937-eb075b49c961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:59.389706 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3de88-c7d6-4f9e-8937-eb075b49c961 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:59.390095 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3de88-c7d6-4f9e-8937-eb075b49c961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:59.390477 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3de88-c7d6-4f9e-8937-eb075b49c961 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:59.391277 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3de88-c7d6-4f9e-8937-eb075b49c961 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:59.396834 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3de88-c7d6-4f9e-8937-eb075b49c961 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:59.452389 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1238/2471] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:33:59 2022] POST /identity/v3/projects => generated 383 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:33:59.454041 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674f185-601f-457a-aeb9-216ad8a52abb None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:59.473934 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674f185-601f-457a-aeb9-216ad8a52abb None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:59.562489 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3de88-c7d6-4f9e-8937-eb075b49c961 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:59.564911 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-41e3de88-c7d6-4f9e-8937-eb075b49c961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:59.582213 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a3839-5d95-4601-9359-3c8bec8e7164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:59.582858 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a3839-5d95-4601-9359-3c8bec8e7164 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:59.583154 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a3839-5d95-4601-9359-3c8bec8e7164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:59.583406 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a3839-5d95-4601-9359-3c8bec8e7164 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:59.584050 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a3839-5d95-4601-9359-3c8bec8e7164 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:59.586644 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a3839-5d95-4601-9359-3c8bec8e7164 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:59.627263 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1234/2472] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:33:59 2022] POST /identity/v3/users => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:33:59.632838 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a3839-5d95-4601-9359-3c8bec8e7164 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:59.661560 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a3839-5d95-4601-9359-3c8bec8e7164 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:59.667718 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae3c16-7195-4352-96e3-759accc221eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:59.668353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae3c16-7195-4352-96e3-759accc221eb admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:59.668637 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae3c16-7195-4352-96e3-759accc221eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:59.668919 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae3c16-7195-4352-96e3-759accc221eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:59.669610 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae3c16-7195-4352-96e3-759accc221eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:59.671257 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae3c16-7195-4352-96e3-759accc221eb admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:59.684408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1235/2473] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:33:59.689503 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae3c16-7195-4352-96e3-759accc221eb admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:59.701934 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae3c16-7195-4352-96e3-759accc221eb admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:59.708578 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e12039-fb10-409f-a028-b74c418b6c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:59.709330 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3de88-c7d6-4f9e-8937-eb075b49c961 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:59.709504 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e12039-fb10-409f-a028-b74c418b6c91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:59.709761 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e12039-fb10-409f-a028-b74c418b6c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:59.710071 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e12039-fb10-409f-a028-b74c418b6c91 admin admin] PATH_INFO: `/v3/projects/05f33a2ef5fe4a4ea2311daab111cc1c/users/57837f42a696417a9acbaba990a2830f/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:59.713590 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:59.713906 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d891a-bef3-44c4-a4ec-5e46235105fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:59.714452 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d891a-bef3-44c4-a4ec-5e46235105fb service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:59.714729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d891a-bef3-44c4-a4ec-5e46235105fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:59.716028 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d891a-bef3-44c4-a4ec-5e46235105fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:59.718176 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-9d7d891a-bef3-44c4-a4ec-5e46235105fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:59.732168 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d891a-bef3-44c4-a4ec-5e46235105fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:59.732384 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e12039-fb10-409f-a028-b74c418b6c91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05f33a2ef5fe4a4ea2311daab111cc1c, user_id=57837f42a696417a9acbaba990a2830f, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:59.734143 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d891a-bef3-44c4-a4ec-5e46235105fb service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:59.736962 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e12039-fb10-409f-a028-b74c418b6c91 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:59.749720 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1239/2474] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:33:59.752127 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d891a-bef3-44c4-a4ec-5e46235105fb service neutron] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:59.754764 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-9d7d891a-bef3-44c4-a4ec-5e46235105fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:59.773448 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1236/2475] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:33:59 2022] PUT /identity/v3/projects/05f33a2ef5fe4a4ea2311daab111cc1c/users/57837f42a696417a9acbaba990a2830f/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:33:59.779403 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e12039-fb10-409f-a028-b74c418b6c91 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:59.786873 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:59.798630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d891a-bef3-44c4-a4ec-5e46235105fb service neutron] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:59.876030 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e12039-fb10-409f-a028-b74c418b6c91 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:59.884064 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058981f7-895a-4587-b64b-3f23189fd71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:59.885052 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058981f7-895a-4587-b64b-3f23189fd71b admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:59.885599 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058981f7-895a-4587-b64b-3f23189fd71b admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:59.886097 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058981f7-895a-4587-b64b-3f23189fd71b admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:59.887317 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058981f7-895a-4587-b64b-3f23189fd71b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:59.890609 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058981f7-895a-4587-b64b-3f23189fd71b admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:59.899760 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded478b3-827a-42e0-93c4-c2bbabada8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:59.900583 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded478b3-827a-42e0-93c4-c2bbabada8e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:59.900901 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded478b3-827a-42e0-93c4-c2bbabada8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:59.901153 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded478b3-827a-42e0-93c4-c2bbabada8e8 admin admin] PATH_INFO: `/v3/projects/c8604090875c4ef5953938521a8fc4f9` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:59.902612 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded478b3-827a-42e0-93c4-c2bbabada8e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8604090875c4ef5953938521a8fc4f9)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:59.904625 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded478b3-827a-42e0-93c4-c2bbabada8e8 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:59.913114 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1237/2476] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:33:59.917750 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058981f7-895a-4587-b64b-3f23189fd71b admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:59.932411 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058981f7-895a-4587-b64b-3f23189fd71b admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:59.937602 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7413ee-d6ad-40f8-9cd8-5bc2e29f802e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:59.939577 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7413ee-d6ad-40f8-9cd8-5bc2e29f802e admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:59.940533 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7413ee-d6ad-40f8-9cd8-5bc2e29f802e admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:59.940533 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7413ee-d6ad-40f8-9cd8-5bc2e29f802e admin admin] PATH_INFO: `/v3/projects/05f33a2ef5fe4a4ea2311daab111cc1c/users/57837f42a696417a9acbaba990a2830f/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:59.943522 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7413ee-d6ad-40f8-9cd8-5bc2e29f802e admin admin] RBAC: Authorizing `identity:create_grant(project_id=05f33a2ef5fe4a4ea2311daab111cc1c, user_id=57837f42a696417a9acbaba990a2830f, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:59.946359 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7413ee-d6ad-40f8-9cd8-5bc2e29f802e admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:59.960078 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1238/2477] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:33:59 2022] PUT /identity/v3/projects/05f33a2ef5fe4a4ea2311daab111cc1c/users/57837f42a696417a9acbaba990a2830f/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:33:59.989984 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-ded478b3-827a-42e0-93c4-c2bbabada8e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8604090875c4ef5953938521a8fc4f9', 'request_id': 'req-ded478b3-827a-42e0-93c4-c2bbabada8e8'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:59.998950 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-ded478b3-827a-42e0-93c4-c2bbabada8e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8604090875c4ef5953938521a8fc4f9', 'request_id': 'req-ded478b3-827a-42e0-93c4-c2bbabada8e8'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:00.010366 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-ded478b3-827a-42e0-93c4-c2bbabada8e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8604090875c4ef5953938521a8fc4f9', 'request_id': 'req-ded478b3-827a-42e0-93c4-c2bbabada8e8'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:00.027266 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-ded478b3-827a-42e0-93c4-c2bbabada8e8 admin admin] The token cache is being invalidate because project c8604090875c4ef5953938521a8fc4f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:34:00.027951 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-ded478b3-827a-42e0-93c4-c2bbabada8e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:00.029481 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-ded478b3-827a-42e0-93c4-c2bbabada8e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:00.032018 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1240/2478] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:33:59 2022] DELETE /identity/v3/projects/c8604090875c4ef5953938521a8fc4f9 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:00.036147 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7413ee-d6ad-40f8-9cd8-5bc2e29f802e admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:00.038918 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-6a7413ee-d6ad-40f8-9cd8-5bc2e29f802e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:00.146656 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7413ee-d6ad-40f8-9cd8-5bc2e29f802e admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:00.230650 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d07488-3f98-417c-b11d-11a30aab8c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:00.231352 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d07488-3f98-417c-b11d-11a30aab8c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:00.231636 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d07488-3f98-417c-b11d-11a30aab8c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:00.231966 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d07488-3f98-417c-b11d-11a30aab8c0e admin admin] PATH_INFO: `/v3/users/5fad61510eeb4f47bbec471fa8a499cb` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:00.233246 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d07488-3f98-417c-b11d-11a30aab8c0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fad61510eeb4f47bbec471fa8a499cb)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:00.236759 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d07488-3f98-417c-b11d-11a30aab8c0e admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:00.259491 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:00.303328 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-30d07488-3f98-417c-b11d-11a30aab8c0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fad61510eeb4f47bbec471fa8a499cb'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:00.304016 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-30d07488-3f98-417c-b11d-11a30aab8c0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fad61510eeb4f47bbec471fa8a499cb'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:00.317709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-30d07488-3f98-417c-b11d-11a30aab8c0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fad61510eeb4f47bbec471fa8a499cb'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:00.327211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-30d07488-3f98-417c-b11d-11a30aab8c0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fad61510eeb4f47bbec471fa8a499cb'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:00.346291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-30d07488-3f98-417c-b11d-11a30aab8c0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fad61510eeb4f47bbec471fa8a499cb'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:00.371907 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1239/2479] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:34:00 2022] DELETE /identity/v3/users/5fad61510eeb4f47bbec471fa8a499cb => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:34:01.109966 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded478b3-827a-42e0-93c4-c2bbabada8e8 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:01.127651 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded478b3-827a-42e0-93c4-c2bbabada8e8 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:01.237094 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544fd8dd-bb48-4769-b65f-ed52a5ec2bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:01.239081 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fd8dd-bb48-4769-b65f-ed52a5ec2bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:01.239468 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fd8dd-bb48-4769-b65f-ed52a5ec2bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:01.240016 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fd8dd-bb48-4769-b65f-ed52a5ec2bef admin admin] PATH_INFO: `/v3/projects/26362a0572614318b620291885307bb3` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:01.243147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544fd8dd-bb48-4769-b65f-ed52a5ec2bef admin admin] RBAC: Authorizing `identity:delete_project(project_id=26362a0572614318b620291885307bb3)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:01.245456 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544fd8dd-bb48-4769-b65f-ed52a5ec2bef admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:01.307194 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:01.324896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-544fd8dd-bb48-4769-b65f-ed52a5ec2bef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26362a0572614318b620291885307bb3', 'request_id': 'req-544fd8dd-bb48-4769-b65f-ed52a5ec2bef'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:01.334334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-544fd8dd-bb48-4769-b65f-ed52a5ec2bef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26362a0572614318b620291885307bb3', 'request_id': 'req-544fd8dd-bb48-4769-b65f-ed52a5ec2bef'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:01.350260 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-544fd8dd-bb48-4769-b65f-ed52a5ec2bef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26362a0572614318b620291885307bb3', 'request_id': 'req-544fd8dd-bb48-4769-b65f-ed52a5ec2bef'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:01.367608 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-544fd8dd-bb48-4769-b65f-ed52a5ec2bef admin admin] The token cache is being invalidate because project 26362a0572614318b620291885307bb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:34:01.368538 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-544fd8dd-bb48-4769-b65f-ed52a5ec2bef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:01.369852 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-544fd8dd-bb48-4769-b65f-ed52a5ec2bef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:01.375384 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1241/2480] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:34:01 2022] DELETE /identity/v3/projects/26362a0572614318b620291885307bb3 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:01.378183 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebd82f-5179-421d-be63-037de2e93d2f None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:01.379462 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebd82f-5179-421d-be63-037de2e93d2f None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:01.380070 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebd82f-5179-421d-be63-037de2e93d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:01.409242 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-a2ebd82f-5179-421d-be63-037de2e93d2f None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:01.411396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-a2ebd82f-5179-421d-be63-037de2e93d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:01.625353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1240/2481] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:01.628298 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5423c-0d9f-4111-8afa-1c7026226537 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:01.628298 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5423c-0d9f-4111-8afa-1c7026226537 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:01.629118 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5423c-0d9f-4111-8afa-1c7026226537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:01.666733 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-b5b5423c-0d9f-4111-8afa-1c7026226537 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:01.668123 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-b5b5423c-0d9f-4111-8afa-1c7026226537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:01.689500 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1242/2482] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:01.690986 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebd82f-5179-421d-be63-037de2e93d2f None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:01.704590 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebd82f-5179-421d-be63-037de2e93d2f None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:01.711930 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47759538-58b8-41ec-93b2-1d5b1993fbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:01.713067 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47759538-58b8-41ec-93b2-1d5b1993fbea admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:01.713265 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47759538-58b8-41ec-93b2-1d5b1993fbea admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:01.713681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47759538-58b8-41ec-93b2-1d5b1993fbea admin admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:01.714810 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47759538-58b8-41ec-93b2-1d5b1993fbea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:34:01.715546 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47759538-58b8-41ec-93b2-1d5b1993fbea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:01.720781 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47759538-58b8-41ec-93b2-1d5b1993fbea admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:01.745958 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1241/2483] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:34:01.753054 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5423c-0d9f-4111-8afa-1c7026226537 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:01.774345 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5423c-0d9f-4111-8afa-1c7026226537 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:01.792900 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fe622-acc9-4109-8583-9c59905bb8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:01.794905 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fe622-acc9-4109-8583-9c59905bb8e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:01.795423 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fe622-acc9-4109-8583-9c59905bb8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:01.796158 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fe622-acc9-4109-8583-9c59905bb8e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:01.799184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0fe622-acc9-4109-8583-9c59905bb8e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:01.803325 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0fe622-acc9-4109-8583-9c59905bb8e0 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:01.881425 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1243/2484] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:34:01 2022] POST /identity/v3/projects => generated 363 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:34:01.888036 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47759538-58b8-41ec-93b2-1d5b1993fbea admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:01.914610 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47759538-58b8-41ec-93b2-1d5b1993fbea admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:02.156112 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77351965-5972-4c3c-abb3-d4695c9e35f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:02.157259 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77351965-5972-4c3c-abb3-d4695c9e35f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:02.157803 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77351965-5972-4c3c-abb3-d4695c9e35f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:02.158326 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77351965-5972-4c3c-abb3-d4695c9e35f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:02.159558 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77351965-5972-4c3c-abb3-d4695c9e35f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:02.163851 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77351965-5972-4c3c-abb3-d4695c9e35f8 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:02.233469 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1242/2485] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:34:01 2022] POST /identity/v3/users => generated 282 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:34:02.241022 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fe622-acc9-4109-8583-9c59905bb8e0 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:02.268498 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fe622-acc9-4109-8583-9c59905bb8e0 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:02.277000 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b87b13-2528-4124-b65f-f80eb968164f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:02.278213 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b87b13-2528-4124-b65f-f80eb968164f admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:02.278740 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b87b13-2528-4124-b65f-f80eb968164f admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:02.280540 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b87b13-2528-4124-b65f-f80eb968164f admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:02.281616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b87b13-2528-4124-b65f-f80eb968164f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:02.285482 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b87b13-2528-4124-b65f-f80eb968164f admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:02.320528 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1244/2486] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:02.326229 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77351965-5972-4c3c-abb3-d4695c9e35f8 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:02.357674 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77351965-5972-4c3c-abb3-d4695c9e35f8 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:02.370656 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ae75f-9145-4c55-8dfd-b4cec1b5e701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:02.372777 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ae75f-9145-4c55-8dfd-b4cec1b5e701 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:02.373259 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ae75f-9145-4c55-8dfd-b4cec1b5e701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:02.373782 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ae75f-9145-4c55-8dfd-b4cec1b5e701 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:02.375263 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ae75f-9145-4c55-8dfd-b4cec1b5e701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:02.390823 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ae75f-9145-4c55-8dfd-b4cec1b5e701 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:02.402778 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:02.421027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b87b13-2528-4124-b65f-f80eb968164f admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:02.429032 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1243/2487] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:02.458927 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b87b13-2528-4124-b65f-f80eb968164f admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:02.471077 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f24a38-94e1-4656-91d3-a70653b4aebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:02.472258 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f24a38-94e1-4656-91d3-a70653b4aebf admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:02.472652 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f24a38-94e1-4656-91d3-a70653b4aebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:02.473931 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f24a38-94e1-4656-91d3-a70653b4aebf admin admin] PATH_INFO: `/v3/projects/d8bc4d0525914cdd90671bedbf455145/users/2813ad04869a4431a7592b7fbe20b266/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:02.514251 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f24a38-94e1-4656-91d3-a70653b4aebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8bc4d0525914cdd90671bedbf455145, user_id=2813ad04869a4431a7592b7fbe20b266, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:02.518973 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f24a38-94e1-4656-91d3-a70653b4aebf admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:02.546982 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1245/2488] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:34:02 2022] PUT /identity/v3/projects/d8bc4d0525914cdd90671bedbf455145/users/2813ad04869a4431a7592b7fbe20b266/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:34:02.567304 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2ceb5-5158-4f7f-8f82-6564f995fb4a None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:02.567706 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2ceb5-5158-4f7f-8f82-6564f995fb4a None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:02.568092 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2ceb5-5158-4f7f-8f82-6564f995fb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:02.618151 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-dce2ceb5-5158-4f7f-8f82-6564f995fb4a None None] MFA Rules not processed for user `2813ad04869a4431a7592b7fbe20b266`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:02.620649 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-dce2ceb5-5158-4f7f-8f82-6564f995fb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:02.743310 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1244/2489] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:02.747899 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f24a38-94e1-4656-91d3-a70653b4aebf admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:02.922330 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f24a38-94e1-4656-91d3-a70653b4aebf admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:02.932401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3edb9d-5c01-4d3e-b47e-381a33e3f018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:02.933427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3edb9d-5c01-4d3e-b47e-381a33e3f018 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:02.934420 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3edb9d-5c01-4d3e-b47e-381a33e3f018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:02.934923 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3edb9d-5c01-4d3e-b47e-381a33e3f018 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:02.936120 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3edb9d-5c01-4d3e-b47e-381a33e3f018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:02.941035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3edb9d-5c01-4d3e-b47e-381a33e3f018 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:02.996061 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1246/2490] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:34:02 2022] POST /identity/v3/projects => generated 363 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:34:03.003721 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2ceb5-5158-4f7f-8f82-6564f995fb4a None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:03.023449 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2ceb5-5158-4f7f-8f82-6564f995fb4a None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:03.181517 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8a62e-5fc6-4d71-8852-3ab4ca203f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:03.182156 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8a62e-5fc6-4d71-8852-3ab4ca203f39 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:03.183324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8a62e-5fc6-4d71-8852-3ab4ca203f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:03.183324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8a62e-5fc6-4d71-8852-3ab4ca203f39 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:03.183718 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8a62e-5fc6-4d71-8852-3ab4ca203f39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:03.189317 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8a62e-5fc6-4d71-8852-3ab4ca203f39 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:03.263597 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1245/2491] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:34:03 2022] POST /identity/v3/users => generated 288 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:34:03.268929 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3edb9d-5c01-4d3e-b47e-381a33e3f018 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:03.301154 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3edb9d-5c01-4d3e-b47e-381a33e3f018 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:03.318426 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354b3f1-04aa-4b61-bc80-a077a136ffe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:03.319670 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354b3f1-04aa-4b61-bc80-a077a136ffe9 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:03.320970 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354b3f1-04aa-4b61-bc80-a077a136ffe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:03.322756 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354b3f1-04aa-4b61-bc80-a077a136ffe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:03.325065 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354b3f1-04aa-4b61-bc80-a077a136ffe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:03.329396 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354b3f1-04aa-4b61-bc80-a077a136ffe9 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:03.361795 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1247/2492] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:03.365261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8a62e-5fc6-4d71-8852-3ab4ca203f39 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:03.388769 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8a62e-5fc6-4d71-8852-3ab4ca203f39 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:03.414171 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33acf561-0b54-4700-aca0-d585a08d61c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:03.415407 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acf561-0b54-4700-aca0-d585a08d61c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:03.415905 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acf561-0b54-4700-aca0-d585a08d61c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:03.416376 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acf561-0b54-4700-aca0-d585a08d61c5 admin admin] PATH_INFO: `/v3/projects/927e310440bd44bbaeb01fd36f9ea7a4/users/e6e848c81bf34a40a6ac7415f987efc4/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:03.448220 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33acf561-0b54-4700-aca0-d585a08d61c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=927e310440bd44bbaeb01fd36f9ea7a4, user_id=e6e848c81bf34a40a6ac7415f987efc4, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:03.454901 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33acf561-0b54-4700-aca0-d585a08d61c5 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:03.491842 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1246/2493] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:34:03 2022] PUT /identity/v3/projects/927e310440bd44bbaeb01fd36f9ea7a4/users/e6e848c81bf34a40a6ac7415f987efc4/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:03.496360 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354b3f1-04aa-4b61-bc80-a077a136ffe9 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:03.516798 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354b3f1-04aa-4b61-bc80-a077a136ffe9 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:03.587668 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:03.666463 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0715c-b725-4d50-a2b7-0c68d8fa83fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:03.668847 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0715c-b725-4d50-a2b7-0c68d8fa83fd admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:03.669696 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0715c-b725-4d50-a2b7-0c68d8fa83fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:03.671242 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0715c-b725-4d50-a2b7-0c68d8fa83fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:03.673873 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd0715c-b725-4d50-a2b7-0c68d8fa83fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:03.680049 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd0715c-b725-4d50-a2b7-0c68d8fa83fd admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:03.728509 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1248/2494] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:34:03.736076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33acf561-0b54-4700-aca0-d585a08d61c5 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:03.762899 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33acf561-0b54-4700-aca0-d585a08d61c5 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:03.768484 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c73336-7b9c-4461-84b8-6431b0136638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:03.769196 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c73336-7b9c-4461-84b8-6431b0136638 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:03.769639 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c73336-7b9c-4461-84b8-6431b0136638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:03.769929 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c73336-7b9c-4461-84b8-6431b0136638 admin admin] PATH_INFO: `/v3/projects/927e310440bd44bbaeb01fd36f9ea7a4/users/e6e848c81bf34a40a6ac7415f987efc4/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:03.776647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c73336-7b9c-4461-84b8-6431b0136638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=927e310440bd44bbaeb01fd36f9ea7a4, user_id=e6e848c81bf34a40a6ac7415f987efc4, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:03.780465 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c73336-7b9c-4461-84b8-6431b0136638 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:03.805249 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1247/2495] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:34:03 2022] PUT /identity/v3/projects/927e310440bd44bbaeb01fd36f9ea7a4/users/e6e848c81bf34a40a6ac7415f987efc4/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:34:03.824182 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabbf53-f3a2-4163-a579-dd2fc6e09a20 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:03.824667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabbf53-f3a2-4163-a579-dd2fc6e09a20 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:03.825171 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabbf53-f3a2-4163-a579-dd2fc6e09a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:03.899250 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-beabbf53-f3a2-4163-a579-dd2fc6e09a20 None None] MFA Rules not processed for user `e6e848c81bf34a40a6ac7415f987efc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:03.913194 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-beabbf53-f3a2-4163-a579-dd2fc6e09a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:04.143363 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1249/2496] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:03 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:34:04.164883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c73336-7b9c-4461-84b8-6431b0136638 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:04.167651 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-59c73336-7b9c-4461-84b8-6431b0136638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:04.300643 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:04.360669 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c73336-7b9c-4461-84b8-6431b0136638 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:04.379503 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68767a4-0746-4841-8b70-9eb82f241c26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:04.380152 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68767a4-0746-4841-8b70-9eb82f241c26 service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:04.380430 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68767a4-0746-4841-8b70-9eb82f241c26 service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:04.380699 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68767a4-0746-4841-8b70-9eb82f241c26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:04.415786 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68767a4-0746-4841-8b70-9eb82f241c26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:04.417275 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68767a4-0746-4841-8b70-9eb82f241c26 service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:04.469070 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1248/2497] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:34:04.474931 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5b9a9-45da-429b-aaf2-c7da9dfe491d None None] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:04.475467 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5b9a9-45da-429b-aaf2-c7da9dfe491d None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:04.475467 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5b9a9-45da-429b-aaf2-c7da9dfe491d None None] PATH_INFO: `/` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:04.478992 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1250/2498] 10.222.0.77 () {54 vars in 921 bytes} [Tue Aug 23 22:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:34:04.498822 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517feeda-8fb4-4ee8-b7ab-e19074f53b42 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:04.499107 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517feeda-8fb4-4ee8-b7ab-e19074f53b42 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:04.499412 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517feeda-8fb4-4ee8-b7ab-e19074f53b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:04.550085 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-517feeda-8fb4-4ee8-b7ab-e19074f53b42 None None] MFA Rules not processed for user `84ea6fbc3de84b7db9e62b9ee6055c52`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:04.551633 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-517feeda-8fb4-4ee8-b7ab-e19074f53b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:04.759022 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1249/2499] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Aug 23 22:34:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:04.877359 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5b9a9-45da-429b-aaf2-c7da9dfe491d None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:04.890797 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-38f5b9a9-45da-429b-aaf2-c7da9dfe491d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:04.957063 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5b9a9-45da-429b-aaf2-c7da9dfe491d None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:04.994340 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b764ff-bfdc-4737-822e-fe3aec2b493b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:04.995363 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b764ff-bfdc-4737-822e-fe3aec2b493b service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:04.995896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b764ff-bfdc-4737-822e-fe3aec2b493b service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:04.996985 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b764ff-bfdc-4737-822e-fe3aec2b493b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:05.017804 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b764ff-bfdc-4737-822e-fe3aec2b493b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:05.021056 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b764ff-bfdc-4737-822e-fe3aec2b493b service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:05.077358 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1251/2500] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:34:05.372380 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828eff9-9ca0-4d76-90e5-8e0abe6afbb4 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:05.372850 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828eff9-9ca0-4d76-90e5-8e0abe6afbb4 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:05.373296 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828eff9-9ca0-4d76-90e5-8e0abe6afbb4 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:05.375075 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1250/2501] 10.222.0.77 () {54 vars in 921 bytes} [Tue Aug 23 22:34:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:34:05.384943 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb4dee-ff16-4631-9c1a-77b0ff5a06c6 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:05.385526 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb4dee-ff16-4631-9c1a-77b0ff5a06c6 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:05.386039 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb4dee-ff16-4631-9c1a-77b0ff5a06c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:05.439809 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-a1eb4dee-ff16-4631-9c1a-77b0ff5a06c6 None None] MFA Rules not processed for user `1a0af5bf009b48a8915c7320b16d08dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:05.442741 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-a1eb4dee-ff16-4631-9c1a-77b0ff5a06c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:05.553739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828eff9-9ca0-4d76-90e5-8e0abe6afbb4 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:05.708910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1252/2502] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Aug 23 22:34:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:34:05.720997 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb4dee-ff16-4631-9c1a-77b0ff5a06c6 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:05.722649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-a1eb4dee-ff16-4631-9c1a-77b0ff5a06c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:05.749307 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb4dee-ff16-4631-9c1a-77b0ff5a06c6 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:05.755215 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828eff9-9ca0-4d76-90e5-8e0abe6afbb4 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:05.761680 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2cccc2-6765-40cb-a82d-bf09d3f917b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:05.763552 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cccc2-6765-40cb-a82d-bf09d3f917b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:05.764415 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cccc2-6765-40cb-a82d-bf09d3f917b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:05.765872 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cccc2-6765-40cb-a82d-bf09d3f917b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:05.774372 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db31557-44f5-4090-bb66-c29b8aebc8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:05.774372 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db31557-44f5-4090-bb66-c29b8aebc8a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:05.774372 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db31557-44f5-4090-bb66-c29b8aebc8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:05.774372 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db31557-44f5-4090-bb66-c29b8aebc8a0 admin admin] PATH_INFO: `/v3/users/2813ad04869a4431a7592b7fbe20b266` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:05.778408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db31557-44f5-4090-bb66-c29b8aebc8a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2813ad04869a4431a7592b7fbe20b266)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:05.794938 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db31557-44f5-4090-bb66-c29b8aebc8a0 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:05.809425 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2cccc2-6765-40cb-a82d-bf09d3f917b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:05.814429 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2cccc2-6765-40cb-a82d-bf09d3f917b8 service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:05.836348 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1253/2503] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:34:05.916398 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-3db31557-44f5-4090-bb66-c29b8aebc8a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2813ad04869a4431a7592b7fbe20b266'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:05.917207 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-3db31557-44f5-4090-bb66-c29b8aebc8a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2813ad04869a4431a7592b7fbe20b266'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:05.940061 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-3db31557-44f5-4090-bb66-c29b8aebc8a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2813ad04869a4431a7592b7fbe20b266'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:05.969020 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-3db31557-44f5-4090-bb66-c29b8aebc8a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2813ad04869a4431a7592b7fbe20b266'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:05.993177 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2cccc2-6765-40cb-a82d-bf09d3f917b8 service neutron] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:05.995147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-1e2cccc2-6765-40cb-a82d-bf09d3f917b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:06.037494 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-3db31557-44f5-4090-bb66-c29b8aebc8a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2813ad04869a4431a7592b7fbe20b266'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:06.060622 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1251/2504] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:34:05 2022] DELETE /identity/v3/users/2813ad04869a4431a7592b7fbe20b266 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:34:06.066138 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fda3e-1675-4410-9737-2118e1a37b43 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:06.066456 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fda3e-1675-4410-9737-2118e1a37b43 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:06.066880 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fda3e-1675-4410-9737-2118e1a37b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:06.083785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:06.161830 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-2d3fda3e-1675-4410-9737-2118e1a37b43 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:06.164615 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-2d3fda3e-1675-4410-9737-2118e1a37b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:06.179093 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:06.257694 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2cccc2-6765-40cb-a82d-bf09d3f917b8 service neutron] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:06.443659 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1252/2505] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:06.486707 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3fda3e-1675-4410-9737-2118e1a37b43 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:06.489091 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-2d3fda3e-1675-4410-9737-2118e1a37b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:06.518170 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24722e-03a6-4803-9187-edd8f95f6b95 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2000b80e34ae45d2a8b658cd394419f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:06.519236 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24722e-03a6-4803-9187-edd8f95f6b95 service placement] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:06.519752 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24722e-03a6-4803-9187-edd8f95f6b95 service placement] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:06.522908 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24722e-03a6-4803-9187-edd8f95f6b95 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:06.530230 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-5f24722e-03a6-4803-9187-edd8f95f6b95 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:06.562317 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24722e-03a6-4803-9187-edd8f95f6b95 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:06.565504 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24722e-03a6-4803-9187-edd8f95f6b95 service placement] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:06.592422 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1254/2506] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:34:06.726369 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3fda3e-1675-4410-9737-2118e1a37b43 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:06.771544 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5593c15-aca1-482e-898e-37a56c5df15f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:06.778722 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5593c15-aca1-482e-898e-37a56c5df15f service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:06.779436 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5593c15-aca1-482e-898e-37a56c5df15f service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:06.781125 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5593c15-aca1-482e-898e-37a56c5df15f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:06.806916 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24722e-03a6-4803-9187-edd8f95f6b95 service placement] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:06.809040 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-5f24722e-03a6-4803-9187-edd8f95f6b95 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:06.823023 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5593c15-aca1-482e-898e-37a56c5df15f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:06.830127 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5593c15-aca1-482e-898e-37a56c5df15f service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:06.895730 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1253/2507] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:34:07.040137 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24722e-03a6-4803-9187-edd8f95f6b95 service placement] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:07.047026 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc85be-e5c1-4678-bb4b-e9d194195d07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:07.048115 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc85be-e5c1-4678-bb4b-e9d194195d07 service nova] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:07.048786 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc85be-e5c1-4678-bb4b-e9d194195d07 service nova] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:07.049269 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc85be-e5c1-4678-bb4b-e9d194195d07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:07.051519 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-7bbc85be-e5c1-4678-bb4b-e9d194195d07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:07.075085 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc85be-e5c1-4678-bb4b-e9d194195d07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:07.077523 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc85be-e5c1-4678-bb4b-e9d194195d07 service nova] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:07.105132 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1255/2508] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:34:07.500061 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5593c15-aca1-482e-898e-37a56c5df15f service neutron] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:07.503388 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-d5593c15-aca1-482e-898e-37a56c5df15f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:07.554581 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5593c15-aca1-482e-898e-37a56c5df15f service neutron] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:07.570112 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c1e05-2fcf-4096-8183-a892774a574f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:07.571053 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c1e05-2fcf-4096-8183-a892774a574f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:07.571795 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c1e05-2fcf-4096-8183-a892774a574f admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:07.572214 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c1e05-2fcf-4096-8183-a892774a574f admin admin] PATH_INFO: `/v3/projects/d8bc4d0525914cdd90671bedbf455145` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:07.574515 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c1e05-2fcf-4096-8183-a892774a574f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8bc4d0525914cdd90671bedbf455145)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:07.579536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c1e05-2fcf-4096-8183-a892774a574f admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:07.679211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-ae4c1e05-2fcf-4096-8183-a892774a574f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8bc4d0525914cdd90671bedbf455145', 'request_id': 'req-ae4c1e05-2fcf-4096-8183-a892774a574f'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:07.702764 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-ae4c1e05-2fcf-4096-8183-a892774a574f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8bc4d0525914cdd90671bedbf455145', 'request_id': 'req-ae4c1e05-2fcf-4096-8183-a892774a574f'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:07.719013 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-ae4c1e05-2fcf-4096-8183-a892774a574f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8bc4d0525914cdd90671bedbf455145', 'request_id': 'req-ae4c1e05-2fcf-4096-8183-a892774a574f'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:07.749016 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-ae4c1e05-2fcf-4096-8183-a892774a574f admin admin] The token cache is being invalidate because project d8bc4d0525914cdd90671bedbf455145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:34:07.750076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-ae4c1e05-2fcf-4096-8183-a892774a574f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:07.752307 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-ae4c1e05-2fcf-4096-8183-a892774a574f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:07.755950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1254/2509] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:34:07 2022] DELETE /identity/v3/projects/d8bc4d0525914cdd90671bedbf455145 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:07.760481 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc85be-e5c1-4678-bb4b-e9d194195d07 service nova] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:07.783979 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc85be-e5c1-4678-bb4b-e9d194195d07 service nova] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:07.987712 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:08.074383 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7130517-2c79-4559-88dc-8f6048fcb52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:08.075721 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7130517-2c79-4559-88dc-8f6048fcb52d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:08.076005 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7130517-2c79-4559-88dc-8f6048fcb52d admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:08.076278 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7130517-2c79-4559-88dc-8f6048fcb52d admin admin] PATH_INFO: `/v3/users/e6e848c81bf34a40a6ac7415f987efc4` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:08.077730 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7130517-2c79-4559-88dc-8f6048fcb52d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6e848c81bf34a40a6ac7415f987efc4)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:08.080551 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7130517-2c79-4559-88dc-8f6048fcb52d admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:08.227069 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-d7130517-2c79-4559-88dc-8f6048fcb52d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6e848c81bf34a40a6ac7415f987efc4'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:08.229614 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-d7130517-2c79-4559-88dc-8f6048fcb52d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6e848c81bf34a40a6ac7415f987efc4'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:08.244006 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-d7130517-2c79-4559-88dc-8f6048fcb52d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6e848c81bf34a40a6ac7415f987efc4'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:08.266432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-d7130517-2c79-4559-88dc-8f6048fcb52d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6e848c81bf34a40a6ac7415f987efc4'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:08.276599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-d7130517-2c79-4559-88dc-8f6048fcb52d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6e848c81bf34a40a6ac7415f987efc4'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:08.304444 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1256/2510] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:34:07 2022] DELETE /identity/v3/users/e6e848c81bf34a40a6ac7415f987efc4 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:09.140846 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c1e05-2fcf-4096-8183-a892774a574f admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:09.143310 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-ae4c1e05-2fcf-4096-8183-a892774a574f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:09.165072 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c1e05-2fcf-4096-8183-a892774a574f admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:09.275345 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:09.336611 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba7152-9fcc-4ec5-b565-395c6ee4ed12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:09.337273 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba7152-9fcc-4ec5-b565-395c6ee4ed12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:09.337763 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba7152-9fcc-4ec5-b565-395c6ee4ed12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:09.338204 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba7152-9fcc-4ec5-b565-395c6ee4ed12 admin admin] PATH_INFO: `/v3/projects/927e310440bd44bbaeb01fd36f9ea7a4` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:09.340166 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fba7152-9fcc-4ec5-b565-395c6ee4ed12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=927e310440bd44bbaeb01fd36f9ea7a4)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:09.342761 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fba7152-9fcc-4ec5-b565-395c6ee4ed12 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:09.444206 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2fba7152-9fcc-4ec5-b565-395c6ee4ed12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '927e310440bd44bbaeb01fd36f9ea7a4', 'request_id': 'req-2fba7152-9fcc-4ec5-b565-395c6ee4ed12'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:09.454336 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2fba7152-9fcc-4ec5-b565-395c6ee4ed12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '927e310440bd44bbaeb01fd36f9ea7a4', 'request_id': 'req-2fba7152-9fcc-4ec5-b565-395c6ee4ed12'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:09.471301 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ec4ee-72f4-44d4-aecd-b32df13adf8c None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:09.471863 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ec4ee-72f4-44d4-aecd-b32df13adf8c None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:09.472234 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ec4ee-72f4-44d4-aecd-b32df13adf8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:09.473639 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2fba7152-9fcc-4ec5-b565-395c6ee4ed12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '927e310440bd44bbaeb01fd36f9ea7a4', 'request_id': 'req-2fba7152-9fcc-4ec5-b565-395c6ee4ed12'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:09.503429 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2fba7152-9fcc-4ec5-b565-395c6ee4ed12 admin admin] The token cache is being invalidate because project 927e310440bd44bbaeb01fd36f9ea7a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:34:09.503740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2fba7152-9fcc-4ec5-b565-395c6ee4ed12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:09.504705 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2fba7152-9fcc-4ec5-b565-395c6ee4ed12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:09.506937 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1255/2511] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:34:09 2022] DELETE /identity/v3/projects/927e310440bd44bbaeb01fd36f9ea7a4 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:09.517074 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be6fe5-7942-4a03-b950-13c91b54f878 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:09.517502 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be6fe5-7942-4a03-b950-13c91b54f878 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:09.518018 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be6fe5-7942-4a03-b950-13c91b54f878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:09.521150 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-052ec4ee-72f4-44d4-aecd-b32df13adf8c None None] MFA Rules not processed for user `57837f42a696417a9acbaba990a2830f`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:09.522813 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-052ec4ee-72f4-44d4-aecd-b32df13adf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:09.549511 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-72be6fe5-7942-4a03-b950-13c91b54f878 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:09.551066 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-72be6fe5-7942-4a03-b950-13c91b54f878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:09.638624 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1257/2512] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:09 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:09.647987 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1256/2513] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:09.652685 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ec4ee-72f4-44d4-aecd-b32df13adf8c None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:09.654734 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-052ec4ee-72f4-44d4-aecd-b32df13adf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:09.660329 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e816b-5377-4373-a960-50568309809e None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:09.660618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e816b-5377-4373-a960-50568309809e None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:09.660891 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e816b-5377-4373-a960-50568309809e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:09.700197 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-e57e816b-5377-4373-a960-50568309809e None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:09.701539 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-e57e816b-5377-4373-a960-50568309809e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:09.714066 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1257/2514] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:09.715886 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e816b-5377-4373-a960-50568309809e None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:09.722563 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:09.729230 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e816b-5377-4373-a960-50568309809e None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:09.737973 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5ff86-9d08-4e26-b066-69827d1e85ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:09.738841 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5ff86-9d08-4e26-b066-69827d1e85ad admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:09.739120 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5ff86-9d08-4e26-b066-69827d1e85ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:09.739502 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5ff86-9d08-4e26-b066-69827d1e85ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:09.740272 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5ff86-9d08-4e26-b066-69827d1e85ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:34:09.740640 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5ff86-9d08-4e26-b066-69827d1e85ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:09.742407 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5ff86-9d08-4e26-b066-69827d1e85ad admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:09.744621 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ec4ee-72f4-44d4-aecd-b32df13adf8c None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:09.749207 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91c787-6320-47da-aa6e-e65ad3e46d7f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '855cbc7a992d4c6697632d2d4d74abfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:09.749912 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91c787-6320-47da-aa6e-e65ad3e46d7f service glance] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:09.753126 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91c787-6320-47da-aa6e-e65ad3e46d7f service glance] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:09.753126 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91c787-6320-47da-aa6e-e65ad3e46d7f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:09.753126 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-8e91c787-6320-47da-aa6e-e65ad3e46d7f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:09.760458 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1258/2515] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:34:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:34:09.764793 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5ff86-9d08-4e26-b066-69827d1e85ad admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:09.793414 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5ff86-9d08-4e26-b066-69827d1e85ad admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:09.807641 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bccf7e-1a9c-41d2-86d8-2b4fdbac6ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:09.808272 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bccf7e-1a9c-41d2-86d8-2b4fdbac6ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:09.808687 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bccf7e-1a9c-41d2-86d8-2b4fdbac6ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:09.808968 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bccf7e-1a9c-41d2-86d8-2b4fdbac6ba2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:09.809928 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bccf7e-1a9c-41d2-86d8-2b4fdbac6ba2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:09.811883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bccf7e-1a9c-41d2-86d8-2b4fdbac6ba2 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:09.835674 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91c787-6320-47da-aa6e-e65ad3e46d7f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:09.837113 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91c787-6320-47da-aa6e-e65ad3e46d7f service glance] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:09.840487 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1259/2516] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:34:09 2022] POST /identity/v3/projects => generated 367 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:34:09.846296 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bccf7e-1a9c-41d2-86d8-2b4fdbac6ba2 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:09.847355 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1258/2517] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:09 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:34:09.883268 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:09.929031 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bccf7e-1a9c-41d2-86d8-2b4fdbac6ba2 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:09.933779 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c595cc-4859-4572-bcb5-ffa947c7e19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:09.934398 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c595cc-4859-4572-bcb5-ffa947c7e19a admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:09.934676 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c595cc-4859-4572-bcb5-ffa947c7e19a admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:09.934945 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c595cc-4859-4572-bcb5-ffa947c7e19a admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:09.935575 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c595cc-4859-4572-bcb5-ffa947c7e19a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:09.937537 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c595cc-4859-4572-bcb5-ffa947c7e19a admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:09.979533 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91c787-6320-47da-aa6e-e65ad3e46d7f service glance] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:09.991265 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1260/2518] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:34:09 2022] POST /identity/v3/users => generated 284 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:34:09.998656 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91c787-6320-47da-aa6e-e65ad3e46d7f service glance] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:10.008777 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a4f0d-1761-44e9-bc2a-e501a08c03cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:10.015228 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a4f0d-1761-44e9-bc2a-e501a08c03cb admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:10.015855 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a4f0d-1761-44e9-bc2a-e501a08c03cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:10.016718 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a4f0d-1761-44e9-bc2a-e501a08c03cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:10.018034 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a4f0d-1761-44e9-bc2a-e501a08c03cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:10.020717 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a4f0d-1761-44e9-bc2a-e501a08c03cb admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:10.039809 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1259/2519] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:10.049759 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c595cc-4859-4572-bcb5-ffa947c7e19a admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:10.066132 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92856dfc-19f8-44a8-bef2-7985067840d8 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:10.067192 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92856dfc-19f8-44a8-bef2-7985067840d8 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:10.067542 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c595cc-4859-4572-bcb5-ffa947c7e19a admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:10.067680 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92856dfc-19f8-44a8-bef2-7985067840d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:10.072542 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6325807-2e49-40a0-a13e-7ff8c03ac2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:10.073161 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6325807-2e49-40a0-a13e-7ff8c03ac2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:10.073473 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6325807-2e49-40a0-a13e-7ff8c03ac2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:10.073752 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6325807-2e49-40a0-a13e-7ff8c03ac2f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:10.074426 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6325807-2e49-40a0-a13e-7ff8c03ac2f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:10.076046 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6325807-2e49-40a0-a13e-7ff8c03ac2f9 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:10.087387 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1261/2520] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:10.091672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6325807-2e49-40a0-a13e-7ff8c03ac2f9 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:10.095985 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-92856dfc-19f8-44a8-bef2-7985067840d8 None None] MFA Rules not processed for user `02e415eb75984daa97ee79fc0146f318`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:10.097298 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-92856dfc-19f8-44a8-bef2-7985067840d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:10.104069 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6325807-2e49-40a0-a13e-7ff8c03ac2f9 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:10.109582 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c78dec-9145-4182-bd7a-d91a74a83d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:10.110888 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c78dec-9145-4182-bd7a-d91a74a83d4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:10.111174 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c78dec-9145-4182-bd7a-d91a74a83d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:10.111534 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c78dec-9145-4182-bd7a-d91a74a83d4d admin admin] PATH_INFO: `/v3/projects/3e68268ede2b4909976ba1784439bdc6/users/f7b030354f7c4aa692c5d73f304bfd93/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:10.134431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c78dec-9145-4182-bd7a-d91a74a83d4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e68268ede2b4909976ba1784439bdc6, user_id=f7b030354f7c4aa692c5d73f304bfd93, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:10.137076 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c78dec-9145-4182-bd7a-d91a74a83d4d admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:10.153971 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1262/2521] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:34:10 2022] PUT /identity/v3/projects/3e68268ede2b4909976ba1784439bdc6/users/f7b030354f7c4aa692c5d73f304bfd93/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:34:10.169591 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6518240-eef7-4a1e-b0a6-f18d8cf341f8 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:10.170031 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6518240-eef7-4a1e-b0a6-f18d8cf341f8 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:10.170426 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6518240-eef7-4a1e-b0a6-f18d8cf341f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:10.172748 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1260/2522] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Aug 23 22:34:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:10.215331 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-a6518240-eef7-4a1e-b0a6-f18d8cf341f8 None None] MFA Rules not processed for user `f7b030354f7c4aa692c5d73f304bfd93`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:10.217497 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-a6518240-eef7-4a1e-b0a6-f18d8cf341f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:10.238871 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92856dfc-19f8-44a8-bef2-7985067840d8 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:10.241201 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-92856dfc-19f8-44a8-bef2-7985067840d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:10.318474 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1263/2523] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:34:10.322662 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6518240-eef7-4a1e-b0a6-f18d8cf341f8 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:10.401302 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92856dfc-19f8-44a8-bef2-7985067840d8 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:10.467575 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6518240-eef7-4a1e-b0a6-f18d8cf341f8 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:10.476400 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775a4bc-3c02-436b-a5f7-d6bd92aa1471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:10.477036 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775a4bc-3c02-436b-a5f7-d6bd92aa1471 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:10.477323 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775a4bc-3c02-436b-a5f7-d6bd92aa1471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:10.477647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775a4bc-3c02-436b-a5f7-d6bd92aa1471 admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:10.478892 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775a4bc-3c02-436b-a5f7-d6bd92aa1471 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:10.481044 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:10.482229 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775a4bc-3c02-436b-a5f7-d6bd92aa1471 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:10.512025 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:10.535635 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1264/2524] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:34:10 2022] POST /identity/v3/projects => generated 369 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:34:10.537517 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775a4bc-3c02-436b-a5f7-d6bd92aa1471 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:10.545728 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49945ded-13b2-4b87-a45f-b7c0dd8ee658 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abda1f23a18c4c808483cd6b53952975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:10.547924 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49945ded-13b2-4b87-a45f-b7c0dd8ee658 service swift] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:10.548491 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49945ded-13b2-4b87-a45f-b7c0dd8ee658 service swift] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:10.548828 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49945ded-13b2-4b87-a45f-b7c0dd8ee658 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:10.630518 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49945ded-13b2-4b87-a45f-b7c0dd8ee658 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:10.632355 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49945ded-13b2-4b87-a45f-b7c0dd8ee658 service swift] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:10.642875 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1261/2525] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Aug 23 22:34:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 22:34:10.649035 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775a4bc-3c02-436b-a5f7-d6bd92aa1471 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:10.654456 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049e378-0530-4933-a284-32f283b8a31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:10.655094 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049e378-0530-4933-a284-32f283b8a31c admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:10.655373 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049e378-0530-4933-a284-32f283b8a31c admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:10.655715 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049e378-0530-4933-a284-32f283b8a31c admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:10.656687 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049e378-0530-4933-a284-32f283b8a31c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:10.658671 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049e378-0530-4933-a284-32f283b8a31c admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:10.697749 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1265/2526] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:34:10 2022] POST /identity/v3/users => generated 291 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:34:10.698059 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49945ded-13b2-4b87-a45f-b7c0dd8ee658 service swift] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:10.728630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49945ded-13b2-4b87-a45f-b7c0dd8ee658 service swift] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:10.746909 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d72510-4ac4-48e7-8af4-75ed16cf542e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:10.748940 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d72510-4ac4-48e7-8af4-75ed16cf542e admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:10.748940 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d72510-4ac4-48e7-8af4-75ed16cf542e admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:10.748940 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d72510-4ac4-48e7-8af4-75ed16cf542e admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:10.749273 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d72510-4ac4-48e7-8af4-75ed16cf542e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:10.752065 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d72510-4ac4-48e7-8af4-75ed16cf542e admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:10.776921 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1262/2527] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:10.781042 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049e378-0530-4933-a284-32f283b8a31c admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:10.806687 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049e378-0530-4933-a284-32f283b8a31c admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:10.822859 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3db60-e78d-4f12-a3b1-3d2ab7f15697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:10.824908 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3db60-e78d-4f12-a3b1-3d2ab7f15697 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:10.825312 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3db60-e78d-4f12-a3b1-3d2ab7f15697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:10.825732 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3db60-e78d-4f12-a3b1-3d2ab7f15697 admin admin] PATH_INFO: `/v3/projects/9553f34c473b4518ac848a1741799a07/users/093103b931184150bfd3b7be5b43353a/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:10.858050 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3db60-e78d-4f12-a3b1-3d2ab7f15697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9553f34c473b4518ac848a1741799a07, user_id=093103b931184150bfd3b7be5b43353a, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:10.864101 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3db60-e78d-4f12-a3b1-3d2ab7f15697 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:10.894246 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1266/2528] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:34:10 2022] PUT /identity/v3/projects/9553f34c473b4518ac848a1741799a07/users/093103b931184150bfd3b7be5b43353a/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:34:10.898003 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d72510-4ac4-48e7-8af4-75ed16cf542e admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:10.917351 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d72510-4ac4-48e7-8af4-75ed16cf542e admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:11.075420 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5a4d4-d3bb-4c0a-ae0b-f0b01af086be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:11.076521 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5a4d4-d3bb-4c0a-ae0b-f0b01af086be admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:11.077454 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5a4d4-d3bb-4c0a-ae0b-f0b01af086be admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:11.077454 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5a4d4-d3bb-4c0a-ae0b-f0b01af086be admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:11.079580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d5a4d4-d3bb-4c0a-ae0b-f0b01af086be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:11.081122 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d5a4d4-d3bb-4c0a-ae0b-f0b01af086be admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:11.112164 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1263/2529] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:34:11.128387 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3db60-e78d-4f12-a3b1-3d2ab7f15697 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:11.155395 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3db60-e78d-4f12-a3b1-3d2ab7f15697 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:11.189824 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f8091-5944-4677-8acf-c6917f346b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:11.190542 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f8091-5944-4677-8acf-c6917f346b5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:11.193924 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f8091-5944-4677-8acf-c6917f346b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:11.194146 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f8091-5944-4677-8acf-c6917f346b5e admin admin] PATH_INFO: `/v3/projects/9553f34c473b4518ac848a1741799a07/users/093103b931184150bfd3b7be5b43353a/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:11.196936 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f8091-5944-4677-8acf-c6917f346b5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9553f34c473b4518ac848a1741799a07, user_id=093103b931184150bfd3b7be5b43353a, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:11.200161 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f8091-5944-4677-8acf-c6917f346b5e admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:11.235336 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1267/2530] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:34:11 2022] PUT /identity/v3/projects/9553f34c473b4518ac848a1741799a07/users/093103b931184150bfd3b7be5b43353a/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:11.247321 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d1302-3b60-4d63-83af-925c80d1de66 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:11.248095 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d1302-3b60-4d63-83af-925c80d1de66 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:11.248565 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d1302-3b60-4d63-83af-925c80d1de66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:11.310445 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-8e4d1302-3b60-4d63-83af-925c80d1de66 None None] MFA Rules not processed for user `093103b931184150bfd3b7be5b43353a`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:11.311491 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-8e4d1302-3b60-4d63-83af-925c80d1de66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:11.425590 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:11.488362 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1264/2531] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:11 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:11.496929 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f8091-5944-4677-8acf-c6917f346b5e admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:11.499251 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-663f8091-5944-4677-8acf-c6917f346b5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:11.627436 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f8091-5944-4677-8acf-c6917f346b5e admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:11.636724 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01020d06-ad5d-469f-8ea7-6ce0936bc6b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:11.644556 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01020d06-ad5d-469f-8ea7-6ce0936bc6b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:11.646224 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01020d06-ad5d-469f-8ea7-6ce0936bc6b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:11.647053 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01020d06-ad5d-469f-8ea7-6ce0936bc6b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:11.668454 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01020d06-ad5d-469f-8ea7-6ce0936bc6b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:11.672772 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01020d06-ad5d-469f-8ea7-6ce0936bc6b9 service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:11.690991 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1268/2532] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:11 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:34:14.427766 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d1302-3b60-4d63-83af-925c80d1de66 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:14.559292 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d1302-3b60-4d63-83af-925c80d1de66 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:14.567600 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541f633-429b-496c-8b1b-2b302c6cdf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:14.568283 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541f633-429b-496c-8b1b-2b302c6cdf3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:14.568576 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541f633-429b-496c-8b1b-2b302c6cdf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:14.568856 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541f633-429b-496c-8b1b-2b302c6cdf3f admin admin] PATH_INFO: `/v3/users/f7b030354f7c4aa692c5d73f304bfd93` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:14.570695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541f633-429b-496c-8b1b-2b302c6cdf3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7b030354f7c4aa692c5d73f304bfd93)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:14.572702 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541f633-429b-496c-8b1b-2b302c6cdf3f admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:14.658296 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-3541f633-429b-496c-8b1b-2b302c6cdf3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7b030354f7c4aa692c5d73f304bfd93'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:14.659302 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-3541f633-429b-496c-8b1b-2b302c6cdf3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7b030354f7c4aa692c5d73f304bfd93'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:14.675474 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-3541f633-429b-496c-8b1b-2b302c6cdf3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7b030354f7c4aa692c5d73f304bfd93'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:14.688919 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-3541f633-429b-496c-8b1b-2b302c6cdf3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7b030354f7c4aa692c5d73f304bfd93'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:14.690081 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-3541f633-429b-496c-8b1b-2b302c6cdf3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7b030354f7c4aa692c5d73f304bfd93'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:14.729707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1265/2533] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:34:14 2022] DELETE /identity/v3/users/f7b030354f7c4aa692c5d73f304bfd93 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:14.738733 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f4746-ce52-46ad-81a4-841c10e84fde None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:14.738733 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f4746-ce52-46ad-81a4-841c10e84fde None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:14.738733 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f4746-ce52-46ad-81a4-841c10e84fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:14.806127 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-590f4746-ce52-46ad-81a4-841c10e84fde None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:14.807771 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-590f4746-ce52-46ad-81a4-841c10e84fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:14.893991 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:14.957405 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1269/2534] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:34:14.971214 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541f633-429b-496c-8b1b-2b302c6cdf3f admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:14.972881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-3541f633-429b-496c-8b1b-2b302c6cdf3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:15.077209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541f633-429b-496c-8b1b-2b302c6cdf3f admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:15.095342 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f87b8-21a8-4407-9488-91475f549cb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:15.096395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f87b8-21a8-4407-9488-91475f549cb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:15.096648 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f87b8-21a8-4407-9488-91475f549cb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:15.097085 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f87b8-21a8-4407-9488-91475f549cb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:15.115066 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f87b8-21a8-4407-9488-91475f549cb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:15.116706 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f87b8-21a8-4407-9488-91475f549cb4 service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:15.129329 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1266/2535] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:34:15.922789 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f4746-ce52-46ad-81a4-841c10e84fde None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:15.925135 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-590f4746-ce52-46ad-81a4-841c10e84fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:15.957925 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f4746-ce52-46ad-81a4-841c10e84fde None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:15.971666 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90157b3-909c-4ff2-92a5-3f6037bf6822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:15.972362 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90157b3-909c-4ff2-92a5-3f6037bf6822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:15.972642 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90157b3-909c-4ff2-92a5-3f6037bf6822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:15.973098 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90157b3-909c-4ff2-92a5-3f6037bf6822 admin admin] PATH_INFO: `/v3/projects/3e68268ede2b4909976ba1784439bdc6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:15.976943 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90157b3-909c-4ff2-92a5-3f6037bf6822 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e68268ede2b4909976ba1784439bdc6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:15.982759 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90157b3-909c-4ff2-92a5-3f6037bf6822 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:16.096762 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-d90157b3-909c-4ff2-92a5-3f6037bf6822 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e68268ede2b4909976ba1784439bdc6', 'request_id': 'req-d90157b3-909c-4ff2-92a5-3f6037bf6822'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:16.104107 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-d90157b3-909c-4ff2-92a5-3f6037bf6822 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e68268ede2b4909976ba1784439bdc6', 'request_id': 'req-d90157b3-909c-4ff2-92a5-3f6037bf6822'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:16.120346 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-d90157b3-909c-4ff2-92a5-3f6037bf6822 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e68268ede2b4909976ba1784439bdc6', 'request_id': 'req-d90157b3-909c-4ff2-92a5-3f6037bf6822'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:16.153109 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-d90157b3-909c-4ff2-92a5-3f6037bf6822 admin admin] The token cache is being invalidate because project 3e68268ede2b4909976ba1784439bdc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:34:16.153601 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-d90157b3-909c-4ff2-92a5-3f6037bf6822 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:16.154327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-d90157b3-909c-4ff2-92a5-3f6037bf6822 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:16.159744 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1270/2536] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:34:15 2022] DELETE /identity/v3/projects/3e68268ede2b4909976ba1784439bdc6 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:16.161534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f87b8-21a8-4407-9488-91475f549cb4 service neutron] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:16.172450 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f87b8-21a8-4407-9488-91475f549cb4 service neutron] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:16.179017 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:16.255660 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690011e3-2149-4f7c-9154-818fbdc81566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:16.256331 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690011e3-2149-4f7c-9154-818fbdc81566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:16.256654 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690011e3-2149-4f7c-9154-818fbdc81566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:16.256933 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690011e3-2149-4f7c-9154-818fbdc81566 admin admin] PATH_INFO: `/v3/users/093103b931184150bfd3b7be5b43353a` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:16.258331 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690011e3-2149-4f7c-9154-818fbdc81566 admin admin] RBAC: Authorizing `identity:delete_user(user_id=093103b931184150bfd3b7be5b43353a)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:16.260549 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690011e3-2149-4f7c-9154-818fbdc81566 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:16.432829 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-690011e3-2149-4f7c-9154-818fbdc81566 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '093103b931184150bfd3b7be5b43353a'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:16.435381 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-690011e3-2149-4f7c-9154-818fbdc81566 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '093103b931184150bfd3b7be5b43353a'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:16.460942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-690011e3-2149-4f7c-9154-818fbdc81566 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '093103b931184150bfd3b7be5b43353a'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:16.485457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-690011e3-2149-4f7c-9154-818fbdc81566 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '093103b931184150bfd3b7be5b43353a'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:16.486311 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-690011e3-2149-4f7c-9154-818fbdc81566 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '093103b931184150bfd3b7be5b43353a'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:16.577264 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1267/2537] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:34:16 2022] DELETE /identity/v3/users/093103b931184150bfd3b7be5b43353a => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:17.264207 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90157b3-909c-4ff2-92a5-3f6037bf6822 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:17.268886 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-d90157b3-909c-4ff2-92a5-3f6037bf6822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:17.304464 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90157b3-909c-4ff2-92a5-3f6037bf6822 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:17.469876 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690011e3-2149-4f7c-9154-818fbdc81566 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:17.471370 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-690011e3-2149-4f7c-9154-818fbdc81566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:17.497558 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3a217-b70c-479a-8ac2-d315b1b75699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:17.505618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3a217-b70c-479a-8ac2-d315b1b75699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:17.506714 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3a217-b70c-479a-8ac2-d315b1b75699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:17.507228 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3a217-b70c-479a-8ac2-d315b1b75699 admin admin] PATH_INFO: `/v3/projects/9553f34c473b4518ac848a1741799a07` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:17.511975 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3a217-b70c-479a-8ac2-d315b1b75699 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9553f34c473b4518ac848a1741799a07)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:17.520109 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3a217-b70c-479a-8ac2-d315b1b75699 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:17.705624 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-f6e3a217-b70c-479a-8ac2-d315b1b75699 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9553f34c473b4518ac848a1741799a07', 'request_id': 'req-f6e3a217-b70c-479a-8ac2-d315b1b75699'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:17.718709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-f6e3a217-b70c-479a-8ac2-d315b1b75699 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9553f34c473b4518ac848a1741799a07', 'request_id': 'req-f6e3a217-b70c-479a-8ac2-d315b1b75699'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:17.730788 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690011e3-2149-4f7c-9154-818fbdc81566 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:17.751813 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-f6e3a217-b70c-479a-8ac2-d315b1b75699 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9553f34c473b4518ac848a1741799a07', 'request_id': 'req-f6e3a217-b70c-479a-8ac2-d315b1b75699'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:17.813896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:17.816430 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-f6e3a217-b70c-479a-8ac2-d315b1b75699 admin admin] The token cache is being invalidate because project 9553f34c473b4518ac848a1741799a07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:34:17.816961 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-f6e3a217-b70c-479a-8ac2-d315b1b75699 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:17.818894 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-f6e3a217-b70c-479a-8ac2-d315b1b75699 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:17.822551 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1271/2538] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:34:17 2022] DELETE /identity/v3/projects/9553f34c473b4518ac848a1741799a07 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:17.850440 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf847d7-34c2-4876-9c59-1af5fa064907 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:17.851043 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf847d7-34c2-4876-9c59-1af5fa064907 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:17.851541 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf847d7-34c2-4876-9c59-1af5fa064907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:17.893283 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:17.912624 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-7cf847d7-34c2-4876-9c59-1af5fa064907 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:17.915001 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-7cf847d7-34c2-4876-9c59-1af5fa064907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:17.946565 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ddaac-41f9-4a56-aba2-960fe3399b86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:17.947300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ddaac-41f9-4a56-aba2-960fe3399b86 service nova] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:17.948795 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ddaac-41f9-4a56-aba2-960fe3399b86 service nova] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:17.949158 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ddaac-41f9-4a56-aba2-960fe3399b86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:17.956717 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-579ddaac-41f9-4a56-aba2-960fe3399b86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:17.991736 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ddaac-41f9-4a56-aba2-960fe3399b86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:17.996552 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ddaac-41f9-4a56-aba2-960fe3399b86 service nova] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:18.045307 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1268/2539] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:34:18.113408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1272/2540] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:18.118508 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecab553-426a-4876-8907-479f6df237cc None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:18.119296 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecab553-426a-4876-8907-479f6df237cc None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:18.119737 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecab553-426a-4876-8907-479f6df237cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:18.148015 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-fecab553-426a-4876-8907-479f6df237cc None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:18.150098 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-fecab553-426a-4876-8907-479f6df237cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:18.189796 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1269/2541] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:18.195961 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf847d7-34c2-4876-9c59-1af5fa064907 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:18.226211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf847d7-34c2-4876-9c59-1af5fa064907 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:18.234026 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b8102-126c-4976-967e-9f1322dd64bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:18.235835 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b8102-126c-4976-967e-9f1322dd64bc admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:18.236326 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b8102-126c-4976-967e-9f1322dd64bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:18.236809 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b8102-126c-4976-967e-9f1322dd64bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:18.237766 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b8102-126c-4976-967e-9f1322dd64bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:34:18.238272 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b8102-126c-4976-967e-9f1322dd64bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:18.240584 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b8102-126c-4976-967e-9f1322dd64bc admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:18.273802 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1273/2542] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:34:18.278530 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecab553-426a-4876-8907-479f6df237cc None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:18.298410 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecab553-426a-4876-8907-479f6df237cc None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:18.315264 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25271b1-185e-4bec-92db-e900c9996678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:18.316253 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25271b1-185e-4bec-92db-e900c9996678 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:18.317136 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25271b1-185e-4bec-92db-e900c9996678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:18.317670 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25271b1-185e-4bec-92db-e900c9996678 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:18.318994 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25271b1-185e-4bec-92db-e900c9996678 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:18.328387 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25271b1-185e-4bec-92db-e900c9996678 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:18.411528 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1270/2543] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:34:18 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:34:18.420026 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b8102-126c-4976-967e-9f1322dd64bc admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:18.449177 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b8102-126c-4976-967e-9f1322dd64bc admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:18.558472 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879879c6-288a-40bb-ad75-834f91aac144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:18.559377 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879879c6-288a-40bb-ad75-834f91aac144 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:18.559852 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879879c6-288a-40bb-ad75-834f91aac144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:18.560206 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879879c6-288a-40bb-ad75-834f91aac144 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:18.560944 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879879c6-288a-40bb-ad75-834f91aac144 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:18.564068 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879879c6-288a-40bb-ad75-834f91aac144 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:18.608492 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1274/2544] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:34:18 2022] POST /identity/v3/users => generated 291 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:34:18.615707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25271b1-185e-4bec-92db-e900c9996678 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:18.636956 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25271b1-185e-4bec-92db-e900c9996678 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:18.649439 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de656e-a234-41b8-8f94-2ce8d74723a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:18.650806 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de656e-a234-41b8-8f94-2ce8d74723a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:18.651475 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de656e-a234-41b8-8f94-2ce8d74723a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:18.652097 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de656e-a234-41b8-8f94-2ce8d74723a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:18.654316 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de656e-a234-41b8-8f94-2ce8d74723a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:18.659954 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de656e-a234-41b8-8f94-2ce8d74723a6 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:18.686012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1271/2545] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:18.693038 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879879c6-288a-40bb-ad75-834f91aac144 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:18.713249 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879879c6-288a-40bb-ad75-834f91aac144 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:18.719765 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b852fde-c3a1-4de1-b6a5-c35a78f699c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:18.720655 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b852fde-c3a1-4de1-b6a5-c35a78f699c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:18.721053 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b852fde-c3a1-4de1-b6a5-c35a78f699c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:18.721475 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b852fde-c3a1-4de1-b6a5-c35a78f699c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:18.722364 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b852fde-c3a1-4de1-b6a5-c35a78f699c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:18.724296 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b852fde-c3a1-4de1-b6a5-c35a78f699c2 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:18.740560 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1275/2546] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:18.746584 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de656e-a234-41b8-8f94-2ce8d74723a6 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:18.769987 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de656e-a234-41b8-8f94-2ce8d74723a6 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:18.782453 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22809ccc-3928-4edd-a836-ab7dcced61a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:18.783818 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22809ccc-3928-4edd-a836-ab7dcced61a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:18.784116 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22809ccc-3928-4edd-a836-ab7dcced61a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:18.784401 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22809ccc-3928-4edd-a836-ab7dcced61a1 admin admin] PATH_INFO: `/v3/projects/a119917ce54744359577b584e37b99ff/users/4113b7f082b8420b973f286121f74372/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:18.808517 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22809ccc-3928-4edd-a836-ab7dcced61a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a119917ce54744359577b584e37b99ff, user_id=4113b7f082b8420b973f286121f74372, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:18.811611 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22809ccc-3928-4edd-a836-ab7dcced61a1 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:18.839402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1272/2547] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:34:18 2022] PUT /identity/v3/projects/a119917ce54744359577b584e37b99ff/users/4113b7f082b8420b973f286121f74372/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:18.862366 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9ac29-b37f-4348-a740-93f0e9fe6fb3 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:18.862803 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9ac29-b37f-4348-a740-93f0e9fe6fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:18.863186 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9ac29-b37f-4348-a740-93f0e9fe6fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:18.929428 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-eee9ac29-b37f-4348-a740-93f0e9fe6fb3 None None] MFA Rules not processed for user `4113b7f082b8420b973f286121f74372`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:18.931270 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-eee9ac29-b37f-4348-a740-93f0e9fe6fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:19.041212 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:19.048073 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1276/2548] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:19.053472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22809ccc-3928-4edd-a836-ab7dcced61a1 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:19.210762 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22809ccc-3928-4edd-a836-ab7dcced61a1 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:19.231633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35dbcda-fdc6-41dc-b584-00265e4f9139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:19.232314 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35dbcda-fdc6-41dc-b584-00265e4f9139 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:19.232635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35dbcda-fdc6-41dc-b584-00265e4f9139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:19.232859 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35dbcda-fdc6-41dc-b584-00265e4f9139 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:19.233573 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35dbcda-fdc6-41dc-b584-00265e4f9139 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:19.235740 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35dbcda-fdc6-41dc-b584-00265e4f9139 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:19.317692 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1273/2549] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:34:19 2022] POST /identity/v3/projects => generated 379 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:34:19.323883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9ac29-b37f-4348-a740-93f0e9fe6fb3 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:19.342324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9ac29-b37f-4348-a740-93f0e9fe6fb3 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:19.536108 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a2563-c275-40e7-809e-fb5e52f71ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:19.537525 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a2563-c275-40e7-809e-fb5e52f71ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:19.538405 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a2563-c275-40e7-809e-fb5e52f71ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:19.538935 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a2563-c275-40e7-809e-fb5e52f71ca8 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:19.539840 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a2563-c275-40e7-809e-fb5e52f71ca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:19.546074 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a2563-c275-40e7-809e-fb5e52f71ca8 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:19.619654 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35dbcda-fdc6-41dc-b584-00265e4f9139 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:19.629547 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1277/2550] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:34:19 2022] POST /identity/v3/users => generated 296 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:34:19.650577 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35dbcda-fdc6-41dc-b584-00265e4f9139 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:19.660060 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b96bf3-a6d5-4ca8-a605-9620eb085f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:19.665904 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b96bf3-a6d5-4ca8-a605-9620eb085f26 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:19.666276 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b96bf3-a6d5-4ca8-a605-9620eb085f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:19.666655 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b96bf3-a6d5-4ca8-a605-9620eb085f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:19.667614 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b96bf3-a6d5-4ca8-a605-9620eb085f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:19.670925 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b96bf3-a6d5-4ca8-a605-9620eb085f26 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:19.693015 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1274/2551] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:34:19.694884 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a2563-c275-40e7-809e-fb5e52f71ca8 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:19.727031 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a2563-c275-40e7-809e-fb5e52f71ca8 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:19.733522 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99340f59-097f-43d1-829a-baf307586a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:19.735486 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99340f59-097f-43d1-829a-baf307586a9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:19.735795 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99340f59-097f-43d1-829a-baf307586a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:19.736155 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99340f59-097f-43d1-829a-baf307586a9e admin admin] PATH_INFO: `/v3/projects/1c54b93651794431ab787878e6e98ca5/users/acef4a7893bc48408d29f40e2e6aced8/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:19.786141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99340f59-097f-43d1-829a-baf307586a9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c54b93651794431ab787878e6e98ca5, user_id=acef4a7893bc48408d29f40e2e6aced8, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:19.791708 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99340f59-097f-43d1-829a-baf307586a9e admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:19.838812 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1278/2552] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:34:19 2022] PUT /identity/v3/projects/1c54b93651794431ab787878e6e98ca5/users/acef4a7893bc48408d29f40e2e6aced8/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:34:19.846839 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b96bf3-a6d5-4ca8-a605-9620eb085f26 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:19.865538 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b96bf3-a6d5-4ca8-a605-9620eb085f26 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:19.916564 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:20.051814 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baaead9-195c-4fee-a37d-a0702ae3944a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:20.052758 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baaead9-195c-4fee-a37d-a0702ae3944a admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:20.053155 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baaead9-195c-4fee-a37d-a0702ae3944a admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:20.053576 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baaead9-195c-4fee-a37d-a0702ae3944a admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:20.054391 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baaead9-195c-4fee-a37d-a0702ae3944a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:20.057351 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baaead9-195c-4fee-a37d-a0702ae3944a admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:20.078633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1275/2553] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:34:20.082375 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99340f59-097f-43d1-829a-baf307586a9e admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:20.096305 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99340f59-097f-43d1-829a-baf307586a9e admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:20.104385 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ceb69-7a81-4ba7-a901-85060f775609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:20.105361 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ceb69-7a81-4ba7-a901-85060f775609 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:20.105855 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ceb69-7a81-4ba7-a901-85060f775609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:20.106203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ceb69-7a81-4ba7-a901-85060f775609 admin admin] PATH_INFO: `/v3/projects/1c54b93651794431ab787878e6e98ca5/users/acef4a7893bc48408d29f40e2e6aced8/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:20.108828 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ceb69-7a81-4ba7-a901-85060f775609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c54b93651794431ab787878e6e98ca5, user_id=acef4a7893bc48408d29f40e2e6aced8, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:20.115084 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ceb69-7a81-4ba7-a901-85060f775609 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:20.135075 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1279/2554] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:34:20 2022] PUT /identity/v3/projects/1c54b93651794431ab787878e6e98ca5/users/acef4a7893bc48408d29f40e2e6aced8/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:20.146497 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55cbb6-fe3d-4a2a-93a1-6794fd45cef7 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:20.146822 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55cbb6-fe3d-4a2a-93a1-6794fd45cef7 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:20.147124 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55cbb6-fe3d-4a2a-93a1-6794fd45cef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:20.195896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-2b55cbb6-fe3d-4a2a-93a1-6794fd45cef7 None None] MFA Rules not processed for user `acef4a7893bc48408d29f40e2e6aced8`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:20.200124 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-2b55cbb6-fe3d-4a2a-93a1-6794fd45cef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:20.459829 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1276/2555] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:20 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:34:20.491312 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ceb69-7a81-4ba7-a901-85060f775609 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:20.494684 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-723ceb69-7a81-4ba7-a901-85060f775609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:20.672993 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ceb69-7a81-4ba7-a901-85060f775609 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:20.679820 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5db5ae-b25d-46bd-8698-76880a9a3997 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:20.680631 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5db5ae-b25d-46bd-8698-76880a9a3997 service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:20.681021 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5db5ae-b25d-46bd-8698-76880a9a3997 service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:20.681674 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5db5ae-b25d-46bd-8698-76880a9a3997 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:20.699423 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5db5ae-b25d-46bd-8698-76880a9a3997 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:20.702125 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5db5ae-b25d-46bd-8698-76880a9a3997 service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:20.716518 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1280/2556] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:20 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:34:21.404589 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55cbb6-fe3d-4a2a-93a1-6794fd45cef7 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:21.419595 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55cbb6-fe3d-4a2a-93a1-6794fd45cef7 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:21.429535 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1aaf7-828b-4935-9bab-0cd34d790f9f tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acef4a7893bc48408d29f40e2e6aced8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c54b93651794431ab787878e6e98ca5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:21.430428 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1aaf7-828b-4935-9bab-0cd34d790f9f tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:21.430881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1aaf7-828b-4935-9bab-0cd34d790f9f tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:21.431304 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1aaf7-828b-4935-9bab-0cd34d790f9f tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:21.432181 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1aaf7-828b-4935-9bab-0cd34d790f9f tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:34:21.432653 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1aaf7-828b-4935-9bab-0cd34d790f9f tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:21.435248 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1aaf7-828b-4935-9bab-0cd34d790f9f tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:21.450071 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1277/2557] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:34:21.455562 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5db5ae-b25d-46bd-8698-76880a9a3997 service cinder] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:21.467151 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5db5ae-b25d-46bd-8698-76880a9a3997 service cinder] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:21.472925 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ddd695-d209-436f-b3b4-c39e30b48450 tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acef4a7893bc48408d29f40e2e6aced8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c54b93651794431ab787878e6e98ca5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:21.473599 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ddd695-d209-436f-b3b4-c39e30b48450 tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:21.473888 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ddd695-d209-436f-b3b4-c39e30b48450 tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:21.474220 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ddd695-d209-436f-b3b4-c39e30b48450 tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:21.475183 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ddd695-d209-436f-b3b4-c39e30b48450 tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:21.477341 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ddd695-d209-436f-b3b4-c39e30b48450 tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:21.518623 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1281/2558] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:34:21 2022] POST /identity/v3/projects => generated 354 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:34:21.523459 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1aaf7-828b-4935-9bab-0cd34d790f9f tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:21.535811 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1aaf7-828b-4935-9bab-0cd34d790f9f tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:21.632384 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff923b52-58f4-47e9-a4cd-083ee2688bdc tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acef4a7893bc48408d29f40e2e6aced8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c54b93651794431ab787878e6e98ca5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:21.633035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff923b52-58f4-47e9-a4cd-083ee2688bdc tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:21.633332 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff923b52-58f4-47e9-a4cd-083ee2688bdc tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:21.633647 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff923b52-58f4-47e9-a4cd-083ee2688bdc tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:21.634381 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff923b52-58f4-47e9-a4cd-083ee2688bdc tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:34:21.634693 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff923b52-58f4-47e9-a4cd-083ee2688bdc tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:21.636514 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff923b52-58f4-47e9-a4cd-083ee2688bdc tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:21.657080 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1278/2559] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:34:21.714460 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ddd695-d209-436f-b3b4-c39e30b48450 tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:21.731563 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ddd695-d209-436f-b3b4-c39e30b48450 tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:21.751360 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb998ee-ade9-4690-aaeb-e6b1566d49a3 tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acef4a7893bc48408d29f40e2e6aced8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c54b93651794431ab787878e6e98ca5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:21.752428 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb998ee-ade9-4690-aaeb-e6b1566d49a3 tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:21.752944 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb998ee-ade9-4690-aaeb-e6b1566d49a3 tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:21.753475 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb998ee-ade9-4690-aaeb-e6b1566d49a3 tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] PATH_INFO: `/v3/projects/0c8f6fc567df4db095b96a46258a8826` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:21.755968 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb998ee-ade9-4690-aaeb-e6b1566d49a3 tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0c8f6fc567df4db095b96a46258a8826)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:21.766731 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb998ee-ade9-4690-aaeb-e6b1566d49a3 tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:21.819462 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:21.850695 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-efb998ee-ade9-4690-aaeb-e6b1566d49a3 tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c8f6fc567df4db095b96a46258a8826', 'request_id': 'req-efb998ee-ade9-4690-aaeb-e6b1566d49a3'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:21.862629 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-efb998ee-ade9-4690-aaeb-e6b1566d49a3 tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c8f6fc567df4db095b96a46258a8826', 'request_id': 'req-efb998ee-ade9-4690-aaeb-e6b1566d49a3'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:21.872630 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-efb998ee-ade9-4690-aaeb-e6b1566d49a3 tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c8f6fc567df4db095b96a46258a8826', 'request_id': 'req-efb998ee-ade9-4690-aaeb-e6b1566d49a3'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:21.888077 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-efb998ee-ade9-4690-aaeb-e6b1566d49a3 tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] The token cache is being invalidate because project 0c8f6fc567df4db095b96a46258a8826 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:34:21.888311 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-efb998ee-ade9-4690-aaeb-e6b1566d49a3 tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:21.888979 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-efb998ee-ade9-4690-aaeb-e6b1566d49a3 tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:21.891922 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1282/2560] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:34:21 2022] DELETE /identity/v3/projects/0c8f6fc567df4db095b96a46258a8826 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:22.303597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff923b52-58f4-47e9-a4cd-083ee2688bdc tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:22.308205 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-ff923b52-58f4-47e9-a4cd-083ee2688bdc tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:22.421339 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:22.627411 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff923b52-58f4-47e9-a4cd-083ee2688bdc tempest-VolumeQuotaClassesTest-223535053 tempest-VolumeQuotaClassesTest-223535053-project-admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:22.783117 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ae79e-5345-4e3c-891c-59d70cf1b515 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:22.783788 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ae79e-5345-4e3c-891c-59d70cf1b515 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:22.783788 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ae79e-5345-4e3c-891c-59d70cf1b515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:22.812672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-934ae79e-5345-4e3c-891c-59d70cf1b515 None None] MFA Rules not processed for user `02e415eb75984daa97ee79fc0146f318`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:22.814895 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-934ae79e-5345-4e3c-891c-59d70cf1b515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:22.903364 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1283/2561] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Aug 23 22:34:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:22.905818 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5648ea-131f-4b90-8e93-6f57a460202c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:22.907970 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5648ea-131f-4b90-8e93-6f57a460202c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:22.909053 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5648ea-131f-4b90-8e93-6f57a460202c admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:22.909619 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5648ea-131f-4b90-8e93-6f57a460202c admin admin] PATH_INFO: `/v3/users/4113b7f082b8420b973f286121f74372` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:22.911819 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5648ea-131f-4b90-8e93-6f57a460202c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4113b7f082b8420b973f286121f74372)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:22.914372 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5648ea-131f-4b90-8e93-6f57a460202c admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:22.931264 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ae79e-5345-4e3c-891c-59d70cf1b515 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:22.934278 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-934ae79e-5345-4e3c-891c-59d70cf1b515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:23.070507 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-1f5648ea-131f-4b90-8e93-6f57a460202c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4113b7f082b8420b973f286121f74372'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:23.071465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-1f5648ea-131f-4b90-8e93-6f57a460202c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4113b7f082b8420b973f286121f74372'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:23.085887 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-1f5648ea-131f-4b90-8e93-6f57a460202c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4113b7f082b8420b973f286121f74372'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:23.120524 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-1f5648ea-131f-4b90-8e93-6f57a460202c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4113b7f082b8420b973f286121f74372'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:23.122115 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-1f5648ea-131f-4b90-8e93-6f57a460202c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4113b7f082b8420b973f286121f74372'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:23.176682 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1279/2562] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:34:22 2022] DELETE /identity/v3/users/4113b7f082b8420b973f286121f74372 => generated 0 bytes in 874 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:23.183151 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca90cb3-5446-4488-a2f8-b3d438778939 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:23.184051 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca90cb3-5446-4488-a2f8-b3d438778939 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:23.184918 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca90cb3-5446-4488-a2f8-b3d438778939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:23.240814 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-fca90cb3-5446-4488-a2f8-b3d438778939 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:23.249332 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-fca90cb3-5446-4488-a2f8-b3d438778939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:23.360517 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ae79e-5345-4e3c-891c-59d70cf1b515 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:23.424912 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:23.459060 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1280/2563] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:34:23.486992 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca90cb3-5446-4488-a2f8-b3d438778939 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:23.488758 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-fca90cb3-5446-4488-a2f8-b3d438778939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:23.555304 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460ad80-899b-4cf1-8a1c-47256f48c62f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abda1f23a18c4c808483cd6b53952975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:23.556920 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460ad80-899b-4cf1-8a1c-47256f48c62f service swift] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:23.557648 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460ad80-899b-4cf1-8a1c-47256f48c62f service swift] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:23.563537 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460ad80-899b-4cf1-8a1c-47256f48c62f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:23.570621 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-5460ad80-899b-4cf1-8a1c-47256f48c62f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:23.585416 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:23.658932 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca90cb3-5446-4488-a2f8-b3d438778939 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:23.667642 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f350f2c-89d9-4439-aafb-4326ef6279c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:23.668918 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f350f2c-89d9-4439-aafb-4326ef6279c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:23.669532 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f350f2c-89d9-4439-aafb-4326ef6279c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:23.670083 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f350f2c-89d9-4439-aafb-4326ef6279c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:23.690348 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f350f2c-89d9-4439-aafb-4326ef6279c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:23.693251 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f350f2c-89d9-4439-aafb-4326ef6279c3 service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:23.716951 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1281/2564] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:34:23.753710 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5460ad80-899b-4cf1-8a1c-47256f48c62f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:23.757682 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5460ad80-899b-4cf1-8a1c-47256f48c62f service swift] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:23.788845 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1284/2565] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Aug 23 22:34:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 858 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 22:34:24.427947 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f350f2c-89d9-4439-aafb-4326ef6279c3 service neutron] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:24.430127 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-8f350f2c-89d9-4439-aafb-4326ef6279c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:24.473076 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f350f2c-89d9-4439-aafb-4326ef6279c3 service neutron] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:24.488451 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab0289-38b0-424b-a42e-1841876344bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:24.489671 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab0289-38b0-424b-a42e-1841876344bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:24.491053 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab0289-38b0-424b-a42e-1841876344bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:24.491356 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab0289-38b0-424b-a42e-1841876344bd admin admin] PATH_INFO: `/v3/projects/a119917ce54744359577b584e37b99ff` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:24.492843 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eab0289-38b0-424b-a42e-1841876344bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a119917ce54744359577b584e37b99ff)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:24.496334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eab0289-38b0-424b-a42e-1841876344bd admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:24.689149 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-2eab0289-38b0-424b-a42e-1841876344bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a119917ce54744359577b584e37b99ff', 'request_id': 'req-2eab0289-38b0-424b-a42e-1841876344bd'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:24.716942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-2eab0289-38b0-424b-a42e-1841876344bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a119917ce54744359577b584e37b99ff', 'request_id': 'req-2eab0289-38b0-424b-a42e-1841876344bd'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:24.761666 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-2eab0289-38b0-424b-a42e-1841876344bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a119917ce54744359577b584e37b99ff', 'request_id': 'req-2eab0289-38b0-424b-a42e-1841876344bd'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:24.813353 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-2eab0289-38b0-424b-a42e-1841876344bd admin admin] The token cache is being invalidate because project a119917ce54744359577b584e37b99ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:34:24.813860 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-2eab0289-38b0-424b-a42e-1841876344bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:24.816261 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-2eab0289-38b0-424b-a42e-1841876344bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:24.830941 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1282/2566] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:34:24 2022] DELETE /identity/v3/projects/a119917ce54744359577b584e37b99ff => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:24.836667 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460ad80-899b-4cf1-8a1c-47256f48c62f service swift] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:24.866968 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460ad80-899b-4cf1-8a1c-47256f48c62f service swift] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:25.075680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3e402-3791-4f0e-a7fe-5475639903c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:25.076597 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3e402-3791-4f0e-a7fe-5475639903c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:25.076882 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3e402-3791-4f0e-a7fe-5475639903c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:25.077233 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3e402-3791-4f0e-a7fe-5475639903c3 admin admin] PATH_INFO: `/v3/users/acef4a7893bc48408d29f40e2e6aced8` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:25.080326 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3e402-3791-4f0e-a7fe-5475639903c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acef4a7893bc48408d29f40e2e6aced8)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:25.082985 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3e402-3791-4f0e-a7fe-5475639903c3 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:25.212428 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-d8d3e402-3791-4f0e-a7fe-5475639903c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acef4a7893bc48408d29f40e2e6aced8'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:25.213242 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-d8d3e402-3791-4f0e-a7fe-5475639903c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acef4a7893bc48408d29f40e2e6aced8'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:25.228220 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-d8d3e402-3791-4f0e-a7fe-5475639903c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acef4a7893bc48408d29f40e2e6aced8'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:25.267142 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-d8d3e402-3791-4f0e-a7fe-5475639903c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acef4a7893bc48408d29f40e2e6aced8'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:25.327116 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-d8d3e402-3791-4f0e-a7fe-5475639903c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acef4a7893bc48408d29f40e2e6aced8'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:25.377473 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1285/2567] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:34:24 2022] DELETE /identity/v3/users/acef4a7893bc48408d29f40e2e6aced8 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:26.262038 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab0289-38b0-424b-a42e-1841876344bd admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:26.263237 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-2eab0289-38b0-424b-a42e-1841876344bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:26.560141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3e402-3791-4f0e-a7fe-5475639903c3 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:26.564527 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-d8d3e402-3791-4f0e-a7fe-5475639903c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:26.615383 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab0289-38b0-424b-a42e-1841876344bd admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:26.707905 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:26.834767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3e402-3791-4f0e-a7fe-5475639903c3 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:26.856907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:26.857943 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df211c3-a3bc-40d2-a1b1-e0e5a21d822c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:26.858908 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df211c3-a3bc-40d2-a1b1-e0e5a21d822c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:26.859918 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df211c3-a3bc-40d2-a1b1-e0e5a21d822c admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:26.860567 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df211c3-a3bc-40d2-a1b1-e0e5a21d822c admin admin] PATH_INFO: `/v3/projects/1c54b93651794431ab787878e6e98ca5` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:26.863944 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df211c3-a3bc-40d2-a1b1-e0e5a21d822c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c54b93651794431ab787878e6e98ca5)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:26.866469 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df211c3-a3bc-40d2-a1b1-e0e5a21d822c admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:26.921172 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde1f4e-15f7-48f3-9070-e3ead5b78f59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:26.923600 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde1f4e-15f7-48f3-9070-e3ead5b78f59 service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:26.924945 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde1f4e-15f7-48f3-9070-e3ead5b78f59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:26.928108 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde1f4e-15f7-48f3-9070-e3ead5b78f59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:26.934592 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-bdde1f4e-15f7-48f3-9070-e3ead5b78f59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:27.029760 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde1f4e-15f7-48f3-9070-e3ead5b78f59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:27.037852 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde1f4e-15f7-48f3-9070-e3ead5b78f59 service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:27.085266 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1283/2568] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 826 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:34:27.131176 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-4df211c3-a3bc-40d2-a1b1-e0e5a21d822c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c54b93651794431ab787878e6e98ca5', 'request_id': 'req-4df211c3-a3bc-40d2-a1b1-e0e5a21d822c'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:27.169621 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-4df211c3-a3bc-40d2-a1b1-e0e5a21d822c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c54b93651794431ab787878e6e98ca5', 'request_id': 'req-4df211c3-a3bc-40d2-a1b1-e0e5a21d822c'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:27.197511 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-4df211c3-a3bc-40d2-a1b1-e0e5a21d822c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c54b93651794431ab787878e6e98ca5', 'request_id': 'req-4df211c3-a3bc-40d2-a1b1-e0e5a21d822c'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:27.227916 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-4df211c3-a3bc-40d2-a1b1-e0e5a21d822c admin admin] The token cache is being invalidate because project 1c54b93651794431ab787878e6e98ca5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:34:27.228277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-4df211c3-a3bc-40d2-a1b1-e0e5a21d822c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:27.228968 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-4df211c3-a3bc-40d2-a1b1-e0e5a21d822c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:27.240682 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1286/2569] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:34:26 2022] DELETE /identity/v3/projects/1c54b93651794431ab787878e6e98ca5 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:27.252608 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f55c87-14ab-4bb0-b98e-5f6ecc5b19da None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:27.253063 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f55c87-14ab-4bb0-b98e-5f6ecc5b19da None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:27.253519 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f55c87-14ab-4bb0-b98e-5f6ecc5b19da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:27.313046 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-33f55c87-14ab-4bb0-b98e-5f6ecc5b19da None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:27.316214 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-33f55c87-14ab-4bb0-b98e-5f6ecc5b19da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:27.562534 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1284/2570] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:27.580372 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ae0c7-ecdd-4b14-8a9f-08a8827c3fd9 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:27.580974 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ae0c7-ecdd-4b14-8a9f-08a8827c3fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:27.580974 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ae0c7-ecdd-4b14-8a9f-08a8827c3fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:27.658626 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-621ae0c7-ecdd-4b14-8a9f-08a8827c3fd9 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:27.659979 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-621ae0c7-ecdd-4b14-8a9f-08a8827c3fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:27.754026 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1287/2571] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:34:27.755273 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f55c87-14ab-4bb0-b98e-5f6ecc5b19da None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:27.776147 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f55c87-14ab-4bb0-b98e-5f6ecc5b19da None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:27.801241 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b4747-423a-4a63-ba81-627bad547a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:27.803178 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b4747-423a-4a63-ba81-627bad547a5c admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:27.803860 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b4747-423a-4a63-ba81-627bad547a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:27.804384 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b4747-423a-4a63-ba81-627bad547a5c admin admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:27.805526 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b4747-423a-4a63-ba81-627bad547a5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:34:27.806305 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b4747-423a-4a63-ba81-627bad547a5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:27.808415 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b4747-423a-4a63-ba81-627bad547a5c admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:27.858435 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1285/2572] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:34:27.862650 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ae0c7-ecdd-4b14-8a9f-08a8827c3fd9 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:27.882690 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ae0c7-ecdd-4b14-8a9f-08a8827c3fd9 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:27.901859 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432505d-0659-4f80-85ec-495aa9c36d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:27.902489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432505d-0659-4f80-85ec-495aa9c36d1f admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:27.902782 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432505d-0659-4f80-85ec-495aa9c36d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:27.903054 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432505d-0659-4f80-85ec-495aa9c36d1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:27.903703 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432505d-0659-4f80-85ec-495aa9c36d1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:27.906360 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432505d-0659-4f80-85ec-495aa9c36d1f admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:27.973716 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1288/2573] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:34:27 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:34:27.974765 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b4747-423a-4a63-ba81-627bad547a5c admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:27.991279 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b4747-423a-4a63-ba81-627bad547a5c admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:28.148076 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515132c-6cfe-4a9c-858b-5693d139a87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:28.149101 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515132c-6cfe-4a9c-858b-5693d139a87b admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:28.149655 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515132c-6cfe-4a9c-858b-5693d139a87b admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:28.156124 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515132c-6cfe-4a9c-858b-5693d139a87b admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:28.158366 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2515132c-6cfe-4a9c-858b-5693d139a87b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:28.161626 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2515132c-6cfe-4a9c-858b-5693d139a87b admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:28.213621 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432505d-0659-4f80-85ec-495aa9c36d1f admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:28.217254 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1286/2574] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:34:27 2022] POST /identity/v3/users => generated 289 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:34:28.230417 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432505d-0659-4f80-85ec-495aa9c36d1f admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:28.238983 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd41e4b-ff4c-41b2-86f4-5b1afe69170d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:28.240004 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd41e4b-ff4c-41b2-86f4-5b1afe69170d admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:28.240488 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd41e4b-ff4c-41b2-86f4-5b1afe69170d admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:28.240974 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd41e4b-ff4c-41b2-86f4-5b1afe69170d admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:28.242890 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd41e4b-ff4c-41b2-86f4-5b1afe69170d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:28.245681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd41e4b-ff4c-41b2-86f4-5b1afe69170d admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:28.270406 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1289/2575] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:28.275994 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515132c-6cfe-4a9c-858b-5693d139a87b admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:28.292252 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515132c-6cfe-4a9c-858b-5693d139a87b admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:28.300649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2bc78-a99a-4376-8552-5267acf98433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:28.301314 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2bc78-a99a-4376-8552-5267acf98433 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:28.301731 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2bc78-a99a-4376-8552-5267acf98433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:28.302202 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2bc78-a99a-4376-8552-5267acf98433 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:28.303158 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2bc78-a99a-4376-8552-5267acf98433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:28.305301 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2bc78-a99a-4376-8552-5267acf98433 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:28.326500 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd41e4b-ff4c-41b2-86f4-5b1afe69170d admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:28.335370 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1287/2576] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:28.352205 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd41e4b-ff4c-41b2-86f4-5b1afe69170d admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:28.358802 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e2fee-0260-4fd9-9196-21a3f5719a35 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:28.359508 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e2fee-0260-4fd9-9196-21a3f5719a35 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:28.359862 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e2fee-0260-4fd9-9196-21a3f5719a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:28.390522 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba2b3f-fed1-4cc3-93b9-fcbfee248b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:28.391346 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba2b3f-fed1-4cc3-93b9-fcbfee248b51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:28.394992 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba2b3f-fed1-4cc3-93b9-fcbfee248b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:28.395287 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba2b3f-fed1-4cc3-93b9-fcbfee248b51 admin admin] PATH_INFO: `/v3/projects/03200dd9f09e49cc937b2dd4d61cf923/users/b9103b1d187b424ea5684065d8fd1fc4/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:28.419905 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba2b3f-fed1-4cc3-93b9-fcbfee248b51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03200dd9f09e49cc937b2dd4d61cf923, user_id=b9103b1d187b424ea5684065d8fd1fc4, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:28.425040 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba2b3f-fed1-4cc3-93b9-fcbfee248b51 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:28.435721 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-fc1e2fee-0260-4fd9-9196-21a3f5719a35 None None] MFA Rules not processed for user `c4aa03196af3474284bfaa19bef8e95b`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:28.442599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-fc1e2fee-0260-4fd9-9196-21a3f5719a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:28.450289 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1290/2577] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:34:28 2022] PUT /identity/v3/projects/03200dd9f09e49cc937b2dd4d61cf923/users/b9103b1d187b424ea5684065d8fd1fc4/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:34:28.465876 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b3f60-4bdf-41bf-b957-ab9165811fd0 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:28.466241 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b3f60-4bdf-41bf-b957-ab9165811fd0 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:28.466659 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b3f60-4bdf-41bf-b957-ab9165811fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:28.533687 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-a64b3f60-4bdf-41bf-b957-ab9165811fd0 None None] MFA Rules not processed for user `b9103b1d187b424ea5684065d8fd1fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:28.540153 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-a64b3f60-4bdf-41bf-b957-ab9165811fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:28.545723 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:28.588021 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1288/2578] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:34:28.677787 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:28.786939 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1291/2579] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:34:28.795729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e2fee-0260-4fd9-9196-21a3f5719a35 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:28.953466 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e2fee-0260-4fd9-9196-21a3f5719a35 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:28.963390 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a40b9-5aaa-4f6b-9744-6afcdcde5f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:28.964524 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a40b9-5aaa-4f6b-9744-6afcdcde5f45 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:28.965070 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a40b9-5aaa-4f6b-9744-6afcdcde5f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:28.965739 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a40b9-5aaa-4f6b-9744-6afcdcde5f45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:28.966965 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a40b9-5aaa-4f6b-9744-6afcdcde5f45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:28.970117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a40b9-5aaa-4f6b-9744-6afcdcde5f45 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:29.016966 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1289/2580] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:34:28 2022] POST /identity/v3/projects => generated 377 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:34:29.023362 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b3f60-4bdf-41bf-b957-ab9165811fd0 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:29.069059 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b3f60-4bdf-41bf-b957-ab9165811fd0 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:29.245554 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b7d2f-176f-4d4d-8819-48ff8a8c2f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:29.247013 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b7d2f-176f-4d4d-8819-48ff8a8c2f23 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:29.247430 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b7d2f-176f-4d4d-8819-48ff8a8c2f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:29.248231 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b7d2f-176f-4d4d-8819-48ff8a8c2f23 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:29.248502 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b7d2f-176f-4d4d-8819-48ff8a8c2f23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:29.251647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b7d2f-176f-4d4d-8819-48ff8a8c2f23 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:29.284805 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1292/2581] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:34:29 2022] POST /identity/v3/users => generated 289 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:34:29.290759 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a40b9-5aaa-4f6b-9744-6afcdcde5f45 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:29.315828 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a40b9-5aaa-4f6b-9744-6afcdcde5f45 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:29.327069 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ece71-f499-4617-9525-ec7157f76e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:29.335625 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ece71-f499-4617-9525-ec7157f76e59 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:29.336306 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ece71-f499-4617-9525-ec7157f76e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:29.336738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ece71-f499-4617-9525-ec7157f76e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:29.338087 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ece71-f499-4617-9525-ec7157f76e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:29.341467 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ece71-f499-4617-9525-ec7157f76e59 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:29.370221 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1290/2582] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:29.375788 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b7d2f-176f-4d4d-8819-48ff8a8c2f23 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:29.421038 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b7d2f-176f-4d4d-8819-48ff8a8c2f23 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:29.445118 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d8881-ec78-4dcb-a79d-7c45268820da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:29.446451 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d8881-ec78-4dcb-a79d-7c45268820da admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:29.448475 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d8881-ec78-4dcb-a79d-7c45268820da admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:29.449006 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d8881-ec78-4dcb-a79d-7c45268820da admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:29.450317 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d8881-ec78-4dcb-a79d-7c45268820da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:29.459383 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d8881-ec78-4dcb-a79d-7c45268820da admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:29.504122 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1293/2583] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:29.506399 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ece71-f499-4617-9525-ec7157f76e59 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:29.527135 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ece71-f499-4617-9525-ec7157f76e59 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:29.543724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383e30b-b146-416a-ab15-fd1af25da46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:29.545028 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383e30b-b146-416a-ab15-fd1af25da46f admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:29.545764 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383e30b-b146-416a-ab15-fd1af25da46f admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:29.546445 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383e30b-b146-416a-ab15-fd1af25da46f admin admin] PATH_INFO: `/v3/projects/ba76c6aa85194ea28170b4affa7ae7b3/users/c3786f5186814d56922868b1761a10dd/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:29.610821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383e30b-b146-416a-ab15-fd1af25da46f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba76c6aa85194ea28170b4affa7ae7b3, user_id=c3786f5186814d56922868b1761a10dd, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:29.619967 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383e30b-b146-416a-ab15-fd1af25da46f admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:29.710662 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1291/2584] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:34:29 2022] PUT /identity/v3/projects/ba76c6aa85194ea28170b4affa7ae7b3/users/c3786f5186814d56922868b1761a10dd/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:29.715836 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f7a0b-a9f5-4259-952b-acc15b452409 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:29.716642 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f7a0b-a9f5-4259-952b-acc15b452409 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:29.716642 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f7a0b-a9f5-4259-952b-acc15b452409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:29.835569 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-416f7a0b-a9f5-4259-952b-acc15b452409 None None] MFA Rules not processed for user `c3786f5186814d56922868b1761a10dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:29.837840 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-416f7a0b-a9f5-4259-952b-acc15b452409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:30.384048 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1294/2585] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 670 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:30.389721 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383e30b-b146-416a-ab15-fd1af25da46f admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:30.546970 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383e30b-b146-416a-ab15-fd1af25da46f admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:30.576633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fe1cd-a944-4cfb-99f7-cae242df506f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:30.581957 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fe1cd-a944-4cfb-99f7-cae242df506f admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:30.586028 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fe1cd-a944-4cfb-99f7-cae242df506f admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:30.586977 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fe1cd-a944-4cfb-99f7-cae242df506f admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:30.591493 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569fe1cd-a944-4cfb-99f7-cae242df506f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:30.597517 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569fe1cd-a944-4cfb-99f7-cae242df506f admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:30.697563 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1292/2586] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:34:30 2022] POST /identity/v3/projects => generated 379 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:34:30.704506 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f7a0b-a9f5-4259-952b-acc15b452409 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:30.738083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f7a0b-a9f5-4259-952b-acc15b452409 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:30.920275 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:30.972016 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ba86b-8167-4915-be1e-dfbc6949f982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:30.973085 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ba86b-8167-4915-be1e-dfbc6949f982 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:30.973616 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ba86b-8167-4915-be1e-dfbc6949f982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:30.974084 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ba86b-8167-4915-be1e-dfbc6949f982 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:30.975490 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ba86b-8167-4915-be1e-dfbc6949f982 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:30.979380 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ba86b-8167-4915-be1e-dfbc6949f982 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:31.051112 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1295/2587] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:34:30 2022] POST /identity/v3/users => generated 296 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:34:31.060746 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fe1cd-a944-4cfb-99f7-cae242df506f admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:31.126921 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fe1cd-a944-4cfb-99f7-cae242df506f admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:31.178972 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b078a-09cb-4f2a-8b30-e69af27084d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:31.179947 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b078a-09cb-4f2a-8b30-e69af27084d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:31.182206 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b078a-09cb-4f2a-8b30-e69af27084d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:31.193127 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b078a-09cb-4f2a-8b30-e69af27084d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:31.197635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b078a-09cb-4f2a-8b30-e69af27084d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:31.203758 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b078a-09cb-4f2a-8b30-e69af27084d0 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:31.293702 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1293/2588] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:31.300813 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ba86b-8167-4915-be1e-dfbc6949f982 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:31.345410 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ba86b-8167-4915-be1e-dfbc6949f982 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:31.377653 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2116748-1050-4beb-ae63-dbf7ce73b1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:31.378909 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2116748-1050-4beb-ae63-dbf7ce73b1bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:31.379439 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2116748-1050-4beb-ae63-dbf7ce73b1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:31.380072 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2116748-1050-4beb-ae63-dbf7ce73b1bf admin admin] PATH_INFO: `/v3/projects/b4632af9e299435bb3f34a7012f0108f/users/cab7ce0b5e3342fba345478f10259f31/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:31.409064 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2116748-1050-4beb-ae63-dbf7ce73b1bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4632af9e299435bb3f34a7012f0108f, user_id=cab7ce0b5e3342fba345478f10259f31, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:31.413963 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2116748-1050-4beb-ae63-dbf7ce73b1bf admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:31.480632 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1296/2589] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:34:31 2022] PUT /identity/v3/projects/b4632af9e299435bb3f34a7012f0108f/users/cab7ce0b5e3342fba345478f10259f31/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:31.486733 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b078a-09cb-4f2a-8b30-e69af27084d0 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:31.500724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b078a-09cb-4f2a-8b30-e69af27084d0 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:31.512036 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:31.666122 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2621b6-96fa-448f-ae34-c8e0ccb94e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:31.666880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2621b6-96fa-448f-ae34-c8e0ccb94e97 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:31.667214 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2621b6-96fa-448f-ae34-c8e0ccb94e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:31.667667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2621b6-96fa-448f-ae34-c8e0ccb94e97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:31.668533 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2621b6-96fa-448f-ae34-c8e0ccb94e97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:31.670673 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2621b6-96fa-448f-ae34-c8e0ccb94e97 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:31.690804 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1294/2590] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:31.692384 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2116748-1050-4beb-ae63-dbf7ce73b1bf admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:31.707160 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2116748-1050-4beb-ae63-dbf7ce73b1bf admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:31.715593 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e41b1-ec9d-4483-8b2e-06a0eb97f108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:31.716714 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e41b1-ec9d-4483-8b2e-06a0eb97f108 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:31.717316 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e41b1-ec9d-4483-8b2e-06a0eb97f108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:31.718056 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e41b1-ec9d-4483-8b2e-06a0eb97f108 admin admin] PATH_INFO: `/v3/projects/b4632af9e299435bb3f34a7012f0108f/users/cab7ce0b5e3342fba345478f10259f31/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:31.721259 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e41b1-ec9d-4483-8b2e-06a0eb97f108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4632af9e299435bb3f34a7012f0108f, user_id=cab7ce0b5e3342fba345478f10259f31, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:31.724576 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e41b1-ec9d-4483-8b2e-06a0eb97f108 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:31.755510 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1297/2591] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:34:31 2022] PUT /identity/v3/projects/b4632af9e299435bb3f34a7012f0108f/users/cab7ce0b5e3342fba345478f10259f31/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:34:31.777438 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330384e3-87f7-4396-acc5-09279e276ef5 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:31.777438 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330384e3-87f7-4396-acc5-09279e276ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:31.777438 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330384e3-87f7-4396-acc5-09279e276ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:31.818793 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-330384e3-87f7-4396-acc5-09279e276ef5 None None] MFA Rules not processed for user `cab7ce0b5e3342fba345478f10259f31`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:31.820455 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-330384e3-87f7-4396-acc5-09279e276ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:32.024970 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1295/2592] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:31 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:32.043050 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e41b1-ec9d-4483-8b2e-06a0eb97f108 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:32.045405 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-950e41b1-ec9d-4483-8b2e-06a0eb97f108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:32.147748 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e41b1-ec9d-4483-8b2e-06a0eb97f108 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:32.154462 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2264f9b-652d-4dfc-a694-c126326c45d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:32.158644 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2264f9b-652d-4dfc-a694-c126326c45d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:32.159351 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2264f9b-652d-4dfc-a694-c126326c45d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:32.159918 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2264f9b-652d-4dfc-a694-c126326c45d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:32.176982 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2264f9b-652d-4dfc-a694-c126326c45d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:32.179942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2264f9b-652d-4dfc-a694-c126326c45d5 service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:32.213681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1298/2593] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:32 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:34:32.315360 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330384e3-87f7-4396-acc5-09279e276ef5 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:32.317484 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-330384e3-87f7-4396-acc5-09279e276ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:32.339662 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330384e3-87f7-4396-acc5-09279e276ef5 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:32.347928 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c79840-b08a-44df-bc94-8a210e3742da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:32.349853 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c79840-b08a-44df-bc94-8a210e3742da service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:32.351988 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c79840-b08a-44df-bc94-8a210e3742da service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:32.352620 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c79840-b08a-44df-bc94-8a210e3742da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:32.510013 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c79840-b08a-44df-bc94-8a210e3742da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:32.513075 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c79840-b08a-44df-bc94-8a210e3742da service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:32.547603 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1296/2594] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:34:32.802483 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b6252-213e-462f-b71b-4d9a6fcc07c3 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:32.803367 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b6252-213e-462f-b71b-4d9a6fcc07c3 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:32.803591 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b6252-213e-462f-b71b-4d9a6fcc07c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:32.878200 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-bd5b6252-213e-462f-b71b-4d9a6fcc07c3 None None] MFA Rules not processed for user `02e415eb75984daa97ee79fc0146f318`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:32.880147 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-bd5b6252-213e-462f-b71b-4d9a6fcc07c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:33.149915 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1299/2595] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Aug 23 22:34:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:33.183597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c79840-b08a-44df-bc94-8a210e3742da service cinder] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:33.187544 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-53c79840-b08a-44df-bc94-8a210e3742da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:33.407222 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:33.578415 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c79840-b08a-44df-bc94-8a210e3742da service cinder] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:33.634155 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5072a-4d18-4bc2-a175-33f805663941 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abda1f23a18c4c808483cd6b53952975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:33.635276 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5072a-4d18-4bc2-a175-33f805663941 service swift] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:33.635776 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5072a-4d18-4bc2-a175-33f805663941 service swift] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:33.636276 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5072a-4d18-4bc2-a175-33f805663941 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:33.681297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5072a-4d18-4bc2-a175-33f805663941 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:33.684514 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5072a-4d18-4bc2-a175-33f805663941 service swift] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:33.724910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1297/2596] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Aug 23 22:34:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 22:34:34.643175 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b6252-213e-462f-b71b-4d9a6fcc07c3 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:34.646233 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-bd5b6252-213e-462f-b71b-4d9a6fcc07c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:34.792257 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:34.865256 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b6252-213e-462f-b71b-4d9a6fcc07c3 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:34.891236 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2c489-9328-4084-b3fb-20d8c93e13ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:34.892623 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2c489-9328-4084-b3fb-20d8c93e13ee service nova] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:34.893312 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2c489-9328-4084-b3fb-20d8c93e13ee service nova] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:34.893938 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2c489-9328-4084-b3fb-20d8c93e13ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:34.897641 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-50f2c489-9328-4084-b3fb-20d8c93e13ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:35.063164 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f2c489-9328-4084-b3fb-20d8c93e13ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:35.067408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f2c489-9328-4084-b3fb-20d8c93e13ee service nova] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:35.085759 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1300/2597] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:34 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:34:37.734468 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5072a-4d18-4bc2-a175-33f805663941 service swift] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:38.034743 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5072a-4d18-4bc2-a175-33f805663941 service swift] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:38.055035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3938468-95fc-43b8-b4d6-162336c562ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:38.055980 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3938468-95fc-43b8-b4d6-162336c562ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:38.056452 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3938468-95fc-43b8-b4d6-162336c562ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:38.056916 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3938468-95fc-43b8-b4d6-162336c562ce admin admin] PATH_INFO: `/v3/users/b9103b1d187b424ea5684065d8fd1fc4` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:38.058952 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3938468-95fc-43b8-b4d6-162336c562ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9103b1d187b424ea5684065d8fd1fc4)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:38.061327 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3938468-95fc-43b8-b4d6-162336c562ce admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:38.242733 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-c3938468-95fc-43b8-b4d6-162336c562ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9103b1d187b424ea5684065d8fd1fc4'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:38.245871 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-c3938468-95fc-43b8-b4d6-162336c562ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9103b1d187b424ea5684065d8fd1fc4'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:38.280084 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-c3938468-95fc-43b8-b4d6-162336c562ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9103b1d187b424ea5684065d8fd1fc4'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:38.304598 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-c3938468-95fc-43b8-b4d6-162336c562ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9103b1d187b424ea5684065d8fd1fc4'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:38.305987 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-c3938468-95fc-43b8-b4d6-162336c562ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9103b1d187b424ea5684065d8fd1fc4'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:38.399441 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1298/2598] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:34:37 2022] DELETE /identity/v3/users/b9103b1d187b424ea5684065d8fd1fc4 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:38.401672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18070fa0-60df-46d6-b872-b32f3509266e None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:38.402429 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18070fa0-60df-46d6-b872-b32f3509266e None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:38.402429 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18070fa0-60df-46d6-b872-b32f3509266e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:38.464900 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-18070fa0-60df-46d6-b872-b32f3509266e None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:38.466839 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-18070fa0-60df-46d6-b872-b32f3509266e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:38.750290 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1301/2599] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:38.779020 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3938468-95fc-43b8-b4d6-162336c562ce admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:38.783241 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-c3938468-95fc-43b8-b4d6-162336c562ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:38.980915 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:39.055831 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3938468-95fc-43b8-b4d6-162336c562ce admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:39.073262 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa6552-4117-48c3-83f9-091d67731453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:39.078543 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa6552-4117-48c3-83f9-091d67731453 service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:39.080528 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa6552-4117-48c3-83f9-091d67731453 service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:39.093513 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa6552-4117-48c3-83f9-091d67731453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:39.129892 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa6552-4117-48c3-83f9-091d67731453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:39.138506 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa6552-4117-48c3-83f9-091d67731453 service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:39.200964 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1299/2600] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:34:39.843178 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18070fa0-60df-46d6-b872-b32f3509266e None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:39.844832 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-18070fa0-60df-46d6-b872-b32f3509266e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:40.082060 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa6552-4117-48c3-83f9-091d67731453 service neutron] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:40.083651 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-e8fa6552-4117-48c3-83f9-091d67731453 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:40.091738 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18070fa0-60df-46d6-b872-b32f3509266e None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:40.119517 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa6552-4117-48c3-83f9-091d67731453 service neutron] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:40.120805 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0b845-857c-4fb3-b095-392c3081f7fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2000b80e34ae45d2a8b658cd394419f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:40.125019 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0b845-857c-4fb3-b095-392c3081f7fd service placement] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:40.126591 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0b845-857c-4fb3-b095-392c3081f7fd service placement] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:40.127265 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0b845-857c-4fb3-b095-392c3081f7fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:40.134923 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-32b0b845-857c-4fb3-b095-392c3081f7fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:40.146610 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d96da-6fe5-4ae8-8e73-017ba5384f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:40.147294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d96da-6fe5-4ae8-8e73-017ba5384f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:40.147580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d96da-6fe5-4ae8-8e73-017ba5384f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:40.147878 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d96da-6fe5-4ae8-8e73-017ba5384f7e admin admin] PATH_INFO: `/v3/users/18c3a4375ded41c89c877077ceb4f46d` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:40.156933 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d96da-6fe5-4ae8-8e73-017ba5384f7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=18c3a4375ded41c89c877077ceb4f46d)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:40.159240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d96da-6fe5-4ae8-8e73-017ba5384f7e admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:40.208826 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0b845-857c-4fb3-b095-392c3081f7fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:40.213799 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0b845-857c-4fb3-b095-392c3081f7fd service placement] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:40.285889 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1302/2601] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:34:40.304414 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-a52d96da-6fe5-4ae8-8e73-017ba5384f7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18c3a4375ded41c89c877077ceb4f46d'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:40.305632 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-a52d96da-6fe5-4ae8-8e73-017ba5384f7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18c3a4375ded41c89c877077ceb4f46d'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:40.327121 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-a52d96da-6fe5-4ae8-8e73-017ba5384f7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18c3a4375ded41c89c877077ceb4f46d'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:40.347490 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-a52d96da-6fe5-4ae8-8e73-017ba5384f7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18c3a4375ded41c89c877077ceb4f46d'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:40.348585 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-a52d96da-6fe5-4ae8-8e73-017ba5384f7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18c3a4375ded41c89c877077ceb4f46d'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:40.451917 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1300/2602] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:34:40 2022] DELETE /identity/v3/users/18c3a4375ded41c89c877077ceb4f46d => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:34:41.041242 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0b845-857c-4fb3-b095-392c3081f7fd service placement] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:41.043169 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-32b0b845-857c-4fb3-b095-392c3081f7fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:41.086317 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0b845-857c-4fb3-b095-392c3081f7fd service placement] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:41.139208 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:41.220284 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d96da-6fe5-4ae8-8e73-017ba5384f7e admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:41.222549 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-a52d96da-6fe5-4ae8-8e73-017ba5384f7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:41.322247 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04035ba7-b086-400e-82b0-028735a676a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:41.322924 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04035ba7-b086-400e-82b0-028735a676a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:41.323204 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04035ba7-b086-400e-82b0-028735a676a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:41.323480 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04035ba7-b086-400e-82b0-028735a676a1 admin admin] PATH_INFO: `/v3/projects/03200dd9f09e49cc937b2dd4d61cf923` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:41.325544 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04035ba7-b086-400e-82b0-028735a676a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03200dd9f09e49cc937b2dd4d61cf923)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:41.329227 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04035ba7-b086-400e-82b0-028735a676a1 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:41.428509 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-04035ba7-b086-400e-82b0-028735a676a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03200dd9f09e49cc937b2dd4d61cf923', 'request_id': 'req-04035ba7-b086-400e-82b0-028735a676a1'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:41.437714 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-04035ba7-b086-400e-82b0-028735a676a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03200dd9f09e49cc937b2dd4d61cf923', 'request_id': 'req-04035ba7-b086-400e-82b0-028735a676a1'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:41.456617 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-04035ba7-b086-400e-82b0-028735a676a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03200dd9f09e49cc937b2dd4d61cf923', 'request_id': 'req-04035ba7-b086-400e-82b0-028735a676a1'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:41.480587 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-04035ba7-b086-400e-82b0-028735a676a1 admin admin] The token cache is being invalidate because project 03200dd9f09e49cc937b2dd4d61cf923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:34:41.481408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-04035ba7-b086-400e-82b0-028735a676a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:41.484241 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-04035ba7-b086-400e-82b0-028735a676a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:41.491253 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1303/2603] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:34:41 2022] DELETE /identity/v3/projects/03200dd9f09e49cc937b2dd4d61cf923 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:41.496205 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04035ba7-b086-400e-82b0-028735a676a1 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:41.506348 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-04035ba7-b086-400e-82b0-028735a676a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:41.533538 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d96da-6fe5-4ae8-8e73-017ba5384f7e admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:41.694344 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04035ba7-b086-400e-82b0-028735a676a1 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:41.729884 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0de9f7-c37c-42bf-b16b-fa1da7428d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:41.731064 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0de9f7-c37c-42bf-b16b-fa1da7428d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:41.731295 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0de9f7-c37c-42bf-b16b-fa1da7428d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:41.731654 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0de9f7-c37c-42bf-b16b-fa1da7428d3d admin admin] PATH_INFO: `/v3/users/c3786f5186814d56922868b1761a10dd` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:41.740738 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0de9f7-c37c-42bf-b16b-fa1da7428d3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3786f5186814d56922868b1761a10dd)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:41.748409 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0de9f7-c37c-42bf-b16b-fa1da7428d3d admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:41.750386 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b1382-7691-40f7-a2b3-423e4961e83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:41.751076 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b1382-7691-40f7-a2b3-423e4961e83d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:41.751425 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b1382-7691-40f7-a2b3-423e4961e83d admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:41.751707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b1382-7691-40f7-a2b3-423e4961e83d admin admin] PATH_INFO: `/v3/projects/eeedf1e5dcd24e52ad8a230144eb4ab2` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:41.760845 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b1382-7691-40f7-a2b3-423e4961e83d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeedf1e5dcd24e52ad8a230144eb4ab2)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:41.763235 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b1382-7691-40f7-a2b3-423e4961e83d admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:41.779705 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:41.912137 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-0c0de9f7-c37c-42bf-b16b-fa1da7428d3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3786f5186814d56922868b1761a10dd'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:41.917992 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-0c0de9f7-c37c-42bf-b16b-fa1da7428d3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3786f5186814d56922868b1761a10dd'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:41.922637 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:41.943645 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-0c0de9f7-c37c-42bf-b16b-fa1da7428d3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3786f5186814d56922868b1761a10dd'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:41.964905 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-0c0de9f7-c37c-42bf-b16b-fa1da7428d3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3786f5186814d56922868b1761a10dd'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:41.981959 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-ee1b1382-7691-40f7-a2b3-423e4961e83d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeedf1e5dcd24e52ad8a230144eb4ab2', 'request_id': 'req-ee1b1382-7691-40f7-a2b3-423e4961e83d'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:42.002284 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-ee1b1382-7691-40f7-a2b3-423e4961e83d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeedf1e5dcd24e52ad8a230144eb4ab2', 'request_id': 'req-ee1b1382-7691-40f7-a2b3-423e4961e83d'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:42.004328 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-0c0de9f7-c37c-42bf-b16b-fa1da7428d3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3786f5186814d56922868b1761a10dd'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:42.021283 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1304/2604] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:34:41 2022] DELETE /identity/v3/users/c3786f5186814d56922868b1761a10dd => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:34:42.027973 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-ee1b1382-7691-40f7-a2b3-423e4961e83d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeedf1e5dcd24e52ad8a230144eb4ab2', 'request_id': 'req-ee1b1382-7691-40f7-a2b3-423e4961e83d'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:42.065231 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-ee1b1382-7691-40f7-a2b3-423e4961e83d admin admin] The token cache is being invalidate because project eeedf1e5dcd24e52ad8a230144eb4ab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:34:42.065568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-ee1b1382-7691-40f7-a2b3-423e4961e83d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:42.066569 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-ee1b1382-7691-40f7-a2b3-423e4961e83d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:42.068252 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1301/2605] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:34:41 2022] DELETE /identity/v3/projects/eeedf1e5dcd24e52ad8a230144eb4ab2 => generated 0 bytes in 849 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:42.074853 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bcd07-8c41-4d42-8239-74884e7bf1a0 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:42.075509 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bcd07-8c41-4d42-8239-74884e7bf1a0 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:42.075509 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bcd07-8c41-4d42-8239-74884e7bf1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:42.129436 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-d10bcd07-8c41-4d42-8239-74884e7bf1a0 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:42.131353 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-d10bcd07-8c41-4d42-8239-74884e7bf1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:42.293998 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1305/2606] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:42.297202 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ea3ad-ed9f-43f7-acab-5888b0c69617 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:42.297879 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ea3ad-ed9f-43f7-acab-5888b0c69617 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:42.298403 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ea3ad-ed9f-43f7-acab-5888b0c69617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:42.402885 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-4b9ea3ad-ed9f-43f7-acab-5888b0c69617 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:42.405843 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-4b9ea3ad-ed9f-43f7-acab-5888b0c69617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:42.435308 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1302/2607] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:34:42.443649 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bcd07-8c41-4d42-8239-74884e7bf1a0 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:42.460395 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bcd07-8c41-4d42-8239-74884e7bf1a0 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:42.492821 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764a9d0-6d33-48ff-b382-61a99dfdcd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:42.500082 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764a9d0-6d33-48ff-b382-61a99dfdcd13 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:42.500860 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764a9d0-6d33-48ff-b382-61a99dfdcd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:42.501422 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764a9d0-6d33-48ff-b382-61a99dfdcd13 admin admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:42.502804 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764a9d0-6d33-48ff-b382-61a99dfdcd13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:34:42.506133 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764a9d0-6d33-48ff-b382-61a99dfdcd13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:42.524830 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764a9d0-6d33-48ff-b382-61a99dfdcd13 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:42.566890 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1306/2608] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:34:42.571903 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ea3ad-ed9f-43f7-acab-5888b0c69617 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:42.584658 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ea3ad-ed9f-43f7-acab-5888b0c69617 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:42.591420 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff9cc3-ce11-4292-b123-a717bd13662b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:42.592251 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff9cc3-ce11-4292-b123-a717bd13662b admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:42.593343 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff9cc3-ce11-4292-b123-a717bd13662b admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:42.593830 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff9cc3-ce11-4292-b123-a717bd13662b admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:42.594675 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff9cc3-ce11-4292-b123-a717bd13662b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:42.597221 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff9cc3-ce11-4292-b123-a717bd13662b admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:42.663893 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764a9d0-6d33-48ff-b382-61a99dfdcd13 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:42.672585 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1303/2609] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:34:42 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:34:42.685621 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764a9d0-6d33-48ff-b382-61a99dfdcd13 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:42.922888 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54744539-f350-4075-9805-b2d5650ebd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:42.928743 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54744539-f350-4075-9805-b2d5650ebd43 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:42.928743 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54744539-f350-4075-9805-b2d5650ebd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:42.928743 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54744539-f350-4075-9805-b2d5650ebd43 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:42.928743 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54744539-f350-4075-9805-b2d5650ebd43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:42.945940 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54744539-f350-4075-9805-b2d5650ebd43 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:43.001600 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1307/2610] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:34:42 2022] POST /identity/v3/users => generated 287 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:34:43.007963 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff9cc3-ce11-4292-b123-a717bd13662b admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:43.045067 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff9cc3-ce11-4292-b123-a717bd13662b admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:43.057667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f22307-6350-492e-8cd8-4a6d1af63a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:43.060779 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f22307-6350-492e-8cd8-4a6d1af63a85 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:43.068775 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f22307-6350-492e-8cd8-4a6d1af63a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:43.071158 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f22307-6350-492e-8cd8-4a6d1af63a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:43.074561 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f22307-6350-492e-8cd8-4a6d1af63a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:43.079358 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f22307-6350-492e-8cd8-4a6d1af63a85 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:43.113668 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1304/2611] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:43.121151 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54744539-f350-4075-9805-b2d5650ebd43 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:43.158555 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54744539-f350-4075-9805-b2d5650ebd43 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:43.168096 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0debd-f68e-45c3-9fd1-718382607c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:43.169263 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0debd-f68e-45c3-9fd1-718382607c93 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:43.169776 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0debd-f68e-45c3-9fd1-718382607c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:43.170306 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0debd-f68e-45c3-9fd1-718382607c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:43.171719 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f0debd-f68e-45c3-9fd1-718382607c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:43.182065 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f0debd-f68e-45c3-9fd1-718382607c93 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:43.211568 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1308/2612] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:43.218175 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f22307-6350-492e-8cd8-4a6d1af63a85 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:43.251690 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f22307-6350-492e-8cd8-4a6d1af63a85 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:43.269792 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe34c9-65c8-49a2-a4b0-c4a82df40de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:43.270973 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe34c9-65c8-49a2-a4b0-c4a82df40de2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:43.275227 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe34c9-65c8-49a2-a4b0-c4a82df40de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:43.276581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe34c9-65c8-49a2-a4b0-c4a82df40de2 admin admin] PATH_INFO: `/v3/projects/71da83c6fcf84c72b4b8b0a024504cad/users/65d1d8233cf34c4d945dd947d8b91b23/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:43.327407 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe34c9-65c8-49a2-a4b0-c4a82df40de2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71da83c6fcf84c72b4b8b0a024504cad, user_id=65d1d8233cf34c4d945dd947d8b91b23, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:43.335339 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe34c9-65c8-49a2-a4b0-c4a82df40de2 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:43.378158 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1305/2613] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:34:43 2022] PUT /identity/v3/projects/71da83c6fcf84c72b4b8b0a024504cad/users/65d1d8233cf34c4d945dd947d8b91b23/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:34:43.398200 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c3531-83c2-4afc-99a1-07ba846112f1 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:43.399077 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c3531-83c2-4afc-99a1-07ba846112f1 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:43.399925 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c3531-83c2-4afc-99a1-07ba846112f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:43.471415 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe34c9-65c8-49a2-a4b0-c4a82df40de2 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:43.473486 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-c5fe34c9-65c8-49a2-a4b0-c4a82df40de2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:43.507938 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-9b2c3531-83c2-4afc-99a1-07ba846112f1 None None] MFA Rules not processed for user `65d1d8233cf34c4d945dd947d8b91b23`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:43.511465 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-9b2c3531-83c2-4afc-99a1-07ba846112f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:43.579947 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:43.647970 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe34c9-65c8-49a2-a4b0-c4a82df40de2 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:43.654805 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07ad36-2eb9-44c0-a164-be693e6a987b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:43.658258 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07ad36-2eb9-44c0-a164-be693e6a987b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:43.658258 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07ad36-2eb9-44c0-a164-be693e6a987b admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:43.658258 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07ad36-2eb9-44c0-a164-be693e6a987b admin admin] PATH_INFO: `/v3/projects/ba76c6aa85194ea28170b4affa7ae7b3` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:43.658993 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b07ad36-2eb9-44c0-a164-be693e6a987b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba76c6aa85194ea28170b4affa7ae7b3)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:43.662625 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b07ad36-2eb9-44c0-a164-be693e6a987b admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:43.683494 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1309/2614] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:34:43.690941 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c3531-83c2-4afc-99a1-07ba846112f1 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:43.724819 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:43.731932 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c3531-83c2-4afc-99a1-07ba846112f1 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:43.779833 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-0b07ad36-2eb9-44c0-a164-be693e6a987b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba76c6aa85194ea28170b4affa7ae7b3', 'request_id': 'req-0b07ad36-2eb9-44c0-a164-be693e6a987b'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:43.809044 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-0b07ad36-2eb9-44c0-a164-be693e6a987b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba76c6aa85194ea28170b4affa7ae7b3', 'request_id': 'req-0b07ad36-2eb9-44c0-a164-be693e6a987b'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:43.841627 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-0b07ad36-2eb9-44c0-a164-be693e6a987b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba76c6aa85194ea28170b4affa7ae7b3', 'request_id': 'req-0b07ad36-2eb9-44c0-a164-be693e6a987b'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:43.886764 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-0b07ad36-2eb9-44c0-a164-be693e6a987b admin admin] The token cache is being invalidate because project ba76c6aa85194ea28170b4affa7ae7b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:34:43.888355 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-0b07ad36-2eb9-44c0-a164-be693e6a987b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:43.891541 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-0b07ad36-2eb9-44c0-a164-be693e6a987b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:43.898772 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9972c7-114f-4db8-b1a3-6d159e971d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:43.900144 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9972c7-114f-4db8-b1a3-6d159e971d6b admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:43.901294 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9972c7-114f-4db8-b1a3-6d159e971d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:43.902228 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9972c7-114f-4db8-b1a3-6d159e971d6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:43.902753 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1306/2615] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:34:43 2022] DELETE /identity/v3/projects/ba76c6aa85194ea28170b4affa7ae7b3 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:43.904033 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9972c7-114f-4db8-b1a3-6d159e971d6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:43.909458 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9972c7-114f-4db8-b1a3-6d159e971d6b admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:43.911882 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07ad36-2eb9-44c0-a164-be693e6a987b admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:43.917984 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-0b07ad36-2eb9-44c0-a164-be693e6a987b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:43.975027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07ad36-2eb9-44c0-a164-be693e6a987b admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:43.987850 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d09e15-cf63-4216-b418-59f19a7320b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:43.988519 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d09e15-cf63-4216-b418-59f19a7320b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:43.988805 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d09e15-cf63-4216-b418-59f19a7320b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:43.989084 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d09e15-cf63-4216-b418-59f19a7320b6 admin admin] PATH_INFO: `/v3/users/cab7ce0b5e3342fba345478f10259f31` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:43.992387 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1310/2616] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:34:43 2022] POST /identity/v3/projects => generated 373 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:34:43.996498 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d09e15-cf63-4216-b418-59f19a7320b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cab7ce0b5e3342fba345478f10259f31)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:43.997259 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9972c7-114f-4db8-b1a3-6d159e971d6b admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:44.001078 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d09e15-cf63-4216-b418-59f19a7320b6 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:44.001603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-5b9972c7-114f-4db8-b1a3-6d159e971d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:44.157618 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-27d09e15-cf63-4216-b418-59f19a7320b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cab7ce0b5e3342fba345478f10259f31'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:44.157618 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-27d09e15-cf63-4216-b418-59f19a7320b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cab7ce0b5e3342fba345478f10259f31'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:44.157988 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9972c7-114f-4db8-b1a3-6d159e971d6b admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:44.169674 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-27d09e15-cf63-4216-b418-59f19a7320b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cab7ce0b5e3342fba345478f10259f31'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:44.172895 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb31c8-ff77-4ed1-a0c4-4004a762cdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:44.177031 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb31c8-ff77-4ed1-a0c4-4004a762cdfb admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:44.178302 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb31c8-ff77-4ed1-a0c4-4004a762cdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:44.179171 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb31c8-ff77-4ed1-a0c4-4004a762cdfb admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:44.180180 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb31c8-ff77-4ed1-a0c4-4004a762cdfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:44.184541 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb31c8-ff77-4ed1-a0c4-4004a762cdfb admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:44.194387 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-27d09e15-cf63-4216-b418-59f19a7320b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cab7ce0b5e3342fba345478f10259f31'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:44.200727 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-27d09e15-cf63-4216-b418-59f19a7320b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cab7ce0b5e3342fba345478f10259f31'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:44.243652 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1311/2617] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:34:43 2022] POST /identity/v3/users => generated 293 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:34:44.253909 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb31c8-ff77-4ed1-a0c4-4004a762cdfb admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:44.270942 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-85cb31c8-ff77-4ed1-a0c4-4004a762cdfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:44.287605 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1307/2618] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:34:43 2022] DELETE /identity/v3/users/cab7ce0b5e3342fba345478f10259f31 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:44.333784 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb31c8-ff77-4ed1-a0c4-4004a762cdfb admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:44.503923 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:44.620851 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a08648-9a75-4864-a8e9-3d6f5893e32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:44.626690 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a08648-9a75-4864-a8e9-3d6f5893e32f admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:44.626690 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a08648-9a75-4864-a8e9-3d6f5893e32f admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:44.626690 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a08648-9a75-4864-a8e9-3d6f5893e32f admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:44.626690 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a08648-9a75-4864-a8e9-3d6f5893e32f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:44.628016 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a08648-9a75-4864-a8e9-3d6f5893e32f admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:44.687662 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1312/2619] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:44.693099 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d09e15-cf63-4216-b418-59f19a7320b6 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:44.754746 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d09e15-cf63-4216-b418-59f19a7320b6 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:44.795739 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd78084-c4ef-4a9e-a154-22f52caa79dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:44.797699 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd78084-c4ef-4a9e-a154-22f52caa79dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:44.798210 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd78084-c4ef-4a9e-a154-22f52caa79dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:44.798687 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd78084-c4ef-4a9e-a154-22f52caa79dc admin admin] PATH_INFO: `/v3/projects/63469f22db9c47ac90f18ee9d4133802/users/d6393ae628a04fb780f0e7c3b6077f7c/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:44.872303 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd78084-c4ef-4a9e-a154-22f52caa79dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=63469f22db9c47ac90f18ee9d4133802, user_id=d6393ae628a04fb780f0e7c3b6077f7c, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:44.881847 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd78084-c4ef-4a9e-a154-22f52caa79dc admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:44.927845 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1308/2620] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:34:44 2022] PUT /identity/v3/projects/63469f22db9c47ac90f18ee9d4133802/users/d6393ae628a04fb780f0e7c3b6077f7c/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:44.934292 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a08648-9a75-4864-a8e9-3d6f5893e32f admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:44.962795 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a08648-9a75-4864-a8e9-3d6f5893e32f admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:45.216175 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0821e82-2fe0-431e-a328-790f5ab964c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:45.218408 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0821e82-2fe0-431e-a328-790f5ab964c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:45.218944 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0821e82-2fe0-431e-a328-790f5ab964c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:45.219575 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0821e82-2fe0-431e-a328-790f5ab964c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:45.220571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0821e82-2fe0-431e-a328-790f5ab964c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:45.232124 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0821e82-2fe0-431e-a328-790f5ab964c8 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:45.263334 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1313/2621] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:45.268993 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd78084-c4ef-4a9e-a154-22f52caa79dc admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:45.314125 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd78084-c4ef-4a9e-a154-22f52caa79dc admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:45.329677 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65eeb1-17e2-48ce-8645-69661bfee8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:45.331732 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65eeb1-17e2-48ce-8645-69661bfee8ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:45.332400 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65eeb1-17e2-48ce-8645-69661bfee8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:45.333087 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65eeb1-17e2-48ce-8645-69661bfee8ee admin admin] PATH_INFO: `/v3/projects/63469f22db9c47ac90f18ee9d4133802/users/d6393ae628a04fb780f0e7c3b6077f7c/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:45.349241 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0821e82-2fe0-431e-a328-790f5ab964c8 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:45.352810 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-d0821e82-2fe0-431e-a328-790f5ab964c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:45.354724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65eeb1-17e2-48ce-8645-69661bfee8ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=63469f22db9c47ac90f18ee9d4133802, user_id=d6393ae628a04fb780f0e7c3b6077f7c, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:45.372208 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65eeb1-17e2-48ce-8645-69661bfee8ee admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:45.401492 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0821e82-2fe0-431e-a328-790f5ab964c8 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:45.414704 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1309/2622] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:34:45 2022] PUT /identity/v3/projects/63469f22db9c47ac90f18ee9d4133802/users/d6393ae628a04fb780f0e7c3b6077f7c/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:45.416765 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b25f9-76a3-4970-b45d-e2d93e3df505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:45.418085 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b25f9-76a3-4970-b45d-e2d93e3df505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:45.418569 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b25f9-76a3-4970-b45d-e2d93e3df505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:45.419038 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b25f9-76a3-4970-b45d-e2d93e3df505 admin admin] PATH_INFO: `/v3/projects/b4632af9e299435bb3f34a7012f0108f` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:45.422782 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b25f9-76a3-4970-b45d-e2d93e3df505 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4632af9e299435bb3f34a7012f0108f)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:45.427105 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b25f9-76a3-4970-b45d-e2d93e3df505 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:45.431294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5ac45-c246-4923-b3ac-48e982b62456 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:45.431665 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5ac45-c246-4923-b3ac-48e982b62456 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:45.431910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5ac45-c246-4923-b3ac-48e982b62456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:45.477684 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-12a5ac45-c246-4923-b3ac-48e982b62456 None None] MFA Rules not processed for user `d6393ae628a04fb780f0e7c3b6077f7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:45.479176 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-12a5ac45-c246-4923-b3ac-48e982b62456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:45.579821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=81,keystone:DELETE=15,keystone:INSERT=4 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:45.594050 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-646b25f9-76a3-4970-b45d-e2d93e3df505 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4632af9e299435bb3f34a7012f0108f', 'request_id': 'req-646b25f9-76a3-4970-b45d-e2d93e3df505'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:45.622025 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-646b25f9-76a3-4970-b45d-e2d93e3df505 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4632af9e299435bb3f34a7012f0108f', 'request_id': 'req-646b25f9-76a3-4970-b45d-e2d93e3df505'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:45.635302 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-646b25f9-76a3-4970-b45d-e2d93e3df505 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4632af9e299435bb3f34a7012f0108f', 'request_id': 'req-646b25f9-76a3-4970-b45d-e2d93e3df505'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:45.652669 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1310/2623] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:34:45.666155 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-646b25f9-76a3-4970-b45d-e2d93e3df505 admin admin] The token cache is being invalidate because project b4632af9e299435bb3f34a7012f0108f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:34:45.667269 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-646b25f9-76a3-4970-b45d-e2d93e3df505 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:45.668935 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-646b25f9-76a3-4970-b45d-e2d93e3df505 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:45.678575 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5ac45-c246-4923-b3ac-48e982b62456 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:45.678575 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-12a5ac45-c246-4923-b3ac-48e982b62456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:45.678913 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1314/2624] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:34:45 2022] DELETE /identity/v3/projects/b4632af9e299435bb3f34a7012f0108f => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:45.681898 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7727df-0d50-4927-9bac-a984c433699d None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:45.682267 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7727df-0d50-4927-9bac-a984c433699d None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:45.682567 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7727df-0d50-4927-9bac-a984c433699d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:45.723906 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-3a7727df-0d50-4927-9bac-a984c433699d None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:45.725276 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-3a7727df-0d50-4927-9bac-a984c433699d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:45.817978 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5ac45-c246-4923-b3ac-48e982b62456 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:45.901413 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce091e8-f0be-4374-b13e-c7e8d12f8380 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:45.902726 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce091e8-f0be-4374-b13e-c7e8d12f8380 service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:45.903119 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce091e8-f0be-4374-b13e-c7e8d12f8380 service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:45.903719 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce091e8-f0be-4374-b13e-c7e8d12f8380 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:45.907750 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-9ce091e8-f0be-4374-b13e-c7e8d12f8380 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:45.942209 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:46.002545 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1315/2625] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:46.016947 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8155f-e9f2-44c6-8cd2-973ce29e3dbc None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:46.017434 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8155f-e9f2-44c6-8cd2-973ce29e3dbc None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:46.017941 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8155f-e9f2-44c6-8cd2-973ce29e3dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:46.046706 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce091e8-f0be-4374-b13e-c7e8d12f8380 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:46.051118 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce091e8-f0be-4374-b13e-c7e8d12f8380 service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:46.080300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1311/2626] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:34:46.112224 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-dff8155f-e9f2-44c6-8cd2-973ce29e3dbc None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:46.115154 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-dff8155f-e9f2-44c6-8cd2-973ce29e3dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:46.134749 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1316/2627] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:46.140953 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce091e8-f0be-4374-b13e-c7e8d12f8380 service cinder] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:46.157988 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce091e8-f0be-4374-b13e-c7e8d12f8380 service cinder] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:46.165566 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814f3ad-d58e-4f02-8bad-69237e755960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:46.166489 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814f3ad-d58e-4f02-8bad-69237e755960 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:46.166959 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814f3ad-d58e-4f02-8bad-69237e755960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:46.167308 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814f3ad-d58e-4f02-8bad-69237e755960 admin admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:46.168551 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3814f3ad-d58e-4f02-8bad-69237e755960 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:34:46.169014 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3814f3ad-d58e-4f02-8bad-69237e755960 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:46.172009 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3814f3ad-d58e-4f02-8bad-69237e755960 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:46.214210 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1312/2628] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:34:46.219966 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8155f-e9f2-44c6-8cd2-973ce29e3dbc None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:46.244649 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8155f-e9f2-44c6-8cd2-973ce29e3dbc None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:46.257230 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e0038-995c-41f3-9bf9-4583f60dff82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:46.259149 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e0038-995c-41f3-9bf9-4583f60dff82 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:46.259429 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e0038-995c-41f3-9bf9-4583f60dff82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:46.259708 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e0038-995c-41f3-9bf9-4583f60dff82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:46.262285 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e0038-995c-41f3-9bf9-4583f60dff82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:46.270764 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e0038-995c-41f3-9bf9-4583f60dff82 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:46.352802 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1317/2629] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:34:46 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:34:46.359016 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814f3ad-d58e-4f02-8bad-69237e755960 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:46.366430 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e0038-995c-41f3-9bf9-4583f60dff82 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:46.371765 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-822e0038-995c-41f3-9bf9-4583f60dff82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:46.383670 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814f3ad-d58e-4f02-8bad-69237e755960 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:46.464924 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:46.541734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e0038-995c-41f3-9bf9-4583f60dff82 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:46.549441 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9fdc5d-b235-4b2f-8bb9-30ebc234b302 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:46.550647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fdc5d-b235-4b2f-8bb9-30ebc234b302 service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:46.551482 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fdc5d-b235-4b2f-8bb9-30ebc234b302 service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:46.552055 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fdc5d-b235-4b2f-8bb9-30ebc234b302 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:46.560268 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-8e9fdc5d-b235-4b2f-8bb9-30ebc234b302 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:46.594685 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd04162-337c-4e5e-9bcc-0a4017ca5fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:46.600838 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd04162-337c-4e5e-9bcc-0a4017ca5fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:46.601686 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd04162-337c-4e5e-9bcc-0a4017ca5fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:46.602324 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd04162-337c-4e5e-9bcc-0a4017ca5fa4 admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:46.604095 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd04162-337c-4e5e-9bcc-0a4017ca5fa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:46.617300 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd04162-337c-4e5e-9bcc-0a4017ca5fa4 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:46.675428 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1313/2630] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:34:46 2022] POST /identity/v3/users => generated 290 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:34:46.679552 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd04162-337c-4e5e-9bcc-0a4017ca5fa4 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:46.695089 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd04162-337c-4e5e-9bcc-0a4017ca5fa4 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:46.700909 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1fe062-7420-41e5-b126-466bc2a66ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:46.701785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fe062-7420-41e5-b126-466bc2a66ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:46.702184 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fe062-7420-41e5-b126-466bc2a66ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:46.702667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fe062-7420-41e5-b126-466bc2a66ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:46.703938 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1fe062-7420-41e5-b126-466bc2a66ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:46.707321 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1fe062-7420-41e5-b126-466bc2a66ca9 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:46.745338 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1314/2631] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:34:46.752032 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1fe062-7420-41e5-b126-466bc2a66ca9 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:46.752983 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9fdc5d-b235-4b2f-8bb9-30ebc234b302 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:46.762115 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9fdc5d-b235-4b2f-8bb9-30ebc234b302 service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:46.793863 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1fe062-7420-41e5-b126-466bc2a66ca9 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:46.799491 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1318/2632] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:34:46.804239 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44ce92-bc62-42ad-a25e-7ddcdf53ac2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:46.804239 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44ce92-bc62-42ad-a25e-7ddcdf53ac2f admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:46.805344 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44ce92-bc62-42ad-a25e-7ddcdf53ac2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:46.805753 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44ce92-bc62-42ad-a25e-7ddcdf53ac2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:46.806589 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44ce92-bc62-42ad-a25e-7ddcdf53ac2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:46.809160 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44ce92-bc62-42ad-a25e-7ddcdf53ac2f admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:46.838084 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9fdc5d-b235-4b2f-8bb9-30ebc234b302 service cinder] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:46.839525 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1315/2633] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:46.886261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9fdc5d-b235-4b2f-8bb9-30ebc234b302 service cinder] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:46.896394 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc62f5a-9d1c-4af5-99eb-0df8a79b355a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:46.897848 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc62f5a-9d1c-4af5-99eb-0df8a79b355a admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:46.899218 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc62f5a-9d1c-4af5-99eb-0df8a79b355a admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:46.899218 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc62f5a-9d1c-4af5-99eb-0df8a79b355a admin admin] PATH_INFO: `/v3/projects/39befc8d314049a1984508da625aadda/users/6b925d53c54543fa9e8128694c76db22/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:46.933756 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc62f5a-9d1c-4af5-99eb-0df8a79b355a admin admin] RBAC: Authorizing `identity:create_grant(project_id=39befc8d314049a1984508da625aadda, user_id=6b925d53c54543fa9e8128694c76db22, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:46.940136 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc62f5a-9d1c-4af5-99eb-0df8a79b355a admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:46.965467 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1319/2634] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:34:46 2022] PUT /identity/v3/projects/39befc8d314049a1984508da625aadda/users/6b925d53c54543fa9e8128694c76db22/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:34:47.073659 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd9607-d186-41b1-87b9-5499ea5a0437 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:47.074319 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd9607-d186-41b1-87b9-5499ea5a0437 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:47.075024 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd9607-d186-41b1-87b9-5499ea5a0437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:47.216452 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-f4dd9607-d186-41b1-87b9-5499ea5a0437 None None] MFA Rules not processed for user `6b925d53c54543fa9e8128694c76db22`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:47.218297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-f4dd9607-d186-41b1-87b9-5499ea5a0437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:47.497505 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1316/2635] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:47.501723 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc62f5a-9d1c-4af5-99eb-0df8a79b355a admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:47.646440 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:47.665503 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc62f5a-9d1c-4af5-99eb-0df8a79b355a admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:47.673094 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c60fe3-6330-4e5a-8aa9-eb3c739842c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:47.673926 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c60fe3-6330-4e5a-8aa9-eb3c739842c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:47.674214 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c60fe3-6330-4e5a-8aa9-eb3c739842c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:47.674557 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c60fe3-6330-4e5a-8aa9-eb3c739842c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:47.675670 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c60fe3-6330-4e5a-8aa9-eb3c739842c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:47.678159 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c60fe3-6330-4e5a-8aa9-eb3c739842c7 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:47.724349 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1320/2636] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:34:47 2022] POST /identity/v3/projects => generated 381 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:34:47.730240 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd9607-d186-41b1-87b9-5499ea5a0437 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:47.748894 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd9607-d186-41b1-87b9-5499ea5a0437 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:47.833456 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9c950-6d64-4300-b2ec-ea5dbadf228b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:47.834098 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9c950-6d64-4300-b2ec-ea5dbadf228b admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:47.834385 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9c950-6d64-4300-b2ec-ea5dbadf228b admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:47.834661 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9c950-6d64-4300-b2ec-ea5dbadf228b admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:47.835328 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9c950-6d64-4300-b2ec-ea5dbadf228b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:47.837317 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9c950-6d64-4300-b2ec-ea5dbadf228b admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:47.872408 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1317/2637] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:34:47 2022] POST /identity/v3/users => generated 297 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:34:47.877106 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c60fe3-6330-4e5a-8aa9-eb3c739842c7 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:47.890249 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c60fe3-6330-4e5a-8aa9-eb3c739842c7 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:47.895589 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f50df9-6621-4657-89b6-83b2898b3eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:47.896220 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f50df9-6621-4657-89b6-83b2898b3eaf admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:47.896497 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f50df9-6621-4657-89b6-83b2898b3eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:47.896768 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f50df9-6621-4657-89b6-83b2898b3eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:47.897724 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f50df9-6621-4657-89b6-83b2898b3eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:47.899976 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f50df9-6621-4657-89b6-83b2898b3eaf admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:47.913011 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1321/2638] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:47.918047 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9c950-6d64-4300-b2ec-ea5dbadf228b admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:47.929848 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9c950-6d64-4300-b2ec-ea5dbadf228b admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:47.941740 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2704f14-8808-4a76-af7f-c0e7e66e4dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:47.942882 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2704f14-8808-4a76-af7f-c0e7e66e4dab admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:47.943373 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2704f14-8808-4a76-af7f-c0e7e66e4dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:47.943690 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2704f14-8808-4a76-af7f-c0e7e66e4dab admin admin] PATH_INFO: `/v3/projects/7fb3979133254e0488390eeb3dc8443f/users/811e776a410040899420cc33b512d8d5/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:47.963197 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2704f14-8808-4a76-af7f-c0e7e66e4dab admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb3979133254e0488390eeb3dc8443f, user_id=811e776a410040899420cc33b512d8d5, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:47.966470 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2704f14-8808-4a76-af7f-c0e7e66e4dab admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:47.969965 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:47.987223 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1318/2639] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:34:47 2022] PUT /identity/v3/projects/7fb3979133254e0488390eeb3dc8443f/users/811e776a410040899420cc33b512d8d5/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:34:47.991514 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f50df9-6621-4657-89b6-83b2898b3eaf admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:48.002104 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f50df9-6621-4657-89b6-83b2898b3eaf admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:48.076037 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3307c-49e0-43a8-8d84-a95137a0ce56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:48.077418 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3307c-49e0-43a8-8d84-a95137a0ce56 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:48.077708 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3307c-49e0-43a8-8d84-a95137a0ce56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:48.077981 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3307c-49e0-43a8-8d84-a95137a0ce56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:48.078633 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3307c-49e0-43a8-8d84-a95137a0ce56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:48.080240 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3307c-49e0-43a8-8d84-a95137a0ce56 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:48.091664 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1322/2640] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:48.096635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2704f14-8808-4a76-af7f-c0e7e66e4dab admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:48.108670 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2704f14-8808-4a76-af7f-c0e7e66e4dab admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:48.114679 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d2778-6489-4ad8-8871-cac0790c2ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:48.115442 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d2778-6489-4ad8-8871-cac0790c2ef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:48.115791 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d2778-6489-4ad8-8871-cac0790c2ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:48.116112 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d2778-6489-4ad8-8871-cac0790c2ef4 admin admin] PATH_INFO: `/v3/projects/7fb3979133254e0488390eeb3dc8443f/users/811e776a410040899420cc33b512d8d5/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:48.118517 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d2778-6489-4ad8-8871-cac0790c2ef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb3979133254e0488390eeb3dc8443f, user_id=811e776a410040899420cc33b512d8d5, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:48.121488 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d2778-6489-4ad8-8871-cac0790c2ef4 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:48.135187 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1319/2641] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:34:48 2022] PUT /identity/v3/projects/7fb3979133254e0488390eeb3dc8443f/users/811e776a410040899420cc33b512d8d5/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:34:48.146932 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9565b5-21d2-4251-9a46-0351359bcf43 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:48.147216 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9565b5-21d2-4251-9a46-0351359bcf43 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:48.147494 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9565b5-21d2-4251-9a46-0351359bcf43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:48.180278 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-6f9565b5-21d2-4251-9a46-0351359bcf43 None None] MFA Rules not processed for user `811e776a410040899420cc33b512d8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:48.181564 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-6f9565b5-21d2-4251-9a46-0351359bcf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:48.277461 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1323/2642] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:48 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:34:48.287433 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d2778-6489-4ad8-8871-cac0790c2ef4 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:48.369159 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d2778-6489-4ad8-8871-cac0790c2ef4 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:48.372990 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe575f0-0863-4318-b0bf-35047cc872e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:48.373877 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe575f0-0863-4318-b0bf-35047cc872e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:48.374332 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe575f0-0863-4318-b0bf-35047cc872e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:48.374696 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe575f0-0863-4318-b0bf-35047cc872e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:48.385683 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe575f0-0863-4318-b0bf-35047cc872e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:48.387153 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe575f0-0863-4318-b0bf-35047cc872e2 service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:48.399006 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1320/2643] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:48 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:34:49.089214 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9565b5-21d2-4251-9a46-0351359bcf43 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:49.165085 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:49.184902 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9565b5-21d2-4251-9a46-0351359bcf43 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:49.192800 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34de62c-1850-4616-ace8-5b56a723c57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:49.193631 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34de62c-1850-4616-ace8-5b56a723c57e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:49.193793 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34de62c-1850-4616-ace8-5b56a723c57e admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:49.194069 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34de62c-1850-4616-ace8-5b56a723c57e admin admin] PATH_INFO: `/v3/users/6b925d53c54543fa9e8128694c76db22` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:49.195250 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34de62c-1850-4616-ace8-5b56a723c57e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b925d53c54543fa9e8128694c76db22)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:49.197227 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34de62c-1850-4616-ace8-5b56a723c57e admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:49.277984 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-b34de62c-1850-4616-ace8-5b56a723c57e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b925d53c54543fa9e8128694c76db22'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:49.279215 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-b34de62c-1850-4616-ace8-5b56a723c57e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b925d53c54543fa9e8128694c76db22'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:49.292730 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-b34de62c-1850-4616-ace8-5b56a723c57e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b925d53c54543fa9e8128694c76db22'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:49.312405 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-b34de62c-1850-4616-ace8-5b56a723c57e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b925d53c54543fa9e8128694c76db22'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:49.334405 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-b34de62c-1850-4616-ace8-5b56a723c57e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b925d53c54543fa9e8128694c76db22'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:49.354661 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1324/2644] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:34:49 2022] DELETE /identity/v3/users/6b925d53c54543fa9e8128694c76db22 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:34:49.361072 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3814f-9d17-4ae3-b328-85324b5e4b6b None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:49.362427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3814f-9d17-4ae3-b328-85324b5e4b6b None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:49.362427 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3814f-9d17-4ae3-b328-85324b5e4b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:49.424731 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-dff3814f-9d17-4ae3-b328-85324b5e4b6b None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:49.426089 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-dff3814f-9d17-4ae3-b328-85324b5e4b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:49.588643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1321/2645] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:49.600284 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34de62c-1850-4616-ace8-5b56a723c57e admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:49.601631 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-b34de62c-1850-4616-ace8-5b56a723c57e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:49.732286 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34de62c-1850-4616-ace8-5b56a723c57e admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:49.748660 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aae307-6a49-42e1-83f1-834ed6d0b0fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:49.749981 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aae307-6a49-42e1-83f1-834ed6d0b0fd service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:49.750668 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aae307-6a49-42e1-83f1-834ed6d0b0fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:49.751189 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aae307-6a49-42e1-83f1-834ed6d0b0fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:49.763115 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aae307-6a49-42e1-83f1-834ed6d0b0fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:49.765191 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aae307-6a49-42e1-83f1-834ed6d0b0fd service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:49.791095 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1325/2646] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:34:50.313457 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3814f-9d17-4ae3-b328-85324b5e4b6b None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:50.318316 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-dff3814f-9d17-4ae3-b328-85324b5e4b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:50.337958 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3814f-9d17-4ae3-b328-85324b5e4b6b None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:50.345999 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99d959-8e10-4a24-9209-7beef16b5e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:50.346763 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99d959-8e10-4a24-9209-7beef16b5e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:50.347115 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99d959-8e10-4a24-9209-7beef16b5e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:50.347464 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99d959-8e10-4a24-9209-7beef16b5e8b admin admin] PATH_INFO: `/v3/projects/39befc8d314049a1984508da625aadda` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:50.349027 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99d959-8e10-4a24-9209-7beef16b5e8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=39befc8d314049a1984508da625aadda)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:50.352259 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99d959-8e10-4a24-9209-7beef16b5e8b admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:50.473832 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-cc99d959-8e10-4a24-9209-7beef16b5e8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39befc8d314049a1984508da625aadda', 'request_id': 'req-cc99d959-8e10-4a24-9209-7beef16b5e8b'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:50.501817 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-cc99d959-8e10-4a24-9209-7beef16b5e8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39befc8d314049a1984508da625aadda', 'request_id': 'req-cc99d959-8e10-4a24-9209-7beef16b5e8b'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:50.550424 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-cc99d959-8e10-4a24-9209-7beef16b5e8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39befc8d314049a1984508da625aadda', 'request_id': 'req-cc99d959-8e10-4a24-9209-7beef16b5e8b'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:50.590289 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-cc99d959-8e10-4a24-9209-7beef16b5e8b admin admin] The token cache is being invalidate because project 39befc8d314049a1984508da625aadda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:34:50.591220 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-cc99d959-8e10-4a24-9209-7beef16b5e8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:50.593903 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-cc99d959-8e10-4a24-9209-7beef16b5e8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:50.596023 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1322/2647] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:34:50 2022] DELETE /identity/v3/projects/39befc8d314049a1984508da625aadda => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:50.600805 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aae307-6a49-42e1-83f1-834ed6d0b0fd service neutron] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:50.614857 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aae307-6a49-42e1-83f1-834ed6d0b0fd service neutron] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:50.711328 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126477c-3418-4d34-8cdd-4c8083b2e29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:50.713280 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126477c-3418-4d34-8cdd-4c8083b2e29e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:50.714321 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126477c-3418-4d34-8cdd-4c8083b2e29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:50.715354 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126477c-3418-4d34-8cdd-4c8083b2e29e admin admin] PATH_INFO: `/v3/users/811e776a410040899420cc33b512d8d5` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:50.719253 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8126477c-3418-4d34-8cdd-4c8083b2e29e admin admin] RBAC: Authorizing `identity:delete_user(user_id=811e776a410040899420cc33b512d8d5)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:50.724215 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8126477c-3418-4d34-8cdd-4c8083b2e29e admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:50.787009 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:50.901651 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-8126477c-3418-4d34-8cdd-4c8083b2e29e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '811e776a410040899420cc33b512d8d5'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:50.902799 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-8126477c-3418-4d34-8cdd-4c8083b2e29e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '811e776a410040899420cc33b512d8d5'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:50.919260 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-8126477c-3418-4d34-8cdd-4c8083b2e29e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '811e776a410040899420cc33b512d8d5'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:50.940769 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-8126477c-3418-4d34-8cdd-4c8083b2e29e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '811e776a410040899420cc33b512d8d5'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:50.967571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-8126477c-3418-4d34-8cdd-4c8083b2e29e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '811e776a410040899420cc33b512d8d5'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:50.988627 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1326/2648] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:34:50 2022] DELETE /identity/v3/users/811e776a410040899420cc33b512d8d5 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:34:51.528746 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99d959-8e10-4a24-9209-7beef16b5e8b admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:51.538244 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-cc99d959-8e10-4a24-9209-7beef16b5e8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:51.571667 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99d959-8e10-4a24-9209-7beef16b5e8b admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:51.578093 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:51.725800 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0cbaf1-409f-4d16-865d-f9823b4d35cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:51.726403 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cbaf1-409f-4d16-865d-f9823b4d35cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:51.726510 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cbaf1-409f-4d16-865d-f9823b4d35cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:51.726845 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cbaf1-409f-4d16-865d-f9823b4d35cb admin admin] PATH_INFO: `/v3/projects/7fb3979133254e0488390eeb3dc8443f` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:51.728236 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0cbaf1-409f-4d16-865d-f9823b4d35cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fb3979133254e0488390eeb3dc8443f)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:51.730515 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0cbaf1-409f-4d16-865d-f9823b4d35cb admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:51.843304 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-6f0cbaf1-409f-4d16-865d-f9823b4d35cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fb3979133254e0488390eeb3dc8443f', 'request_id': 'req-6f0cbaf1-409f-4d16-865d-f9823b4d35cb'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:51.858765 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-6f0cbaf1-409f-4d16-865d-f9823b4d35cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fb3979133254e0488390eeb3dc8443f', 'request_id': 'req-6f0cbaf1-409f-4d16-865d-f9823b4d35cb'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:51.867714 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-6f0cbaf1-409f-4d16-865d-f9823b4d35cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fb3979133254e0488390eeb3dc8443f', 'request_id': 'req-6f0cbaf1-409f-4d16-865d-f9823b4d35cb'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:51.882530 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-6f0cbaf1-409f-4d16-865d-f9823b4d35cb admin admin] The token cache is being invalidate because project 7fb3979133254e0488390eeb3dc8443f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:34:51.883078 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-6f0cbaf1-409f-4d16-865d-f9823b4d35cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:51.884173 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-6f0cbaf1-409f-4d16-865d-f9823b4d35cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:51.887048 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1323/2649] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:34:51 2022] DELETE /identity/v3/projects/7fb3979133254e0488390eeb3dc8443f => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:51.896268 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f90d3-8837-4682-aac0-47c5b47b2ded None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:51.896823 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f90d3-8837-4682-aac0-47c5b47b2ded None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:51.897245 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f90d3-8837-4682-aac0-47c5b47b2ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:51.932693 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-953f90d3-8837-4682-aac0-47c5b47b2ded None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:51.934869 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-953f90d3-8837-4682-aac0-47c5b47b2ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:52.042721 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1327/2650] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:52.056651 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b20cfe-4e7f-465d-9e45-61fde6e041e2 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:52.056651 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b20cfe-4e7f-465d-9e45-61fde6e041e2 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:52.056651 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b20cfe-4e7f-465d-9e45-61fde6e041e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:52.082322 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-62b20cfe-4e7f-465d-9e45-61fde6e041e2 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:52.083773 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-62b20cfe-4e7f-465d-9e45-61fde6e041e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:52.100493 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1324/2651] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:52.102090 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f90d3-8837-4682-aac0-47c5b47b2ded None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:52.117825 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f90d3-8837-4682-aac0-47c5b47b2ded None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:52.123580 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9f553-195f-4d9f-bc76-c63af172725a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:52.124758 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9f553-195f-4d9f-bc76-c63af172725a admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:52.125254 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9f553-195f-4d9f-bc76-c63af172725a admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:52.125838 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9f553-195f-4d9f-bc76-c63af172725a admin admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:52.126680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9f553-195f-4d9f-bc76-c63af172725a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:34:52.127471 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9f553-195f-4d9f-bc76-c63af172725a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:52.129729 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9f553-195f-4d9f-bc76-c63af172725a admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:52.146556 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1328/2652] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:34:52.151645 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b20cfe-4e7f-465d-9e45-61fde6e041e2 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:52.166828 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b20cfe-4e7f-465d-9e45-61fde6e041e2 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:52.187782 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b88e42-e2b5-48ae-9efb-f1b835dbd3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:52.188740 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b88e42-e2b5-48ae-9efb-f1b835dbd3b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:52.189254 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b88e42-e2b5-48ae-9efb-f1b835dbd3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:52.189756 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b88e42-e2b5-48ae-9efb-f1b835dbd3b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:52.190591 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b88e42-e2b5-48ae-9efb-f1b835dbd3b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:52.192792 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b88e42-e2b5-48ae-9efb-f1b835dbd3b1 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:52.251303 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1325/2653] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:34:52 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:34:52.255511 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9f553-195f-4d9f-bc76-c63af172725a admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:52.272672 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9f553-195f-4d9f-bc76-c63af172725a admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:52.437763 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ce0d8-ddbb-4453-970b-edb09830dfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:52.438918 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ce0d8-ddbb-4453-970b-edb09830dfd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:52.439438 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ce0d8-ddbb-4453-970b-edb09830dfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:52.440000 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ce0d8-ddbb-4453-970b-edb09830dfd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:52.441118 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ce0d8-ddbb-4453-970b-edb09830dfd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:52.445247 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ce0d8-ddbb-4453-970b-edb09830dfd4 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:52.481120 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1329/2654] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:34:52 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:34:52.483485 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b88e42-e2b5-48ae-9efb-f1b835dbd3b1 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:52.499783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b88e42-e2b5-48ae-9efb-f1b835dbd3b1 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:52.507915 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa78925-6dfc-4051-be60-1e2d3a6a67b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:52.508964 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa78925-6dfc-4051-be60-1e2d3a6a67b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:52.509562 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa78925-6dfc-4051-be60-1e2d3a6a67b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:52.510061 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa78925-6dfc-4051-be60-1e2d3a6a67b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:52.511264 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa78925-6dfc-4051-be60-1e2d3a6a67b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:52.514916 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa78925-6dfc-4051-be60-1e2d3a6a67b2 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:52.538412 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1326/2655] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:52.543210 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ce0d8-ddbb-4453-970b-edb09830dfd4 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:52.554865 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ce0d8-ddbb-4453-970b-edb09830dfd4 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:52.561851 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567b3eb-0d38-4410-8be4-da4b913a099b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:52.562609 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567b3eb-0d38-4410-8be4-da4b913a099b admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:52.562946 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567b3eb-0d38-4410-8be4-da4b913a099b admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:52.563297 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567b3eb-0d38-4410-8be4-da4b913a099b admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:52.564050 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567b3eb-0d38-4410-8be4-da4b913a099b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:52.566215 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567b3eb-0d38-4410-8be4-da4b913a099b admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:52.568164 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:52.584041 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1330/2656] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:52.589585 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa78925-6dfc-4051-be60-1e2d3a6a67b2 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:52.603974 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa78925-6dfc-4051-be60-1e2d3a6a67b2 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:52.609773 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b511c-a7b5-4ff3-a3fb-c5a640552722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:52.610597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b511c-a7b5-4ff3-a3fb-c5a640552722 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:52.610938 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b511c-a7b5-4ff3-a3fb-c5a640552722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:52.611223 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b511c-a7b5-4ff3-a3fb-c5a640552722 admin admin] PATH_INFO: `/v3/projects/4b48ebd9353c4243bb44d2da545f0b3c/users/cbb8fc02e4b74074a668cb8e1e9284c2/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:52.629793 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b511c-a7b5-4ff3-a3fb-c5a640552722 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b48ebd9353c4243bb44d2da545f0b3c, user_id=cbb8fc02e4b74074a668cb8e1e9284c2, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:52.633132 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b511c-a7b5-4ff3-a3fb-c5a640552722 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:52.651487 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1327/2657] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:34:52 2022] PUT /identity/v3/projects/4b48ebd9353c4243bb44d2da545f0b3c/users/cbb8fc02e4b74074a668cb8e1e9284c2/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:52.664609 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ee48d-530c-4997-abb0-860f03a6eee6 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:52.664894 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ee48d-530c-4997-abb0-860f03a6eee6 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:52.665140 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ee48d-530c-4997-abb0-860f03a6eee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:52.695095 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-0c6ee48d-530c-4997-abb0-860f03a6eee6 None None] MFA Rules not processed for user `cbb8fc02e4b74074a668cb8e1e9284c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:52.696336 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-0c6ee48d-530c-4997-abb0-860f03a6eee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:52.776749 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1331/2658] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:52.793115 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b511c-a7b5-4ff3-a3fb-c5a640552722 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:52.795048 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-306b511c-a7b5-4ff3-a3fb-c5a640552722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:52.834616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:52.863580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b511c-a7b5-4ff3-a3fb-c5a640552722 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:52.868274 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec809c2-8589-4f2c-970a-9c3e56f338e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:52.869084 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec809c2-8589-4f2c-970a-9c3e56f338e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:52.869361 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec809c2-8589-4f2c-970a-9c3e56f338e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:52.869630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec809c2-8589-4f2c-970a-9c3e56f338e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:52.879631 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec809c2-8589-4f2c-970a-9c3e56f338e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:52.881072 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec809c2-8589-4f2c-970a-9c3e56f338e9 service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:52.894798 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1328/2659] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:34:54.928573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb6327-20cf-4c75-a0f2-9b057a4d3836 None None] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:54.930005 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb6327-20cf-4c75-a0f2-9b057a4d3836 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:54.930696 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb6327-20cf-4c75-a0f2-9b057a4d3836 None None] PATH_INFO: `/` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:54.933524 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1332/2660] 10.222.0.77 () {54 vars in 921 bytes} [Tue Aug 23 22:34:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:34:54.944435 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e3bf6-aa96-42ce-a21d-3bedc8046dfc None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:54.945279 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e3bf6-aa96-42ce-a21d-3bedc8046dfc None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:54.945506 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e3bf6-aa96-42ce-a21d-3bedc8046dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:54.981343 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-7e0e3bf6-aa96-42ce-a21d-3bedc8046dfc None None] MFA Rules not processed for user `1a0af5bf009b48a8915c7320b16d08dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:54.984113 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-7e0e3bf6-aa96-42ce-a21d-3bedc8046dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:55.103001 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1329/2661] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Aug 23 22:34:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:55.127939 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb6327-20cf-4c75-a0f2-9b057a4d3836 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:55.130778 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-c7fb6327-20cf-4c75-a0f2-9b057a4d3836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:55.244058 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb6327-20cf-4c75-a0f2-9b057a4d3836 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:55.251512 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a0087-74eb-4f92-b561-82b9a63e10bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '855cbc7a992d4c6697632d2d4d74abfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:55.252274 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a0087-74eb-4f92-b561-82b9a63e10bc service glance] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:55.252608 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a0087-74eb-4f92-b561-82b9a63e10bc service glance] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:55.252879 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a0087-74eb-4f92-b561-82b9a63e10bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:55.272777 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a0087-74eb-4f92-b561-82b9a63e10bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:55.274539 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a0087-74eb-4f92-b561-82b9a63e10bc service glance] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:55.292287 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1333/2662] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:34:55.700315 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e3bf6-aa96-42ce-a21d-3bedc8046dfc None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:55.809635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e3bf6-aa96-42ce-a21d-3bedc8046dfc None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:55.817575 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26ea42-3127-49ea-b022-ac69c9e839cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:55.818893 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26ea42-3127-49ea-b022-ac69c9e839cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:55.819254 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26ea42-3127-49ea-b022-ac69c9e839cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:55.819606 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26ea42-3127-49ea-b022-ac69c9e839cd admin admin] PATH_INFO: `/v3/users/cbb8fc02e4b74074a668cb8e1e9284c2` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:55.821105 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26ea42-3127-49ea-b022-ac69c9e839cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbb8fc02e4b74074a668cb8e1e9284c2)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:55.824426 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26ea42-3127-49ea-b022-ac69c9e839cd admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:55.906923 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-0f26ea42-3127-49ea-b022-ac69c9e839cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbb8fc02e4b74074a668cb8e1e9284c2'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:55.907878 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-0f26ea42-3127-49ea-b022-ac69c9e839cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbb8fc02e4b74074a668cb8e1e9284c2'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:55.918580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-0f26ea42-3127-49ea-b022-ac69c9e839cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbb8fc02e4b74074a668cb8e1e9284c2'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:55.929977 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-0f26ea42-3127-49ea-b022-ac69c9e839cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbb8fc02e4b74074a668cb8e1e9284c2'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:55.930766 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-0f26ea42-3127-49ea-b022-ac69c9e839cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbb8fc02e4b74074a668cb8e1e9284c2'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:55.938742 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:55.958163 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1330/2663] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:34:55 2022] DELETE /identity/v3/users/cbb8fc02e4b74074a668cb8e1e9284c2 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:55.966510 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8a802-4765-42b1-875a-c104d7e6cde2 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:55.967650 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8a802-4765-42b1-875a-c104d7e6cde2 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:55.968088 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8a802-4765-42b1-875a-c104d7e6cde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:55.991313 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-65a8a802-4765-42b1-875a-c104d7e6cde2 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:55.992571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-65a8a802-4765-42b1-875a-c104d7e6cde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:56.104488 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1334/2664] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:56.117111 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26ea42-3127-49ea-b022-ac69c9e839cd admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:56.118546 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-0f26ea42-3127-49ea-b022-ac69c9e839cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:56.234382 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26ea42-3127-49ea-b022-ac69c9e839cd admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:56.240296 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df4255-b6a2-4696-a20c-385f2e199208 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:56.240943 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df4255-b6a2-4696-a20c-385f2e199208 service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:56.241224 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df4255-b6a2-4696-a20c-385f2e199208 service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:56.241528 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df4255-b6a2-4696-a20c-385f2e199208 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:56.254116 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df4255-b6a2-4696-a20c-385f2e199208 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:56.254878 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df4255-b6a2-4696-a20c-385f2e199208 service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:56.267368 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1331/2665] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:34:56.788340 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8a802-4765-42b1-875a-c104d7e6cde2 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:56.789950 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-65a8a802-4765-42b1-875a-c104d7e6cde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:56.822157 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8a802-4765-42b1-875a-c104d7e6cde2 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:56.839172 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571db5c6-6aee-4fdf-aecc-3258af3bd58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:56.840040 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571db5c6-6aee-4fdf-aecc-3258af3bd58b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:56.840411 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571db5c6-6aee-4fdf-aecc-3258af3bd58b admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:56.840836 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571db5c6-6aee-4fdf-aecc-3258af3bd58b admin admin] PATH_INFO: `/v3/projects/4b48ebd9353c4243bb44d2da545f0b3c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:56.843101 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571db5c6-6aee-4fdf-aecc-3258af3bd58b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b48ebd9353c4243bb44d2da545f0b3c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:56.845406 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571db5c6-6aee-4fdf-aecc-3258af3bd58b admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:56.919836 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:56.970063 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-571db5c6-6aee-4fdf-aecc-3258af3bd58b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b48ebd9353c4243bb44d2da545f0b3c', 'request_id': 'req-571db5c6-6aee-4fdf-aecc-3258af3bd58b'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:56.989908 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-571db5c6-6aee-4fdf-aecc-3258af3bd58b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b48ebd9353c4243bb44d2da545f0b3c', 'request_id': 'req-571db5c6-6aee-4fdf-aecc-3258af3bd58b'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:57.039757 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-571db5c6-6aee-4fdf-aecc-3258af3bd58b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b48ebd9353c4243bb44d2da545f0b3c', 'request_id': 'req-571db5c6-6aee-4fdf-aecc-3258af3bd58b'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:57.064007 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-571db5c6-6aee-4fdf-aecc-3258af3bd58b admin admin] The token cache is being invalidate because project 4b48ebd9353c4243bb44d2da545f0b3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:34:57.064743 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-571db5c6-6aee-4fdf-aecc-3258af3bd58b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:57.065521 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-571db5c6-6aee-4fdf-aecc-3258af3bd58b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:57.067983 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1335/2666] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:34:56 2022] DELETE /identity/v3/projects/4b48ebd9353c4243bb44d2da545f0b3c => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:58.539916 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b0c6e-7260-4dee-b3a7-03574a530b67 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:58.540586 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b0c6e-7260-4dee-b3a7-03574a530b67 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:58.540879 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b0c6e-7260-4dee-b3a7-03574a530b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:58.566183 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-9b4b0c6e-7260-4dee-b3a7-03574a530b67 None None] MFA Rules not processed for user `02e415eb75984daa97ee79fc0146f318`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:58.567463 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-9b4b0c6e-7260-4dee-b3a7-03574a530b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:58.639682 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1332/2667] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Aug 23 22:34:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:34:58.653567 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571db5c6-6aee-4fdf-aecc-3258af3bd58b admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:58.657244 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-571db5c6-6aee-4fdf-aecc-3258af3bd58b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:58.765858 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571db5c6-6aee-4fdf-aecc-3258af3bd58b admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:58.773488 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0e24a-6737-4308-928e-77acf3244d5c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abda1f23a18c4c808483cd6b53952975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:58.773488 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0e24a-6737-4308-928e-77acf3244d5c service swift] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:58.773488 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0e24a-6737-4308-928e-77acf3244d5c service swift] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:58.773488 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0e24a-6737-4308-928e-77acf3244d5c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:58.783521 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0e24a-6737-4308-928e-77acf3244d5c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:58.786214 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0e24a-6737-4308-928e-77acf3244d5c service swift] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:58.803267 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1336/2668] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Aug 23 22:34:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 22:35:08.632505 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=56,keystone:DELETE=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:08.795461 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=47,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:10.865718 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b0c6e-7260-4dee-b3a7-03574a530b67 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:10.867782 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-9b4b0c6e-7260-4dee-b3a7-03574a530b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:10.937073 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b0c6e-7260-4dee-b3a7-03574a530b67 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:10.941140 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d9e85-8f96-4098-a4da-8c6d83d8e3ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:10.941806 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d9e85-8f96-4098-a4da-8c6d83d8e3ed service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:10.942122 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d9e85-8f96-4098-a4da-8c6d83d8e3ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:10.942396 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d9e85-8f96-4098-a4da-8c6d83d8e3ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:10.944258 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-3f8d9e85-8f96-4098-a4da-8c6d83d8e3ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:11.017165 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d9e85-8f96-4098-a4da-8c6d83d8e3ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:11.018878 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d9e85-8f96-4098-a4da-8c6d83d8e3ed service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:11.036521 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1333/2669] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:35:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:35:14.444625 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c0454-5117-4763-a9ac-ce041e050586 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:14.445709 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c0454-5117-4763-a9ac-ce041e050586 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:14.446357 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c0454-5117-4763-a9ac-ce041e050586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:14.473913 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-154c0454-5117-4763-a9ac-ce041e050586 None None] MFA Rules not processed for user `02e415eb75984daa97ee79fc0146f318`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:35:14.475352 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-154c0454-5117-4763-a9ac-ce041e050586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:14.486083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1337/2670] 10.222.0.77 () {58 vars in 967 bytes} [Tue Aug 23 22:35:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:35:14.532012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d9e85-8f96-4098-a4da-8c6d83d8e3ed service neutron] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:14.572003 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d9e85-8f96-4098-a4da-8c6d83d8e3ed service neutron] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:14.579286 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f49172-20f5-4845-9054-ccd9d1c30b0a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abda1f23a18c4c808483cd6b53952975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:14.580375 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f49172-20f5-4845-9054-ccd9d1c30b0a service swift] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:14.580884 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f49172-20f5-4845-9054-ccd9d1c30b0a service swift] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:14.581520 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f49172-20f5-4845-9054-ccd9d1c30b0a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:14.611651 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f49172-20f5-4845-9054-ccd9d1c30b0a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:14.615301 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f49172-20f5-4845-9054-ccd9d1c30b0a service swift] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:14.631412 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1334/2671] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Aug 23 22:35:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 22:35:15.222146 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c0454-5117-4763-a9ac-ce041e050586 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:15.224246 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-154c0454-5117-4763-a9ac-ce041e050586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:15.384831 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c0454-5117-4763-a9ac-ce041e050586 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:15.414033 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17c232-3507-4017-83a5-5c6b4f45b635 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:15.414799 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17c232-3507-4017-83a5-5c6b4f45b635 service nova] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:15.415155 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17c232-3507-4017-83a5-5c6b4f45b635 service nova] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:15.415468 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17c232-3507-4017-83a5-5c6b4f45b635 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:15.418941 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-ef17c232-3507-4017-83a5-5c6b4f45b635 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:15.450416 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17c232-3507-4017-83a5-5c6b4f45b635 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:15.453708 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17c232-3507-4017-83a5-5c6b4f45b635 service nova] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:15.475252 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1338/2672] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:35:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:35:20.018084 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f49172-20f5-4845-9054-ccd9d1c30b0a service swift] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:20.021806 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-b6f49172-20f5-4845-9054-ccd9d1c30b0a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:20.170934 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=100 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:20.211280 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f49172-20f5-4845-9054-ccd9d1c30b0a service swift] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:20.216504 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a5df8-b84b-4481-ae4d-45cee13677a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:20.217150 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a5df8-b84b-4481-ae4d-45cee13677a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:20.217484 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a5df8-b84b-4481-ae4d-45cee13677a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:20.217802 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a5df8-b84b-4481-ae4d-45cee13677a0 admin admin] PATH_INFO: `/v3/users/65d1d8233cf34c4d945dd947d8b91b23` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:20.219731 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a5df8-b84b-4481-ae4d-45cee13677a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65d1d8233cf34c4d945dd947d8b91b23)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:20.221709 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a5df8-b84b-4481-ae4d-45cee13677a0 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:20.297213 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-296a5df8-b84b-4481-ae4d-45cee13677a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65d1d8233cf34c4d945dd947d8b91b23'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:20.298153 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-296a5df8-b84b-4481-ae4d-45cee13677a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65d1d8233cf34c4d945dd947d8b91b23'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:20.306981 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-296a5df8-b84b-4481-ae4d-45cee13677a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65d1d8233cf34c4d945dd947d8b91b23'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:20.321313 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-296a5df8-b84b-4481-ae4d-45cee13677a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65d1d8233cf34c4d945dd947d8b91b23'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:20.322143 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-296a5df8-b84b-4481-ae4d-45cee13677a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65d1d8233cf34c4d945dd947d8b91b23'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:20.354608 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1335/2673] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:35:20 2022] DELETE /identity/v3/users/65d1d8233cf34c4d945dd947d8b91b23 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:35:20.361489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b176a12-0263-45e5-8a32-5332fc5a1ae9 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:20.362034 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b176a12-0263-45e5-8a32-5332fc5a1ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:20.366834 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b176a12-0263-45e5-8a32-5332fc5a1ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:20.418572 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-9b176a12-0263-45e5-8a32-5332fc5a1ae9 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:35:20.419867 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-9b176a12-0263-45e5-8a32-5332fc5a1ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:20.513543 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1339/2674] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:35:20.523438 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a5df8-b84b-4481-ae4d-45cee13677a0 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:20.525256 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-296a5df8-b84b-4481-ae4d-45cee13677a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:20.628342 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a5df8-b84b-4481-ae4d-45cee13677a0 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:20.632767 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1770e-f3ce-418c-b821-8cb5d12c486a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:20.633418 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1770e-f3ce-418c-b821-8cb5d12c486a service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:20.633728 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1770e-f3ce-418c-b821-8cb5d12c486a service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:20.634194 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1770e-f3ce-418c-b821-8cb5d12c486a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:20.646920 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a1770e-f3ce-418c-b821-8cb5d12c486a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:20.649292 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a1770e-f3ce-418c-b821-8cb5d12c486a service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:20.664733 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1336/2675] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:35:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:35:21.008191 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b176a12-0263-45e5-8a32-5332fc5a1ae9 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:21.010351 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-9b176a12-0263-45e5-8a32-5332fc5a1ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:21.028127 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b176a12-0263-45e5-8a32-5332fc5a1ae9 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:21.034731 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10f2ca-4872-40ee-b9eb-1f9b3e2f0c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:21.035262 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10f2ca-4872-40ee-b9eb-1f9b3e2f0c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:21.035443 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10f2ca-4872-40ee-b9eb-1f9b3e2f0c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:21.035978 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10f2ca-4872-40ee-b9eb-1f9b3e2f0c27 admin admin] PATH_INFO: `/v3/projects/71da83c6fcf84c72b4b8b0a024504cad` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:21.038785 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10f2ca-4872-40ee-b9eb-1f9b3e2f0c27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71da83c6fcf84c72b4b8b0a024504cad)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:21.040745 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10f2ca-4872-40ee-b9eb-1f9b3e2f0c27 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:21.095647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-8c10f2ca-4872-40ee-b9eb-1f9b3e2f0c27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71da83c6fcf84c72b4b8b0a024504cad', 'request_id': 'req-8c10f2ca-4872-40ee-b9eb-1f9b3e2f0c27'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:21.101795 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-8c10f2ca-4872-40ee-b9eb-1f9b3e2f0c27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71da83c6fcf84c72b4b8b0a024504cad', 'request_id': 'req-8c10f2ca-4872-40ee-b9eb-1f9b3e2f0c27'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:21.111039 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-8c10f2ca-4872-40ee-b9eb-1f9b3e2f0c27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71da83c6fcf84c72b4b8b0a024504cad', 'request_id': 'req-8c10f2ca-4872-40ee-b9eb-1f9b3e2f0c27'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:21.113576 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:21.131876 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-8c10f2ca-4872-40ee-b9eb-1f9b3e2f0c27 admin admin] The token cache is being invalidate because project 71da83c6fcf84c72b4b8b0a024504cad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:35:21.132226 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-8c10f2ca-4872-40ee-b9eb-1f9b3e2f0c27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:21.132949 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-8c10f2ca-4872-40ee-b9eb-1f9b3e2f0c27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:21.134584 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1340/2676] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:35:21 2022] DELETE /identity/v3/projects/71da83c6fcf84c72b4b8b0a024504cad => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:35:21.139041 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1770e-f3ce-418c-b821-8cb5d12c486a service neutron] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:21.149701 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1770e-f3ce-418c-b821-8cb5d12c486a service neutron] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:21.199605 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:21.228128 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebdcd2-ffb6-4043-8844-9ebe923b0751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:21.228780 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebdcd2-ffb6-4043-8844-9ebe923b0751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:21.229062 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebdcd2-ffb6-4043-8844-9ebe923b0751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:21.229395 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebdcd2-ffb6-4043-8844-9ebe923b0751 admin admin] PATH_INFO: `/v3/users/d6393ae628a04fb780f0e7c3b6077f7c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:21.230742 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebdcd2-ffb6-4043-8844-9ebe923b0751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6393ae628a04fb780f0e7c3b6077f7c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:21.232748 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebdcd2-ffb6-4043-8844-9ebe923b0751 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:21.291848 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-96ebdcd2-ffb6-4043-8844-9ebe923b0751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6393ae628a04fb780f0e7c3b6077f7c'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:21.292520 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-96ebdcd2-ffb6-4043-8844-9ebe923b0751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6393ae628a04fb780f0e7c3b6077f7c'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:21.302884 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-96ebdcd2-ffb6-4043-8844-9ebe923b0751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6393ae628a04fb780f0e7c3b6077f7c'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:21.313210 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-96ebdcd2-ffb6-4043-8844-9ebe923b0751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6393ae628a04fb780f0e7c3b6077f7c'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:21.314160 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-96ebdcd2-ffb6-4043-8844-9ebe923b0751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6393ae628a04fb780f0e7c3b6077f7c'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:21.338821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1337/2677] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:35:21 2022] DELETE /identity/v3/users/d6393ae628a04fb780f0e7c3b6077f7c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:35:21.753998 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10f2ca-4872-40ee-b9eb-1f9b3e2f0c27 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:21.756136 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-8c10f2ca-4872-40ee-b9eb-1f9b3e2f0c27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:21.777939 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10f2ca-4872-40ee-b9eb-1f9b3e2f0c27 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:21.856156 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4614351-c56d-43e8-acba-ea8ae17ce6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:21.856958 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4614351-c56d-43e8-acba-ea8ae17ce6c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:21.857321 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4614351-c56d-43e8-acba-ea8ae17ce6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:21.857630 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4614351-c56d-43e8-acba-ea8ae17ce6c1 admin admin] PATH_INFO: `/v3/projects/63469f22db9c47ac90f18ee9d4133802` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:21.858856 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4614351-c56d-43e8-acba-ea8ae17ce6c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63469f22db9c47ac90f18ee9d4133802)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:21.861599 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4614351-c56d-43e8-acba-ea8ae17ce6c1 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:21.926613 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-d4614351-c56d-43e8-acba-ea8ae17ce6c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63469f22db9c47ac90f18ee9d4133802', 'request_id': 'req-d4614351-c56d-43e8-acba-ea8ae17ce6c1'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:21.933703 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-d4614351-c56d-43e8-acba-ea8ae17ce6c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63469f22db9c47ac90f18ee9d4133802', 'request_id': 'req-d4614351-c56d-43e8-acba-ea8ae17ce6c1'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:21.944311 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-d4614351-c56d-43e8-acba-ea8ae17ce6c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63469f22db9c47ac90f18ee9d4133802', 'request_id': 'req-d4614351-c56d-43e8-acba-ea8ae17ce6c1'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:21.963362 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-d4614351-c56d-43e8-acba-ea8ae17ce6c1 admin admin] The token cache is being invalidate because project 63469f22db9c47ac90f18ee9d4133802 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:35:21.963926 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-d4614351-c56d-43e8-acba-ea8ae17ce6c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:21.965005 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-d4614351-c56d-43e8-acba-ea8ae17ce6c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:21.967549 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1341/2678] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:35:21 2022] DELETE /identity/v3/projects/63469f22db9c47ac90f18ee9d4133802 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:35:21.975238 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05213ec4-25d8-44a7-ad70-435eeee4b89f None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:21.975525 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05213ec4-25d8-44a7-ad70-435eeee4b89f None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:21.975802 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05213ec4-25d8-44a7-ad70-435eeee4b89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:22.048985 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-05213ec4-25d8-44a7-ad70-435eeee4b89f None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:35:22.050722 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-05213ec4-25d8-44a7-ad70-435eeee4b89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:22.151031 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1338/2679] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:35:22.160978 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d329180-58b1-469f-befb-99d1a78ba1f5 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:22.161296 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d329180-58b1-469f-befb-99d1a78ba1f5 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:22.161571 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d329180-58b1-469f-befb-99d1a78ba1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:22.188734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-8d329180-58b1-469f-befb-99d1a78ba1f5 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:35:22.190316 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-8d329180-58b1-469f-befb-99d1a78ba1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:22.200082 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1342/2680] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:35:22.206967 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05213ec4-25d8-44a7-ad70-435eeee4b89f None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:22.221594 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05213ec4-25d8-44a7-ad70-435eeee4b89f None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:22.228612 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0c16e-7083-4e48-9f62-1ee3f33f0967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:22.229326 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0c16e-7083-4e48-9f62-1ee3f33f0967 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:22.229691 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0c16e-7083-4e48-9f62-1ee3f33f0967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:22.230139 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0c16e-7083-4e48-9f62-1ee3f33f0967 admin admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:22.230859 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d0c16e-7083-4e48-9f62-1ee3f33f0967 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:35:22.231178 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d0c16e-7083-4e48-9f62-1ee3f33f0967 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:22.232860 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d0c16e-7083-4e48-9f62-1ee3f33f0967 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:22.248383 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1339/2681] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:35:22.254824 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d329180-58b1-469f-befb-99d1a78ba1f5 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:22.265173 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d329180-58b1-469f-befb-99d1a78ba1f5 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:22.273997 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f72f9-88f0-4694-9128-819440a2c489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:22.274938 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f72f9-88f0-4694-9128-819440a2c489 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:22.275162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f72f9-88f0-4694-9128-819440a2c489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:22.275390 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f72f9-88f0-4694-9128-819440a2c489 admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:22.276053 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f72f9-88f0-4694-9128-819440a2c489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:22.278071 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f72f9-88f0-4694-9128-819440a2c489 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:22.312140 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1343/2682] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:35:22 2022] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:35:22.318430 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0c16e-7083-4e48-9f62-1ee3f33f0967 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:22.331172 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0c16e-7083-4e48-9f62-1ee3f33f0967 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:22.360770 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:22.406025 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23038c89-dde5-41c2-b934-526a8b3b1c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:22.407428 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23038c89-dde5-41c2-b934-526a8b3b1c8f admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:22.407913 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23038c89-dde5-41c2-b934-526a8b3b1c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:22.408194 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23038c89-dde5-41c2-b934-526a8b3b1c8f admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:22.408871 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23038c89-dde5-41c2-b934-526a8b3b1c8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:22.411143 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23038c89-dde5-41c2-b934-526a8b3b1c8f admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:22.437165 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1340/2683] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:35:22 2022] POST /identity/v3/users => generated 294 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:35:22.442304 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f72f9-88f0-4694-9128-819440a2c489 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:22.453782 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f72f9-88f0-4694-9128-819440a2c489 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:22.459267 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fb199-d765-421a-ad57-cb525e75b704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:22.459883 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fb199-d765-421a-ad57-cb525e75b704 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:22.460165 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fb199-d765-421a-ad57-cb525e75b704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:22.460434 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fb199-d765-421a-ad57-cb525e75b704 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:22.461083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0fb199-d765-421a-ad57-cb525e75b704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:22.462782 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0fb199-d765-421a-ad57-cb525e75b704 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:22.476344 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1344/2684] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:35:22.482873 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23038c89-dde5-41c2-b934-526a8b3b1c8f admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:22.496209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23038c89-dde5-41c2-b934-526a8b3b1c8f admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:22.501780 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0da3e-aa21-4daa-80aa-6327770a318d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:22.502415 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0da3e-aa21-4daa-80aa-6327770a318d admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:22.502691 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0da3e-aa21-4daa-80aa-6327770a318d admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:22.502963 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0da3e-aa21-4daa-80aa-6327770a318d admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:22.503640 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0da3e-aa21-4daa-80aa-6327770a318d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:22.505412 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0da3e-aa21-4daa-80aa-6327770a318d admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:22.519225 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1341/2685] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:35:22.524141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fb199-d765-421a-ad57-cb525e75b704 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:22.538938 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fb199-d765-421a-ad57-cb525e75b704 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:22.544399 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1084f-c8d6-4f49-8d65-608dc037df7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:22.545147 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1084f-c8d6-4f49-8d65-608dc037df7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:22.545518 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1084f-c8d6-4f49-8d65-608dc037df7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:22.545831 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1084f-c8d6-4f49-8d65-608dc037df7a admin admin] PATH_INFO: `/v3/projects/28f76ce0d4a64dc9ad631bc633bd9a47/users/0e26a301f20d438fa29f1226d7f47a45/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:22.575147 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1084f-c8d6-4f49-8d65-608dc037df7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=28f76ce0d4a64dc9ad631bc633bd9a47, user_id=0e26a301f20d438fa29f1226d7f47a45, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:22.577822 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1084f-c8d6-4f49-8d65-608dc037df7a admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:22.601283 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1345/2686] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:35:22 2022] PUT /identity/v3/projects/28f76ce0d4a64dc9ad631bc633bd9a47/users/0e26a301f20d438fa29f1226d7f47a45/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:35:22.619381 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a48ab-edc1-4909-aa04-642371c466ab None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:22.619812 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a48ab-edc1-4909-aa04-642371c466ab None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:22.620211 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a48ab-edc1-4909-aa04-642371c466ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:22.663518 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-a02a48ab-edc1-4909-aa04-642371c466ab None None] MFA Rules not processed for user `0e26a301f20d438fa29f1226d7f47a45`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:35:22.664908 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-a02a48ab-edc1-4909-aa04-642371c466ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:22.769296 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1342/2687] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:35:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:35:22.775382 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1084f-c8d6-4f49-8d65-608dc037df7a admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:22.829156 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:22.890713 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1084f-c8d6-4f49-8d65-608dc037df7a admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:22.896770 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5d195-18f1-47aa-84d6-d5279cedd508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:22.897602 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5d195-18f1-47aa-84d6-d5279cedd508 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:22.897923 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5d195-18f1-47aa-84d6-d5279cedd508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:22.898198 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5d195-18f1-47aa-84d6-d5279cedd508 admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:22.898961 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f5d195-18f1-47aa-84d6-d5279cedd508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:22.901059 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f5d195-18f1-47aa-84d6-d5279cedd508 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:22.941071 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1346/2688] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:35:22 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:35:22.947237 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a48ab-edc1-4909-aa04-642371c466ab None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:22.963390 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a48ab-edc1-4909-aa04-642371c466ab None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:23.058545 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef715a-9045-4e8e-bf94-f3bd6d59d782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:23.059156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef715a-9045-4e8e-bf94-f3bd6d59d782 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:23.059437 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef715a-9045-4e8e-bf94-f3bd6d59d782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:23.059711 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef715a-9045-4e8e-bf94-f3bd6d59d782 admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:23.060353 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef715a-9045-4e8e-bf94-f3bd6d59d782 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:23.062921 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef715a-9045-4e8e-bf94-f3bd6d59d782 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:23.097946 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1343/2689] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:35:22 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:35:23.099196 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5d195-18f1-47aa-84d6-d5279cedd508 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:23.111998 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5d195-18f1-47aa-84d6-d5279cedd508 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:23.117276 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6499d-8f57-413b-bc88-0c666ea01a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:23.117973 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6499d-8f57-413b-bc88-0c666ea01a7e admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:23.118249 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6499d-8f57-413b-bc88-0c666ea01a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:23.118543 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6499d-8f57-413b-bc88-0c666ea01a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:23.119201 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c6499d-8f57-413b-bc88-0c666ea01a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:23.121018 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c6499d-8f57-413b-bc88-0c666ea01a7e admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:23.134307 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1347/2690] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:35:23.138866 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef715a-9045-4e8e-bf94-f3bd6d59d782 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:23.150282 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef715a-9045-4e8e-bf94-f3bd6d59d782 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:23.155312 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d55e7-e0a3-4bc5-9c15-6026ed1a3efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:23.156563 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d55e7-e0a3-4bc5-9c15-6026ed1a3efc admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:23.156786 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d55e7-e0a3-4bc5-9c15-6026ed1a3efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:23.157057 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d55e7-e0a3-4bc5-9c15-6026ed1a3efc admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:23.158001 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d55e7-e0a3-4bc5-9c15-6026ed1a3efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:23.159709 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d55e7-e0a3-4bc5-9c15-6026ed1a3efc admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:23.171400 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1344/2691] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:35:23.177821 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6499d-8f57-413b-bc88-0c666ea01a7e admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:23.189899 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6499d-8f57-413b-bc88-0c666ea01a7e admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:23.194888 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29615b8d-f18b-4e67-a008-7745c8b6cecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:23.195696 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29615b8d-f18b-4e67-a008-7745c8b6cecb admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:23.196106 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29615b8d-f18b-4e67-a008-7745c8b6cecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:23.196570 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29615b8d-f18b-4e67-a008-7745c8b6cecb admin admin] PATH_INFO: `/v3/projects/e499d876b4e84a36964e8cc74d8ec4dd/users/e7ac51c8ca7749a795fc28d4f780b84f/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:23.217327 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29615b8d-f18b-4e67-a008-7745c8b6cecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e499d876b4e84a36964e8cc74d8ec4dd, user_id=e7ac51c8ca7749a795fc28d4f780b84f, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:23.222012 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29615b8d-f18b-4e67-a008-7745c8b6cecb admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:23.239367 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1348/2692] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:35:23 2022] PUT /identity/v3/projects/e499d876b4e84a36964e8cc74d8ec4dd/users/e7ac51c8ca7749a795fc28d4f780b84f/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:35:23.252041 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e4771-dd01-4d9f-a6e8-ced26e70399f None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:23.252599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e4771-dd01-4d9f-a6e8-ced26e70399f None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:23.253037 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e4771-dd01-4d9f-a6e8-ced26e70399f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:23.287049 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:23.298045 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-014e4771-dd01-4d9f-a6e8-ced26e70399f None None] MFA Rules not processed for user `e7ac51c8ca7749a795fc28d4f780b84f`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:35:23.300211 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-014e4771-dd01-4d9f-a6e8-ced26e70399f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:23.381750 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1345/2693] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:35:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:35:23.386653 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29615b8d-f18b-4e67-a008-7745c8b6cecb admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:23.461915 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29615b8d-f18b-4e67-a008-7745c8b6cecb admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:23.468198 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a805fa4-38c7-4f6e-9bb8-38a0c588ebbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:23.469835 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a805fa4-38c7-4f6e-9bb8-38a0c588ebbe admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:23.470245 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a805fa4-38c7-4f6e-9bb8-38a0c588ebbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:23.470548 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a805fa4-38c7-4f6e-9bb8-38a0c588ebbe admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:23.471324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a805fa4-38c7-4f6e-9bb8-38a0c588ebbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:23.473804 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a805fa4-38c7-4f6e-9bb8-38a0c588ebbe admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:23.511270 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1349/2694] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:35:23 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:35:23.518067 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e4771-dd01-4d9f-a6e8-ced26e70399f None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:23.530498 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e4771-dd01-4d9f-a6e8-ced26e70399f None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:23.619630 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f67a47-0c1a-4bbe-acf2-c6df4b4f1c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:23.620471 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f67a47-0c1a-4bbe-acf2-c6df4b4f1c13 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:23.622863 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f67a47-0c1a-4bbe-acf2-c6df4b4f1c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:23.622863 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f67a47-0c1a-4bbe-acf2-c6df4b4f1c13 admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:23.622863 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f67a47-0c1a-4bbe-acf2-c6df4b4f1c13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:23.623697 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f67a47-0c1a-4bbe-acf2-c6df4b4f1c13 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:23.654326 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1346/2695] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:35:23 2022] POST /identity/v3/users => generated 300 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:35:23.662916 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a805fa4-38c7-4f6e-9bb8-38a0c588ebbe admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:23.675338 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a805fa4-38c7-4f6e-9bb8-38a0c588ebbe admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:23.680811 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d6e57-1e4d-4207-b8c5-5fd15a02c464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:23.681483 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d6e57-1e4d-4207-b8c5-5fd15a02c464 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:23.681794 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d6e57-1e4d-4207-b8c5-5fd15a02c464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:23.682152 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d6e57-1e4d-4207-b8c5-5fd15a02c464 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:23.682752 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d6e57-1e4d-4207-b8c5-5fd15a02c464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:23.684397 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d6e57-1e4d-4207-b8c5-5fd15a02c464 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:23.699446 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1350/2696] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:35:23.705976 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f67a47-0c1a-4bbe-acf2-c6df4b4f1c13 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:23.716737 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f67a47-0c1a-4bbe-acf2-c6df4b4f1c13 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:23.723411 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe823c-eab3-4d58-b26b-9968bdabbf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:23.724035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe823c-eab3-4d58-b26b-9968bdabbf2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:23.724314 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe823c-eab3-4d58-b26b-9968bdabbf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:23.724587 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe823c-eab3-4d58-b26b-9968bdabbf2b admin admin] PATH_INFO: `/v3/projects/34bf5357697a43de80a9c433433c259d/users/87a08da7feab432d85b41e6d1ddc8f0e/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:23.753935 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe823c-eab3-4d58-b26b-9968bdabbf2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=34bf5357697a43de80a9c433433c259d, user_id=87a08da7feab432d85b41e6d1ddc8f0e, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:23.758469 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe823c-eab3-4d58-b26b-9968bdabbf2b admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:23.784478 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1347/2697] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:35:23 2022] PUT /identity/v3/projects/34bf5357697a43de80a9c433433c259d/users/87a08da7feab432d85b41e6d1ddc8f0e/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:35:23.789105 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d6e57-1e4d-4207-b8c5-5fd15a02c464 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:23.803208 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d6e57-1e4d-4207-b8c5-5fd15a02c464 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:23.857741 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:23.873860 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911c6b5-c57e-4289-84fa-dd74d59ac1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:23.874469 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911c6b5-c57e-4289-84fa-dd74d59ac1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:23.875120 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911c6b5-c57e-4289-84fa-dd74d59ac1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:23.875400 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911c6b5-c57e-4289-84fa-dd74d59ac1c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:23.876050 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911c6b5-c57e-4289-84fa-dd74d59ac1c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:23.877679 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911c6b5-c57e-4289-84fa-dd74d59ac1c6 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:23.889310 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1351/2698] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:35:23.893715 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe823c-eab3-4d58-b26b-9968bdabbf2b admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:23.904888 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe823c-eab3-4d58-b26b-9968bdabbf2b admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:23.912193 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0c6ad-7e39-4784-ac54-5950cf5a9cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:23.912867 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0c6ad-7e39-4784-ac54-5950cf5a9cc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:23.913144 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0c6ad-7e39-4784-ac54-5950cf5a9cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:23.913443 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0c6ad-7e39-4784-ac54-5950cf5a9cc8 admin admin] PATH_INFO: `/v3/projects/34bf5357697a43de80a9c433433c259d/users/87a08da7feab432d85b41e6d1ddc8f0e/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:23.915376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0c6ad-7e39-4784-ac54-5950cf5a9cc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34bf5357697a43de80a9c433433c259d, user_id=87a08da7feab432d85b41e6d1ddc8f0e, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:23.918096 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0c6ad-7e39-4784-ac54-5950cf5a9cc8 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:23.930132 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1348/2699] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:35:23 2022] PUT /identity/v3/projects/34bf5357697a43de80a9c433433c259d/users/87a08da7feab432d85b41e6d1ddc8f0e/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:35:23.940762 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33ddc5-6844-413d-a5cd-2277953636e2 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:23.941029 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33ddc5-6844-413d-a5cd-2277953636e2 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:23.941294 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33ddc5-6844-413d-a5cd-2277953636e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:23.974658 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-1e33ddc5-6844-413d-a5cd-2277953636e2 None None] MFA Rules not processed for user `87a08da7feab432d85b41e6d1ddc8f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:35:23.976375 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-1e33ddc5-6844-413d-a5cd-2277953636e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:24.068943 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1352/2700] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:35:23 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:35:24.083522 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0c6ad-7e39-4784-ac54-5950cf5a9cc8 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:24.085348 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-00a0c6ad-7e39-4784-ac54-5950cf5a9cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:24.148500 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0c6ad-7e39-4784-ac54-5950cf5a9cc8 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:24.152346 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc651e-f97e-4432-9bcd-3712bda8d9bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:24.152978 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc651e-f97e-4432-9bcd-3712bda8d9bb service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:24.153257 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc651e-f97e-4432-9bcd-3712bda8d9bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:24.153569 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc651e-f97e-4432-9bcd-3712bda8d9bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:24.162773 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:24.165580 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc651e-f97e-4432-9bcd-3712bda8d9bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:24.167512 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc651e-f97e-4432-9bcd-3712bda8d9bb service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:24.179393 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1349/2701] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:35:24 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:35:24.834195 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33ddc5-6844-413d-a5cd-2277953636e2 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:24.835755 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-1e33ddc5-6844-413d-a5cd-2277953636e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:24.848613 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33ddc5-6844-413d-a5cd-2277953636e2 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:24.852297 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4ad96-14c8-4ef2-a04e-39a999672ee3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:24.852921 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4ad96-14c8-4ef2-a04e-39a999672ee3 service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:24.853198 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4ad96-14c8-4ef2-a04e-39a999672ee3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:24.853493 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4ad96-14c8-4ef2-a04e-39a999672ee3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:24.925728 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4ad96-14c8-4ef2-a04e-39a999672ee3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:24.927274 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4ad96-14c8-4ef2-a04e-39a999672ee3 service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:24.939170 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1353/2702] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:35:24 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:35:29.342731 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc651e-f97e-4432-9bcd-3712bda8d9bb service cinder] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:29.353180 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc651e-f97e-4432-9bcd-3712bda8d9bb service cinder] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:29.357001 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c4fd2-11ca-4ba6-a61c-903cb6b0a2a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:29.357663 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c4fd2-11ca-4ba6-a61c-903cb6b0a2a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:29.357971 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c4fd2-11ca-4ba6-a61c-903cb6b0a2a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:29.358251 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c4fd2-11ca-4ba6-a61c-903cb6b0a2a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:29.427291 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c4fd2-11ca-4ba6-a61c-903cb6b0a2a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:29.428851 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c4fd2-11ca-4ba6-a61c-903cb6b0a2a3 service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:29.441446 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1350/2703] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:35:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:35:32.023361 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4ad96-14c8-4ef2-a04e-39a999672ee3 service cinder] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:32.126773 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4ad96-14c8-4ef2-a04e-39a999672ee3 service cinder] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:32.132396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca51e7-325e-4447-912d-75014b9142e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:32.133241 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca51e7-325e-4447-912d-75014b9142e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:32.133685 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca51e7-325e-4447-912d-75014b9142e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:32.134019 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca51e7-325e-4447-912d-75014b9142e6 admin admin] PATH_INFO: `/v3/users/0e26a301f20d438fa29f1226d7f47a45` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:32.135624 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca51e7-325e-4447-912d-75014b9142e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e26a301f20d438fa29f1226d7f47a45)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:32.137944 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca51e7-325e-4447-912d-75014b9142e6 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:32.146152 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:32.219056 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2dca51e7-325e-4447-912d-75014b9142e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e26a301f20d438fa29f1226d7f47a45'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:32.220299 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2dca51e7-325e-4447-912d-75014b9142e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e26a301f20d438fa29f1226d7f47a45'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:32.232998 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2dca51e7-325e-4447-912d-75014b9142e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e26a301f20d438fa29f1226d7f47a45'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:32.244722 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2dca51e7-325e-4447-912d-75014b9142e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e26a301f20d438fa29f1226d7f47a45'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:32.263022 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2dca51e7-325e-4447-912d-75014b9142e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e26a301f20d438fa29f1226d7f47a45'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:32.271193 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1354/2704] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:35:32 2022] DELETE /identity/v3/users/0e26a301f20d438fa29f1226d7f47a45 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:35:32.277668 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899f2aa-436f-42db-950c-4784d44b03ea None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:32.278519 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899f2aa-436f-42db-950c-4784d44b03ea None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:32.278719 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899f2aa-436f-42db-950c-4784d44b03ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:32.311436 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-3899f2aa-436f-42db-950c-4784d44b03ea None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:35:32.314324 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-3899f2aa-436f-42db-950c-4784d44b03ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:32.391402 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1351/2705] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:35:32.402066 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca51e7-325e-4447-912d-75014b9142e6 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:32.403866 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-2dca51e7-325e-4447-912d-75014b9142e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:32.489406 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca51e7-325e-4447-912d-75014b9142e6 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:32.493145 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f39680-d512-4445-9678-9ae35aa0ced6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:32.493786 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f39680-d512-4445-9678-9ae35aa0ced6 service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:32.494062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f39680-d512-4445-9678-9ae35aa0ced6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:32.494330 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f39680-d512-4445-9678-9ae35aa0ced6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:32.506141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f39680-d512-4445-9678-9ae35aa0ced6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:32.507806 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f39680-d512-4445-9678-9ae35aa0ced6 service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:32.519009 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1355/2706] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:35:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:35:32.928699 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899f2aa-436f-42db-950c-4784d44b03ea None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:32.930675 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-3899f2aa-436f-42db-950c-4784d44b03ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:32.946342 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899f2aa-436f-42db-950c-4784d44b03ea None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:32.951865 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9d1cb-3566-4b90-8daa-adb12fc31df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:32.953525 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9d1cb-3566-4b90-8daa-adb12fc31df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:32.954124 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9d1cb-3566-4b90-8daa-adb12fc31df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:32.954639 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9d1cb-3566-4b90-8daa-adb12fc31df9 admin admin] PATH_INFO: `/v3/projects/28f76ce0d4a64dc9ad631bc633bd9a47` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:32.956934 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9d1cb-3566-4b90-8daa-adb12fc31df9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28f76ce0d4a64dc9ad631bc633bd9a47)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:32.958697 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9d1cb-3566-4b90-8daa-adb12fc31df9 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:33.028375 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f9a9d1cb-3566-4b90-8daa-adb12fc31df9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28f76ce0d4a64dc9ad631bc633bd9a47', 'request_id': 'req-f9a9d1cb-3566-4b90-8daa-adb12fc31df9'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:33.037060 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f9a9d1cb-3566-4b90-8daa-adb12fc31df9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28f76ce0d4a64dc9ad631bc633bd9a47', 'request_id': 'req-f9a9d1cb-3566-4b90-8daa-adb12fc31df9'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:33.047789 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f9a9d1cb-3566-4b90-8daa-adb12fc31df9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28f76ce0d4a64dc9ad631bc633bd9a47', 'request_id': 'req-f9a9d1cb-3566-4b90-8daa-adb12fc31df9'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:33.060648 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f9a9d1cb-3566-4b90-8daa-adb12fc31df9 admin admin] The token cache is being invalidate because project 28f76ce0d4a64dc9ad631bc633bd9a47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:35:33.060974 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f9a9d1cb-3566-4b90-8daa-adb12fc31df9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:33.061914 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f9a9d1cb-3566-4b90-8daa-adb12fc31df9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:33.064413 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1352/2707] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:35:32 2022] DELETE /identity/v3/projects/28f76ce0d4a64dc9ad631bc633bd9a47 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:35:33.068980 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f39680-d512-4445-9678-9ae35aa0ced6 service neutron] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:33.080331 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f39680-d512-4445-9678-9ae35aa0ced6 service neutron] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:33.148798 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684b7d8-ea53-4ab9-9fdc-0855f7b5f1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:33.149490 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684b7d8-ea53-4ab9-9fdc-0855f7b5f1ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:33.149773 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684b7d8-ea53-4ab9-9fdc-0855f7b5f1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:33.150048 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684b7d8-ea53-4ab9-9fdc-0855f7b5f1ba admin admin] PATH_INFO: `/v3/users/e7ac51c8ca7749a795fc28d4f780b84f` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:33.151357 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684b7d8-ea53-4ab9-9fdc-0855f7b5f1ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7ac51c8ca7749a795fc28d4f780b84f)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:33.153436 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684b7d8-ea53-4ab9-9fdc-0855f7b5f1ba admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:33.205564 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:33.226375 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-c684b7d8-ea53-4ab9-9fdc-0855f7b5f1ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7ac51c8ca7749a795fc28d4f780b84f'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:33.227266 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-c684b7d8-ea53-4ab9-9fdc-0855f7b5f1ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7ac51c8ca7749a795fc28d4f780b84f'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:33.247105 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-c684b7d8-ea53-4ab9-9fdc-0855f7b5f1ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7ac51c8ca7749a795fc28d4f780b84f'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:33.259775 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-c684b7d8-ea53-4ab9-9fdc-0855f7b5f1ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7ac51c8ca7749a795fc28d4f780b84f'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:33.280523 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-c684b7d8-ea53-4ab9-9fdc-0855f7b5f1ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7ac51c8ca7749a795fc28d4f780b84f'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:33.294325 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1356/2708] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:35:33 2022] DELETE /identity/v3/users/e7ac51c8ca7749a795fc28d4f780b84f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:35:33.729078 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9d1cb-3566-4b90-8daa-adb12fc31df9 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:33.730925 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-f9a9d1cb-3566-4b90-8daa-adb12fc31df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:33.769614 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9d1cb-3566-4b90-8daa-adb12fc31df9 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:33.805816 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:33.864368 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2141b5-fc1f-4082-978c-7ab69c461ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:33.865024 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2141b5-fc1f-4082-978c-7ab69c461ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:33.865303 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2141b5-fc1f-4082-978c-7ab69c461ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:33.865622 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2141b5-fc1f-4082-978c-7ab69c461ca1 admin admin] PATH_INFO: `/v3/projects/e499d876b4e84a36964e8cc74d8ec4dd` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:33.866942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2141b5-fc1f-4082-978c-7ab69c461ca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e499d876b4e84a36964e8cc74d8ec4dd)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:33.868955 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2141b5-fc1f-4082-978c-7ab69c461ca1 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:33.935185 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-5f2141b5-fc1f-4082-978c-7ab69c461ca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e499d876b4e84a36964e8cc74d8ec4dd', 'request_id': 'req-5f2141b5-fc1f-4082-978c-7ab69c461ca1'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:33.944266 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-5f2141b5-fc1f-4082-978c-7ab69c461ca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e499d876b4e84a36964e8cc74d8ec4dd', 'request_id': 'req-5f2141b5-fc1f-4082-978c-7ab69c461ca1'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:33.955058 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-5f2141b5-fc1f-4082-978c-7ab69c461ca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e499d876b4e84a36964e8cc74d8ec4dd', 'request_id': 'req-5f2141b5-fc1f-4082-978c-7ab69c461ca1'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:33.969290 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-5f2141b5-fc1f-4082-978c-7ab69c461ca1 admin admin] The token cache is being invalidate because project e499d876b4e84a36964e8cc74d8ec4dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:35:33.969638 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-5f2141b5-fc1f-4082-978c-7ab69c461ca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:33.970346 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-5f2141b5-fc1f-4082-978c-7ab69c461ca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:33.972202 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1353/2709] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:35:33 2022] DELETE /identity/v3/projects/e499d876b4e84a36964e8cc74d8ec4dd => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:35:33.976519 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684b7d8-ea53-4ab9-9fdc-0855f7b5f1ba admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:33.978186 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-c684b7d8-ea53-4ab9-9fdc-0855f7b5f1ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:33.994695 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684b7d8-ea53-4ab9-9fdc-0855f7b5f1ba admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:34.075619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1960b45-ae31-494d-82eb-0dd1be3c9db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:34.076803 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1960b45-ae31-494d-82eb-0dd1be3c9db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:34.076803 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1960b45-ae31-494d-82eb-0dd1be3c9db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:34.077163 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1960b45-ae31-494d-82eb-0dd1be3c9db9 admin admin] PATH_INFO: `/v3/users/87a08da7feab432d85b41e6d1ddc8f0e` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:34.079072 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1960b45-ae31-494d-82eb-0dd1be3c9db9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87a08da7feab432d85b41e6d1ddc8f0e)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:34.081605 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1960b45-ae31-494d-82eb-0dd1be3c9db9 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:34.156213 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-a1960b45-ae31-494d-82eb-0dd1be3c9db9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87a08da7feab432d85b41e6d1ddc8f0e'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:34.157579 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-a1960b45-ae31-494d-82eb-0dd1be3c9db9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87a08da7feab432d85b41e6d1ddc8f0e'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:34.168020 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-a1960b45-ae31-494d-82eb-0dd1be3c9db9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87a08da7feab432d85b41e6d1ddc8f0e'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:34.179658 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-a1960b45-ae31-494d-82eb-0dd1be3c9db9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87a08da7feab432d85b41e6d1ddc8f0e'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:34.201627 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-a1960b45-ae31-494d-82eb-0dd1be3c9db9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87a08da7feab432d85b41e6d1ddc8f0e'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:34.213523 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1357/2710] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:35:33 2022] DELETE /identity/v3/users/87a08da7feab432d85b41e6d1ddc8f0e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:35:34.614182 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2141b5-fc1f-4082-978c-7ab69c461ca1 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:34.615766 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-5f2141b5-fc1f-4082-978c-7ab69c461ca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:34.635704 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2141b5-fc1f-4082-978c-7ab69c461ca1 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:34.725553 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68380b-6860-45bd-acf4-fdbf1f882a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:34.726244 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68380b-6860-45bd-acf4-fdbf1f882a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:34.726572 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68380b-6860-45bd-acf4-fdbf1f882a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:34.726805 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68380b-6860-45bd-acf4-fdbf1f882a36 admin admin] PATH_INFO: `/v3/projects/34bf5357697a43de80a9c433433c259d` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:34.728160 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68380b-6860-45bd-acf4-fdbf1f882a36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34bf5357697a43de80a9c433433c259d)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:34.730250 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68380b-6860-45bd-acf4-fdbf1f882a36 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:34.796644 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-4b68380b-6860-45bd-acf4-fdbf1f882a36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34bf5357697a43de80a9c433433c259d', 'request_id': 'req-4b68380b-6860-45bd-acf4-fdbf1f882a36'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:34.798727 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:34.807233 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-4b68380b-6860-45bd-acf4-fdbf1f882a36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34bf5357697a43de80a9c433433c259d', 'request_id': 'req-4b68380b-6860-45bd-acf4-fdbf1f882a36'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:34.817854 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-4b68380b-6860-45bd-acf4-fdbf1f882a36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34bf5357697a43de80a9c433433c259d', 'request_id': 'req-4b68380b-6860-45bd-acf4-fdbf1f882a36'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:34.838372 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-4b68380b-6860-45bd-acf4-fdbf1f882a36 admin admin] The token cache is being invalidate because project 34bf5357697a43de80a9c433433c259d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:35:34.838876 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-4b68380b-6860-45bd-acf4-fdbf1f882a36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:34.840044 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-4b68380b-6860-45bd-acf4-fdbf1f882a36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:34.842675 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1354/2711] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:35:34 2022] DELETE /identity/v3/projects/34bf5357697a43de80a9c433433c259d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:35:34.855516 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baeed7a-ed7f-4969-a65d-6ffc0644e527 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:34.856234 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baeed7a-ed7f-4969-a65d-6ffc0644e527 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:34.856771 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baeed7a-ed7f-4969-a65d-6ffc0644e527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:34.886137 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-9baeed7a-ed7f-4969-a65d-6ffc0644e527 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:35:34.887557 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-9baeed7a-ed7f-4969-a65d-6ffc0644e527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:34.913132 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:34.987047 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1358/2712] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:35:34.989477 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518172c-126e-4cd2-a124-63107752cc67 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:34.989910 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518172c-126e-4cd2-a124-63107752cc67 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:34.991100 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518172c-126e-4cd2-a124-63107752cc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:35.019456 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-0518172c-126e-4cd2-a124-63107752cc67 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:35:35.020945 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-0518172c-126e-4cd2-a124-63107752cc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:35.029989 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1355/2713] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:35:35.036626 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baeed7a-ed7f-4969-a65d-6ffc0644e527 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:35.055988 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baeed7a-ed7f-4969-a65d-6ffc0644e527 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:35.064458 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83899f67-c0e7-441b-8d43-69c3df9e5624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:35.065512 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83899f67-c0e7-441b-8d43-69c3df9e5624 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:35.065982 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83899f67-c0e7-441b-8d43-69c3df9e5624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:35.066434 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83899f67-c0e7-441b-8d43-69c3df9e5624 admin admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:35.067610 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83899f67-c0e7-441b-8d43-69c3df9e5624 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:35:35.068128 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83899f67-c0e7-441b-8d43-69c3df9e5624 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:35.071177 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83899f67-c0e7-441b-8d43-69c3df9e5624 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:35.092701 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1359/2714] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:35:35.094056 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518172c-126e-4cd2-a124-63107752cc67 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:35.105108 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518172c-126e-4cd2-a124-63107752cc67 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:35.112945 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c9b24-1c27-48a8-8c00-f4f7d3dc6655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:35.114010 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c9b24-1c27-48a8-8c00-f4f7d3dc6655 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:35.114201 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c9b24-1c27-48a8-8c00-f4f7d3dc6655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:35.114590 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c9b24-1c27-48a8-8c00-f4f7d3dc6655 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:35.115362 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c9b24-1c27-48a8-8c00-f4f7d3dc6655 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:35.117773 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c9b24-1c27-48a8-8c00-f4f7d3dc6655 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:35.167358 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1356/2715] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:35:35 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:35:35.168636 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83899f67-c0e7-441b-8d43-69c3df9e5624 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:35.181711 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83899f67-c0e7-441b-8d43-69c3df9e5624 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:35.277954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88dfea2-f86b-4fdd-8b61-0b4fc9799060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:35.279282 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88dfea2-f86b-4fdd-8b61-0b4fc9799060 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:35.279869 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88dfea2-f86b-4fdd-8b61-0b4fc9799060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:35.280300 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88dfea2-f86b-4fdd-8b61-0b4fc9799060 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:35.281957 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88dfea2-f86b-4fdd-8b61-0b4fc9799060 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:35.284172 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88dfea2-f86b-4fdd-8b61-0b4fc9799060 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:35.315487 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1360/2716] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:35:35 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:35:35.316932 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c9b24-1c27-48a8-8c00-f4f7d3dc6655 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:35.329866 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c9b24-1c27-48a8-8c00-f4f7d3dc6655 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:35.337348 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27352e47-fe53-41b5-aae6-a4d0fafe91c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:35.337757 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27352e47-fe53-41b5-aae6-a4d0fafe91c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:35.337757 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27352e47-fe53-41b5-aae6-a4d0fafe91c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:35.338025 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27352e47-fe53-41b5-aae6-a4d0fafe91c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:35.338828 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27352e47-fe53-41b5-aae6-a4d0fafe91c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:35.340673 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27352e47-fe53-41b5-aae6-a4d0fafe91c6 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:35.360277 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1357/2717] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:35:35.361875 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88dfea2-f86b-4fdd-8b61-0b4fc9799060 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:35.380099 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88dfea2-f86b-4fdd-8b61-0b4fc9799060 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:35.389177 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9775e-9782-4736-83c8-2a5b75ebf8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:35.390245 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9775e-9782-4736-83c8-2a5b75ebf8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:35.390862 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9775e-9782-4736-83c8-2a5b75ebf8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:35.391300 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9775e-9782-4736-83c8-2a5b75ebf8b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:35.392487 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9775e-9782-4736-83c8-2a5b75ebf8b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:35.395564 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9775e-9782-4736-83c8-2a5b75ebf8b1 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:35.417779 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1361/2718] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:35:35.423467 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27352e47-fe53-41b5-aae6-a4d0fafe91c6 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:35.439102 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27352e47-fe53-41b5-aae6-a4d0fafe91c6 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:35.445267 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ad7af-e59c-460c-85cf-0d85f7fddc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:35.446265 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ad7af-e59c-460c-85cf-0d85f7fddc0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:35.446721 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ad7af-e59c-460c-85cf-0d85f7fddc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:35.447112 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ad7af-e59c-460c-85cf-0d85f7fddc0c admin admin] PATH_INFO: `/v3/projects/af2d0fd5bdcc41e28f6ffbd99031cf3a/users/0bfb831f7a1241fd8cebc5d9ab8c8a91/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:35.471467 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ad7af-e59c-460c-85cf-0d85f7fddc0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=af2d0fd5bdcc41e28f6ffbd99031cf3a, user_id=0bfb831f7a1241fd8cebc5d9ab8c8a91, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:35.474980 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ad7af-e59c-460c-85cf-0d85f7fddc0c admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:35.498691 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1358/2719] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:35:35 2022] PUT /identity/v3/projects/af2d0fd5bdcc41e28f6ffbd99031cf3a/users/0bfb831f7a1241fd8cebc5d9ab8c8a91/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:35:35.511338 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540061d2-3c14-4e31-9758-eb432997f0ea None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:35.511647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540061d2-3c14-4e31-9758-eb432997f0ea None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:35.511886 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540061d2-3c14-4e31-9758-eb432997f0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:35.550661 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-540061d2-3c14-4e31-9758-eb432997f0ea None None] MFA Rules not processed for user `0bfb831f7a1241fd8cebc5d9ab8c8a91`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:35:35.552056 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-540061d2-3c14-4e31-9758-eb432997f0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:35.651359 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1362/2720] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:35:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:35:35.668899 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ad7af-e59c-460c-85cf-0d85f7fddc0c admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:35.672699 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-7c0ad7af-e59c-460c-85cf-0d85f7fddc0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:35.781661 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ad7af-e59c-460c-85cf-0d85f7fddc0c admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:35.792440 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d233cc9-ece9-44dc-8b88-11a52c5901ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:35.793319 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d233cc9-ece9-44dc-8b88-11a52c5901ae service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:35.793813 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d233cc9-ece9-44dc-8b88-11a52c5901ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:35.794306 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d233cc9-ece9-44dc-8b88-11a52c5901ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:35.808754 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d233cc9-ece9-44dc-8b88-11a52c5901ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:35.811035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d233cc9-ece9-44dc-8b88-11a52c5901ae service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:35.828153 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1359/2721] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:35:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:35:35.861061 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540061d2-3c14-4e31-9758-eb432997f0ea None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:35.919596 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:35.998841 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540061d2-3c14-4e31-9758-eb432997f0ea None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:36.007828 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948f323-2fe3-4526-b14a-4eb5c153848e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:36.009077 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948f323-2fe3-4526-b14a-4eb5c153848e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:36.009665 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948f323-2fe3-4526-b14a-4eb5c153848e admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:36.010177 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948f323-2fe3-4526-b14a-4eb5c153848e admin admin] PATH_INFO: `/v3/users/0bfb831f7a1241fd8cebc5d9ab8c8a91` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:36.012534 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948f323-2fe3-4526-b14a-4eb5c153848e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bfb831f7a1241fd8cebc5d9ab8c8a91)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:36.017062 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948f323-2fe3-4526-b14a-4eb5c153848e admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:36.132252 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-4948f323-2fe3-4526-b14a-4eb5c153848e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bfb831f7a1241fd8cebc5d9ab8c8a91'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:36.134192 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-4948f323-2fe3-4526-b14a-4eb5c153848e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bfb831f7a1241fd8cebc5d9ab8c8a91'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:36.150383 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-4948f323-2fe3-4526-b14a-4eb5c153848e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bfb831f7a1241fd8cebc5d9ab8c8a91'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:36.166724 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-4948f323-2fe3-4526-b14a-4eb5c153848e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bfb831f7a1241fd8cebc5d9ab8c8a91'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:36.198996 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-4948f323-2fe3-4526-b14a-4eb5c153848e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bfb831f7a1241fd8cebc5d9ab8c8a91'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:36.220554 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1363/2722] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:35:35 2022] DELETE /identity/v3/users/0bfb831f7a1241fd8cebc5d9ab8c8a91 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:35:36.223671 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55cc6c-b203-4fc5-a320-ea0d25bb0cf2 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:36.224598 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55cc6c-b203-4fc5-a320-ea0d25bb0cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:36.225405 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55cc6c-b203-4fc5-a320-ea0d25bb0cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:36.267055 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-4d55cc6c-b203-4fc5-a320-ea0d25bb0cf2 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:35:36.271859 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-4d55cc6c-b203-4fc5-a320-ea0d25bb0cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:36.439118 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1360/2723] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:35:36.455811 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948f323-2fe3-4526-b14a-4eb5c153848e admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:36.458359 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-4948f323-2fe3-4526-b14a-4eb5c153848e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:36.553512 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948f323-2fe3-4526-b14a-4eb5c153848e admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:36.559671 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b5010-c86d-4da7-a066-e7ff16286ddb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:36.560722 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b5010-c86d-4da7-a066-e7ff16286ddb service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:36.561148 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b5010-c86d-4da7-a066-e7ff16286ddb service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:36.561675 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b5010-c86d-4da7-a066-e7ff16286ddb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:36.580701 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b5010-c86d-4da7-a066-e7ff16286ddb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:36.583715 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b5010-c86d-4da7-a066-e7ff16286ddb service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:36.603980 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1364/2724] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:35:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:35:37.155068 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55cc6c-b203-4fc5-a320-ea0d25bb0cf2 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:37.157991 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-4d55cc6c-b203-4fc5-a320-ea0d25bb0cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:37.186201 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55cc6c-b203-4fc5-a320-ea0d25bb0cf2 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:37.209713 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c93fb-4a2a-4ad9-8d56-03b6a4056b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:37.211187 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c93fb-4a2a-4ad9-8d56-03b6a4056b54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:37.212870 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c93fb-4a2a-4ad9-8d56-03b6a4056b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:37.213906 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c93fb-4a2a-4ad9-8d56-03b6a4056b54 admin admin] PATH_INFO: `/v3/projects/af2d0fd5bdcc41e28f6ffbd99031cf3a` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:37.220714 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c93fb-4a2a-4ad9-8d56-03b6a4056b54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af2d0fd5bdcc41e28f6ffbd99031cf3a)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:37.224719 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c93fb-4a2a-4ad9-8d56-03b6a4056b54 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:37.241202 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:37.307981 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-4a4c93fb-4a2a-4ad9-8d56-03b6a4056b54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af2d0fd5bdcc41e28f6ffbd99031cf3a', 'request_id': 'req-4a4c93fb-4a2a-4ad9-8d56-03b6a4056b54'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:37.318347 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-4a4c93fb-4a2a-4ad9-8d56-03b6a4056b54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af2d0fd5bdcc41e28f6ffbd99031cf3a', 'request_id': 'req-4a4c93fb-4a2a-4ad9-8d56-03b6a4056b54'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:37.331638 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-4a4c93fb-4a2a-4ad9-8d56-03b6a4056b54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af2d0fd5bdcc41e28f6ffbd99031cf3a', 'request_id': 'req-4a4c93fb-4a2a-4ad9-8d56-03b6a4056b54'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:37.348415 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-4a4c93fb-4a2a-4ad9-8d56-03b6a4056b54 admin admin] The token cache is being invalidate because project af2d0fd5bdcc41e28f6ffbd99031cf3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:35:37.348794 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-4a4c93fb-4a2a-4ad9-8d56-03b6a4056b54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:37.349685 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-4a4c93fb-4a2a-4ad9-8d56-03b6a4056b54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:37.353417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1361/2725] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:35:37 2022] DELETE /identity/v3/projects/af2d0fd5bdcc41e28f6ffbd99031cf3a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:35:37.358624 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5216d-e475-4e30-8a3a-6ae57ebf52e9 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:37.359934 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5216d-e475-4e30-8a3a-6ae57ebf52e9 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:37.360158 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5216d-e475-4e30-8a3a-6ae57ebf52e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:37.408366 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-31c5216d-e475-4e30-8a3a-6ae57ebf52e9 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:35:37.409823 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-31c5216d-e475-4e30-8a3a-6ae57ebf52e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:37.477503 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:37.506831 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1365/2726] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:35:37.521278 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989be5f-f252-468c-86a2-75297bdbd1bb None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:37.521827 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989be5f-f252-468c-86a2-75297bdbd1bb None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:37.522311 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989be5f-f252-468c-86a2-75297bdbd1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:37.549496 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-7989be5f-f252-468c-86a2-75297bdbd1bb None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:35:37.550755 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-7989be5f-f252-468c-86a2-75297bdbd1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:37.559603 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1362/2727] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:35:37.565850 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5216d-e475-4e30-8a3a-6ae57ebf52e9 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:37.582763 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5216d-e475-4e30-8a3a-6ae57ebf52e9 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:37.591453 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9e488-cab4-4c57-81d5-9eb27982a48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:37.592448 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9e488-cab4-4c57-81d5-9eb27982a48b admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:37.592842 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9e488-cab4-4c57-81d5-9eb27982a48b admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:37.593348 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9e488-cab4-4c57-81d5-9eb27982a48b admin admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:37.594294 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb9e488-cab4-4c57-81d5-9eb27982a48b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:35:37.594757 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb9e488-cab4-4c57-81d5-9eb27982a48b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:37.597831 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb9e488-cab4-4c57-81d5-9eb27982a48b admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:37.627205 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1366/2728] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:35:37.630169 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989be5f-f252-468c-86a2-75297bdbd1bb None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:37.652350 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989be5f-f252-468c-86a2-75297bdbd1bb None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:37.664177 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19690392-9f82-4ed2-b5af-07cf0444d866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:37.665771 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19690392-9f82-4ed2-b5af-07cf0444d866 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:37.666741 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19690392-9f82-4ed2-b5af-07cf0444d866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:37.667050 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19690392-9f82-4ed2-b5af-07cf0444d866 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:37.668166 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19690392-9f82-4ed2-b5af-07cf0444d866 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:37.672976 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19690392-9f82-4ed2-b5af-07cf0444d866 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:37.719643 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1363/2729] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:35:37 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:35:37.725247 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9e488-cab4-4c57-81d5-9eb27982a48b admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:37.743800 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9e488-cab4-4c57-81d5-9eb27982a48b admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:37.845824 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a42a25-6ccc-4cbe-a5b5-5ed0529c7848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:37.846555 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a42a25-6ccc-4cbe-a5b5-5ed0529c7848 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:37.846975 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a42a25-6ccc-4cbe-a5b5-5ed0529c7848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:37.847450 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a42a25-6ccc-4cbe-a5b5-5ed0529c7848 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:37.848192 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a42a25-6ccc-4cbe-a5b5-5ed0529c7848 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:37.851084 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a42a25-6ccc-4cbe-a5b5-5ed0529c7848 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:37.892531 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1367/2730] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:35:37 2022] POST /identity/v3/users => generated 287 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:35:37.899142 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19690392-9f82-4ed2-b5af-07cf0444d866 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:37.923290 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19690392-9f82-4ed2-b5af-07cf0444d866 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:37.931355 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c5d35-6151-4cd0-a2f9-3a265b17d086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:37.932418 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c5d35-6151-4cd0-a2f9-3a265b17d086 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:37.932956 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c5d35-6151-4cd0-a2f9-3a265b17d086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:37.933465 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c5d35-6151-4cd0-a2f9-3a265b17d086 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:37.934712 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c5d35-6151-4cd0-a2f9-3a265b17d086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:37.937942 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c5d35-6151-4cd0-a2f9-3a265b17d086 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:37.954707 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1364/2731] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:35:37.961552 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a42a25-6ccc-4cbe-a5b5-5ed0529c7848 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:37.983411 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a42a25-6ccc-4cbe-a5b5-5ed0529c7848 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:37.994099 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0d5dd-7a9c-4f95-baa0-9798b26c0530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:37.995521 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0d5dd-7a9c-4f95-baa0-9798b26c0530 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:37.996459 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0d5dd-7a9c-4f95-baa0-9798b26c0530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:37.997414 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0d5dd-7a9c-4f95-baa0-9798b26c0530 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:37.999118 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0d5dd-7a9c-4f95-baa0-9798b26c0530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:38.003403 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0d5dd-7a9c-4f95-baa0-9798b26c0530 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:38.032559 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1368/2732] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:35:38.039170 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c5d35-6151-4cd0-a2f9-3a265b17d086 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:38.061174 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c5d35-6151-4cd0-a2f9-3a265b17d086 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:38.074167 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb9bf3-d14c-4552-a47b-6ed113c98393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:38.075584 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb9bf3-d14c-4552-a47b-6ed113c98393 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:38.077266 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb9bf3-d14c-4552-a47b-6ed113c98393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:38.078112 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb9bf3-d14c-4552-a47b-6ed113c98393 admin admin] PATH_INFO: `/v3/projects/3733736038d44ed6924b825ab665f298/users/995f054403704de9a9a1dab3094e542a/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:38.104709 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb9bf3-d14c-4552-a47b-6ed113c98393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3733736038d44ed6924b825ab665f298, user_id=995f054403704de9a9a1dab3094e542a, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:38.107938 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb9bf3-d14c-4552-a47b-6ed113c98393 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:38.127502 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1365/2733] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:35:38 2022] PUT /identity/v3/projects/3733736038d44ed6924b825ab665f298/users/995f054403704de9a9a1dab3094e542a/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:35:38.133903 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa3a9c-7782-4aa2-b185-b47bf545e501 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:38.134254 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa3a9c-7782-4aa2-b185-b47bf545e501 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:38.134435 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa3a9c-7782-4aa2-b185-b47bf545e501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:38.167304 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-ccfa3a9c-7782-4aa2-b185-b47bf545e501 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:35:38.168862 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-ccfa3a9c-7782-4aa2-b185-b47bf545e501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:38.301407 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1369/2734] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:35:38.312000 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb9bf3-d14c-4552-a47b-6ed113c98393 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:38.314213 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-50fb9bf3-d14c-4552-a47b-6ed113c98393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:38.405281 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb9bf3-d14c-4552-a47b-6ed113c98393 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:38.415708 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7535f6-b49a-4152-afb6-6711297c0628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:38.416839 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7535f6-b49a-4152-afb6-6711297c0628 service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:38.417407 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7535f6-b49a-4152-afb6-6711297c0628 service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:38.417949 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7535f6-b49a-4152-afb6-6711297c0628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:38.445050 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7535f6-b49a-4152-afb6-6711297c0628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:38.447791 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7535f6-b49a-4152-afb6-6711297c0628 service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:38.465824 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1366/2735] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:35:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:35:39.407677 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e65d61-1adc-40bf-9086-5f8eb8afa834 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:39.408654 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e65d61-1adc-40bf-9086-5f8eb8afa834 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:39.408654 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e65d61-1adc-40bf-9086-5f8eb8afa834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:39.451134 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-76e65d61-1adc-40bf-9086-5f8eb8afa834 None None] MFA Rules not processed for user `995f054403704de9a9a1dab3094e542a`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:35:39.453120 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-76e65d61-1adc-40bf-9086-5f8eb8afa834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:39.518757 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:39.577674 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1370/2736] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:35:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:35:39.606247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7535f6-b49a-4152-afb6-6711297c0628 service neutron] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:39.610521 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-cf7535f6-b49a-4152-afb6-6711297c0628 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:39.711991 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:39.762347 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7535f6-b49a-4152-afb6-6711297c0628 service neutron] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:39.768683 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b504b-1c6b-407a-9b80-1e31d167b06d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:39.769332 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b504b-1c6b-407a-9b80-1e31d167b06d service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:39.769709 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b504b-1c6b-407a-9b80-1e31d167b06d service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:39.770024 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b504b-1c6b-407a-9b80-1e31d167b06d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:39.783524 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b504b-1c6b-407a-9b80-1e31d167b06d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:39.785064 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b504b-1c6b-407a-9b80-1e31d167b06d service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:39.797886 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1367/2737] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:35:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:35:41.362548 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3198e-b1d1-480e-864e-57bfaad7f328 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:41.363378 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3198e-b1d1-480e-864e-57bfaad7f328 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:41.363378 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3198e-b1d1-480e-864e-57bfaad7f328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:41.385495 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-b4e3198e-b1d1-480e-864e-57bfaad7f328 None None] MFA Rules not processed for user `995f054403704de9a9a1dab3094e542a`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:35:41.387593 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-b4e3198e-b1d1-480e-864e-57bfaad7f328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:41.404276 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1371/2738] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:35:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:35:41.528362 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b504b-1c6b-407a-9b80-1e31d167b06d service cinder] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:41.529981 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-8b9b504b-1c6b-407a-9b80-1e31d167b06d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:41.576200 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b504b-1c6b-407a-9b80-1e31d167b06d service cinder] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:41.580767 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c2893-8030-431c-ac98-1e0dea1c015a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:41.581407 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c2893-8030-431c-ac98-1e0dea1c015a service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:41.581695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c2893-8030-431c-ac98-1e0dea1c015a service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:41.581967 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c2893-8030-431c-ac98-1e0dea1c015a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:41.583973 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-561c2893-8030-431c-ac98-1e0dea1c015a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:41.598670 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c2893-8030-431c-ac98-1e0dea1c015a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:41.601539 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c2893-8030-431c-ac98-1e0dea1c015a service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:41.622173 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1368/2739] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:35:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:35:41.814857 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3198e-b1d1-480e-864e-57bfaad7f328 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:41.826248 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3198e-b1d1-480e-864e-57bfaad7f328 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:41.830611 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338165f9-ba02-4049-a73e-c842e92d8995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:41.831336 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338165f9-ba02-4049-a73e-c842e92d8995 service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:41.831622 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338165f9-ba02-4049-a73e-c842e92d8995 service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:41.832150 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338165f9-ba02-4049-a73e-c842e92d8995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:41.834059 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-338165f9-ba02-4049-a73e-c842e92d8995 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:41.844968 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338165f9-ba02-4049-a73e-c842e92d8995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:41.846470 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338165f9-ba02-4049-a73e-c842e92d8995 service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:41.856693 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1372/2740] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:35:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:35:51.541852 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c2893-8030-431c-ac98-1e0dea1c015a service neutron] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:51.544264 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-561c2893-8030-431c-ac98-1e0dea1c015a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:51.564194 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c2893-8030-431c-ac98-1e0dea1c015a service neutron] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:51.590855 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e74ff-77a8-40fe-bf21-6c76a1cfdf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:51.592651 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e74ff-77a8-40fe-bf21-6c76a1cfdf77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:51.593755 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e74ff-77a8-40fe-bf21-6c76a1cfdf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:51.594798 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e74ff-77a8-40fe-bf21-6c76a1cfdf77 admin admin] PATH_INFO: `/v3/users/37f4b18e5bd24c6c92ecfe33760c5fdb` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:51.596939 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e74ff-77a8-40fe-bf21-6c76a1cfdf77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37f4b18e5bd24c6c92ecfe33760c5fdb)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:51.603549 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e74ff-77a8-40fe-bf21-6c76a1cfdf77 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:51.682779 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-b89e74ff-77a8-40fe-bf21-6c76a1cfdf77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37f4b18e5bd24c6c92ecfe33760c5fdb'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:51.683749 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-b89e74ff-77a8-40fe-bf21-6c76a1cfdf77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37f4b18e5bd24c6c92ecfe33760c5fdb'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:51.700647 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-b89e74ff-77a8-40fe-bf21-6c76a1cfdf77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37f4b18e5bd24c6c92ecfe33760c5fdb'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:51.717565 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-b89e74ff-77a8-40fe-bf21-6c76a1cfdf77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37f4b18e5bd24c6c92ecfe33760c5fdb'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:51.719880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-b89e74ff-77a8-40fe-bf21-6c76a1cfdf77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37f4b18e5bd24c6c92ecfe33760c5fdb'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:51.764763 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1369/2741] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:35:51 2022] DELETE /identity/v3/users/37f4b18e5bd24c6c92ecfe33760c5fdb => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:35:51.851927 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=18 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:52.000994 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338165f9-ba02-4049-a73e-c842e92d8995 service neutron] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:52.023201 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338165f9-ba02-4049-a73e-c842e92d8995 service neutron] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:52.094773 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5b18a-b0a0-43cb-893b-0ce742bc14a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:52.095502 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5b18a-b0a0-43cb-893b-0ce742bc14a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:52.095781 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5b18a-b0a0-43cb-893b-0ce742bc14a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:52.096060 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5b18a-b0a0-43cb-893b-0ce742bc14a4 admin admin] PATH_INFO: `/v3/projects/3a827c4255f142be96a0e0f26f7316be` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:52.097733 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5b18a-b0a0-43cb-893b-0ce742bc14a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a827c4255f142be96a0e0f26f7316be)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:52.099836 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5b18a-b0a0-43cb-893b-0ce742bc14a4 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:52.161389 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2eb5b18a-b0a0-43cb-893b-0ce742bc14a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a827c4255f142be96a0e0f26f7316be', 'request_id': 'req-2eb5b18a-b0a0-43cb-893b-0ce742bc14a4'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:52.168810 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2eb5b18a-b0a0-43cb-893b-0ce742bc14a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a827c4255f142be96a0e0f26f7316be', 'request_id': 'req-2eb5b18a-b0a0-43cb-893b-0ce742bc14a4'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:52.185960 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2eb5b18a-b0a0-43cb-893b-0ce742bc14a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a827c4255f142be96a0e0f26f7316be', 'request_id': 'req-2eb5b18a-b0a0-43cb-893b-0ce742bc14a4'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:52.198842 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2eb5b18a-b0a0-43cb-893b-0ce742bc14a4 admin admin] The token cache is being invalidate because project 3a827c4255f142be96a0e0f26f7316be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:35:52.199128 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2eb5b18a-b0a0-43cb-893b-0ce742bc14a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:52.199868 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2eb5b18a-b0a0-43cb-893b-0ce742bc14a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:52.201499 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1373/2742] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:35:51 2022] DELETE /identity/v3/projects/3a827c4255f142be96a0e0f26f7316be => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:35:52.206568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e74ff-77a8-40fe-bf21-6c76a1cfdf77 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:52.208187 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-b89e74ff-77a8-40fe-bf21-6c76a1cfdf77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:52.224498 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e74ff-77a8-40fe-bf21-6c76a1cfdf77 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:52.295379 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63460a-7003-4b68-a53b-5f038048a57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:52.295973 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63460a-7003-4b68-a53b-5f038048a57a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:52.296417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63460a-7003-4b68-a53b-5f038048a57a admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:52.296997 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63460a-7003-4b68-a53b-5f038048a57a admin admin] PATH_INFO: `/v3/users/889201cdae5c466fac848670296f4789` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:52.298461 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63460a-7003-4b68-a53b-5f038048a57a admin admin] RBAC: Authorizing `identity:delete_user(user_id=889201cdae5c466fac848670296f4789)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:52.300531 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63460a-7003-4b68-a53b-5f038048a57a admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:52.338542 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:52.384725 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-ce63460a-7003-4b68-a53b-5f038048a57a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '889201cdae5c466fac848670296f4789'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:52.389792 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-ce63460a-7003-4b68-a53b-5f038048a57a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '889201cdae5c466fac848670296f4789'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:52.409829 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-ce63460a-7003-4b68-a53b-5f038048a57a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '889201cdae5c466fac848670296f4789'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:52.421954 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-ce63460a-7003-4b68-a53b-5f038048a57a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '889201cdae5c466fac848670296f4789'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:52.423317 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-ce63460a-7003-4b68-a53b-5f038048a57a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '889201cdae5c466fac848670296f4789'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:52.466097 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1370/2743] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:35:52 2022] DELETE /identity/v3/users/889201cdae5c466fac848670296f4789 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:35:52.808875 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5b18a-b0a0-43cb-893b-0ce742bc14a4 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:52.813136 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-2eb5b18a-b0a0-43cb-893b-0ce742bc14a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:52.868973 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5b18a-b0a0-43cb-893b-0ce742bc14a4 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:53.024083 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a8ded-39e5-4dad-905a-1dd9ac369a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:53.024856 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a8ded-39e5-4dad-905a-1dd9ac369a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:53.025140 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a8ded-39e5-4dad-905a-1dd9ac369a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:53.025443 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a8ded-39e5-4dad-905a-1dd9ac369a85 admin admin] PATH_INFO: `/v3/projects/212179c02fe943fca18cb5d24e58c0da` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:53.026776 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a8ded-39e5-4dad-905a-1dd9ac369a85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=212179c02fe943fca18cb5d24e58c0da)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:53.028694 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a8ded-39e5-4dad-905a-1dd9ac369a85 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:53.071343 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:53.089253 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-d53a8ded-39e5-4dad-905a-1dd9ac369a85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '212179c02fe943fca18cb5d24e58c0da', 'request_id': 'req-d53a8ded-39e5-4dad-905a-1dd9ac369a85'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:53.101214 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-d53a8ded-39e5-4dad-905a-1dd9ac369a85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '212179c02fe943fca18cb5d24e58c0da', 'request_id': 'req-d53a8ded-39e5-4dad-905a-1dd9ac369a85'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:53.126629 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-d53a8ded-39e5-4dad-905a-1dd9ac369a85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '212179c02fe943fca18cb5d24e58c0da', 'request_id': 'req-d53a8ded-39e5-4dad-905a-1dd9ac369a85'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:53.144324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-d53a8ded-39e5-4dad-905a-1dd9ac369a85 admin admin] The token cache is being invalidate because project 212179c02fe943fca18cb5d24e58c0da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:35:53.144750 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-d53a8ded-39e5-4dad-905a-1dd9ac369a85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:53.145736 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-d53a8ded-39e5-4dad-905a-1dd9ac369a85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:53.168804 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1374/2744] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:35:52 2022] DELETE /identity/v3/projects/212179c02fe943fca18cb5d24e58c0da => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:35:58.637914 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63460a-7003-4b68-a53b-5f038048a57a admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:58.639477 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-ce63460a-7003-4b68-a53b-5f038048a57a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:58.705190 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63460a-7003-4b68-a53b-5f038048a57a admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:58.763068 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6afef7-ba36-46bd-b752-6c13ad6b11c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:58.763811 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6afef7-ba36-46bd-b752-6c13ad6b11c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:58.764194 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6afef7-ba36-46bd-b752-6c13ad6b11c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:58.764481 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6afef7-ba36-46bd-b752-6c13ad6b11c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:58.767633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-2d6afef7-ba36-46bd-b752-6c13ad6b11c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:58.845277 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6afef7-ba36-46bd-b752-6c13ad6b11c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:58.847405 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6afef7-ba36-46bd-b752-6c13ad6b11c6 service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:58.865420 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1371/2745] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:35:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:35:58.975242 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1065a68-8eec-4365-a706-3d8f1ba1c450 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:58.976088 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1065a68-8eec-4365-a706-3d8f1ba1c450 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:58.976088 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1065a68-8eec-4365-a706-3d8f1ba1c450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:58.997650 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-b1065a68-8eec-4365-a706-3d8f1ba1c450 None None] MFA Rules not processed for user `995f054403704de9a9a1dab3094e542a`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:35:58.998961 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-b1065a68-8eec-4365-a706-3d8f1ba1c450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:59.067029 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1375/2746] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:35:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:36:03.288212 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6afef7-ba36-46bd-b752-6c13ad6b11c6 service neutron] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:03.292508 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-2d6afef7-ba36-46bd-b752-6c13ad6b11c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:03.328526 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6afef7-ba36-46bd-b752-6c13ad6b11c6 service neutron] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:03.338960 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3387872-6514-40eb-845b-3a77882c682c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:03.340069 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3387872-6514-40eb-845b-3a77882c682c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:03.340568 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3387872-6514-40eb-845b-3a77882c682c admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:03.341043 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3387872-6514-40eb-845b-3a77882c682c admin admin] PATH_INFO: `/v3/users/c4aa1c394e8445adbb4bf668ce056a38` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:03.343803 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3387872-6514-40eb-845b-3a77882c682c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4aa1c394e8445adbb4bf668ce056a38)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:03.349328 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3387872-6514-40eb-845b-3a77882c682c admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:03.354107 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:03.434809 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-a3387872-6514-40eb-845b-3a77882c682c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4aa1c394e8445adbb4bf668ce056a38'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:03.435440 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-a3387872-6514-40eb-845b-3a77882c682c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4aa1c394e8445adbb4bf668ce056a38'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:03.446041 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-a3387872-6514-40eb-845b-3a77882c682c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4aa1c394e8445adbb4bf668ce056a38'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:03.457904 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-a3387872-6514-40eb-845b-3a77882c682c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4aa1c394e8445adbb4bf668ce056a38'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:03.459216 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-a3387872-6514-40eb-845b-3a77882c682c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4aa1c394e8445adbb4bf668ce056a38'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:03.496118 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1372/2747] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:36:03 2022] DELETE /identity/v3/users/c4aa1c394e8445adbb4bf668ce056a38 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:36:03.845702 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1065a68-8eec-4365-a706-3d8f1ba1c450 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:03.859483 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1065a68-8eec-4365-a706-3d8f1ba1c450 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:03.955540 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e92078-86ed-4519-8d58-68f70b24ad65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:03.956203 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e92078-86ed-4519-8d58-68f70b24ad65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:03.956516 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e92078-86ed-4519-8d58-68f70b24ad65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:03.956789 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e92078-86ed-4519-8d58-68f70b24ad65 admin admin] PATH_INFO: `/v3/projects/88bb58d6fcb641ae9b20b7041bde0579` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:03.958969 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e92078-86ed-4519-8d58-68f70b24ad65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88bb58d6fcb641ae9b20b7041bde0579)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:03.962741 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e92078-86ed-4519-8d58-68f70b24ad65 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:04.033646 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-15e92078-86ed-4519-8d58-68f70b24ad65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88bb58d6fcb641ae9b20b7041bde0579', 'request_id': 'req-15e92078-86ed-4519-8d58-68f70b24ad65'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:04.042007 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-15e92078-86ed-4519-8d58-68f70b24ad65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88bb58d6fcb641ae9b20b7041bde0579', 'request_id': 'req-15e92078-86ed-4519-8d58-68f70b24ad65'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:04.051162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-15e92078-86ed-4519-8d58-68f70b24ad65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88bb58d6fcb641ae9b20b7041bde0579', 'request_id': 'req-15e92078-86ed-4519-8d58-68f70b24ad65'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:04.054242 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:04.069940 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-15e92078-86ed-4519-8d58-68f70b24ad65 admin admin] The token cache is being invalidate because project 88bb58d6fcb641ae9b20b7041bde0579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:36:04.070171 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-15e92078-86ed-4519-8d58-68f70b24ad65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:04.070996 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-15e92078-86ed-4519-8d58-68f70b24ad65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:04.072868 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1376/2748] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:36:03 2022] DELETE /identity/v3/projects/88bb58d6fcb641ae9b20b7041bde0579 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:36:04.078377 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e1125-e303-4ebf-bf88-8c969ca5f10f None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:04.078845 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e1125-e303-4ebf-bf88-8c969ca5f10f None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:04.079220 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e1125-e303-4ebf-bf88-8c969ca5f10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:04.106051 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-b28e1125-e303-4ebf-bf88-8c969ca5f10f None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:36:04.107768 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-b28e1125-e303-4ebf-bf88-8c969ca5f10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:04.195343 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1373/2749] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:36:04.204913 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a5aea-a35c-48cd-8ae1-2e83c191f5b0 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:04.205220 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a5aea-a35c-48cd-8ae1-2e83c191f5b0 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:04.205489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a5aea-a35c-48cd-8ae1-2e83c191f5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:04.229512 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-a72a5aea-a35c-48cd-8ae1-2e83c191f5b0 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:36:04.230674 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-a72a5aea-a35c-48cd-8ae1-2e83c191f5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:04.239306 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1377/2750] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:36:04.243813 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e1125-e303-4ebf-bf88-8c969ca5f10f None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:04.258258 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e1125-e303-4ebf-bf88-8c969ca5f10f None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:04.267698 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa2f0f-8604-46f5-b7ec-2d9884e4e21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:04.268784 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa2f0f-8604-46f5-b7ec-2d9884e4e21b admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:04.269169 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa2f0f-8604-46f5-b7ec-2d9884e4e21b admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:04.269477 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa2f0f-8604-46f5-b7ec-2d9884e4e21b admin admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:04.270169 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa2f0f-8604-46f5-b7ec-2d9884e4e21b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:36:04.270470 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa2f0f-8604-46f5-b7ec-2d9884e4e21b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:04.272120 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa2f0f-8604-46f5-b7ec-2d9884e4e21b admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:04.288869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1374/2751] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:36:04.290022 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a5aea-a35c-48cd-8ae1-2e83c191f5b0 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:04.300178 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a5aea-a35c-48cd-8ae1-2e83c191f5b0 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:04.305145 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29894094-53fe-4c4b-bdfc-6556b0237070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:04.305799 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29894094-53fe-4c4b-bdfc-6556b0237070 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:04.306078 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29894094-53fe-4c4b-bdfc-6556b0237070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:04.306351 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29894094-53fe-4c4b-bdfc-6556b0237070 admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:04.306981 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29894094-53fe-4c4b-bdfc-6556b0237070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:04.308974 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29894094-53fe-4c4b-bdfc-6556b0237070 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:04.340171 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1378/2752] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:36:04 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:36:04.345525 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa2f0f-8604-46f5-b7ec-2d9884e4e21b admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:04.357871 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa2f0f-8604-46f5-b7ec-2d9884e4e21b admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:04.429760 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f1f5c-a53e-41a4-8205-7b899bc47bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:04.430405 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f1f5c-a53e-41a4-8205-7b899bc47bac admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:04.430686 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f1f5c-a53e-41a4-8205-7b899bc47bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:04.430960 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f1f5c-a53e-41a4-8205-7b899bc47bac admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:04.431615 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f1f5c-a53e-41a4-8205-7b899bc47bac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:04.433595 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f1f5c-a53e-41a4-8205-7b899bc47bac admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:04.459073 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:04.477435 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1375/2753] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:36:04 2022] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:36:04.483029 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29894094-53fe-4c4b-bdfc-6556b0237070 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:04.495253 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29894094-53fe-4c4b-bdfc-6556b0237070 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:04.501386 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677d441-6426-4ef8-902a-0dc563a7032a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:04.502042 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677d441-6426-4ef8-902a-0dc563a7032a admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:04.502317 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677d441-6426-4ef8-902a-0dc563a7032a admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:04.502587 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677d441-6426-4ef8-902a-0dc563a7032a admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:04.503244 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4677d441-6426-4ef8-902a-0dc563a7032a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:04.504848 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4677d441-6426-4ef8-902a-0dc563a7032a admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:04.517538 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1379/2754] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:36:04.522834 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f1f5c-a53e-41a4-8205-7b899bc47bac admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:04.533898 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f1f5c-a53e-41a4-8205-7b899bc47bac admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:04.540370 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8d5a8-15b2-4c04-aa7c-cd018053a642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:04.541007 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8d5a8-15b2-4c04-aa7c-cd018053a642 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:04.541293 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8d5a8-15b2-4c04-aa7c-cd018053a642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:04.541620 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8d5a8-15b2-4c04-aa7c-cd018053a642 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:04.542335 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a8d5a8-15b2-4c04-aa7c-cd018053a642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:04.543936 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a8d5a8-15b2-4c04-aa7c-cd018053a642 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:04.557538 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1376/2755] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:36:04.562069 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677d441-6426-4ef8-902a-0dc563a7032a admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:04.573242 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677d441-6426-4ef8-902a-0dc563a7032a admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:04.578714 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7890c3-f30f-451a-bbc6-ee652be5f355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:04.579389 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7890c3-f30f-451a-bbc6-ee652be5f355 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:04.579674 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7890c3-f30f-451a-bbc6-ee652be5f355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:04.579951 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7890c3-f30f-451a-bbc6-ee652be5f355 admin admin] PATH_INFO: `/v3/projects/e831120f3ce04934a69b466018cfe4b3/users/7c058ba32770456196ebd23c50482807/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:04.602763 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7890c3-f30f-451a-bbc6-ee652be5f355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e831120f3ce04934a69b466018cfe4b3, user_id=7c058ba32770456196ebd23c50482807, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:04.609067 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7890c3-f30f-451a-bbc6-ee652be5f355 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:04.627688 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1380/2756] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:36:04 2022] PUT /identity/v3/projects/e831120f3ce04934a69b466018cfe4b3/users/7c058ba32770456196ebd23c50482807/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:36:04.638501 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811e344-76c6-4ded-a872-ea61bb6014df None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:04.638794 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811e344-76c6-4ded-a872-ea61bb6014df None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:04.639074 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811e344-76c6-4ded-a872-ea61bb6014df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:04.670562 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-1811e344-76c6-4ded-a872-ea61bb6014df None None] MFA Rules not processed for user `7c058ba32770456196ebd23c50482807`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:36:04.671893 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-1811e344-76c6-4ded-a872-ea61bb6014df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:04.743007 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1377/2757] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:36:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:36:04.755342 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7890c3-f30f-451a-bbc6-ee652be5f355 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:04.757162 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-0b7890c3-f30f-451a-bbc6-ee652be5f355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:04.866811 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7890c3-f30f-451a-bbc6-ee652be5f355 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:04.876826 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052c336-0a0c-480a-afdc-d252174db83e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:04.877776 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052c336-0a0c-480a-afdc-d252174db83e service nova] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:04.878293 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052c336-0a0c-480a-afdc-d252174db83e service nova] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:04.878936 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052c336-0a0c-480a-afdc-d252174db83e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:04.888567 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052c336-0a0c-480a-afdc-d252174db83e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:04.891227 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052c336-0a0c-480a-afdc-d252174db83e service nova] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:04.901802 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1381/2758] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:36:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:36:10.454888 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811e344-76c6-4ded-a872-ea61bb6014df None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:10.583670 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811e344-76c6-4ded-a872-ea61bb6014df None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:10.591466 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8ab81-b48d-45bc-8ff1-43fadaf42d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:10.592284 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8ab81-b48d-45bc-8ff1-43fadaf42d55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:10.592561 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8ab81-b48d-45bc-8ff1-43fadaf42d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:10.592874 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8ab81-b48d-45bc-8ff1-43fadaf42d55 admin admin] PATH_INFO: `/v3/users/7c058ba32770456196ebd23c50482807` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:10.594961 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b8ab81-b48d-45bc-8ff1-43fadaf42d55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c058ba32770456196ebd23c50482807)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:10.596947 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b8ab81-b48d-45bc-8ff1-43fadaf42d55 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:10.663665 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-c9b8ab81-b48d-45bc-8ff1-43fadaf42d55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c058ba32770456196ebd23c50482807'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:10.664531 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-c9b8ab81-b48d-45bc-8ff1-43fadaf42d55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c058ba32770456196ebd23c50482807'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:10.676979 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-c9b8ab81-b48d-45bc-8ff1-43fadaf42d55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c058ba32770456196ebd23c50482807'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:10.687928 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-c9b8ab81-b48d-45bc-8ff1-43fadaf42d55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c058ba32770456196ebd23c50482807'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:10.688675 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-c9b8ab81-b48d-45bc-8ff1-43fadaf42d55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c058ba32770456196ebd23c50482807'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:10.700660 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:10.710374 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1378/2759] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:36:10 2022] DELETE /identity/v3/users/7c058ba32770456196ebd23c50482807 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:36:10.716046 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d2edd-b398-463b-a761-65c98cb6397a None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:10.716645 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d2edd-b398-463b-a761-65c98cb6397a None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:10.716880 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d2edd-b398-463b-a761-65c98cb6397a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:10.740428 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-da8d2edd-b398-463b-a761-65c98cb6397a None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:36:10.741712 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-da8d2edd-b398-463b-a761-65c98cb6397a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:10.798849 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:10.826662 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1382/2760] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:36:10.840219 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8ab81-b48d-45bc-8ff1-43fadaf42d55 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:10.841648 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-c9b8ab81-b48d-45bc-8ff1-43fadaf42d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:10.911859 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8ab81-b48d-45bc-8ff1-43fadaf42d55 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:10.915771 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0b593-1e13-493a-a252-45818fec11f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:10.916396 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0b593-1e13-493a-a252-45818fec11f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:10.917035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0b593-1e13-493a-a252-45818fec11f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:10.917035 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0b593-1e13-493a-a252-45818fec11f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:10.929453 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0b593-1e13-493a-a252-45818fec11f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:10.930924 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0b593-1e13-493a-a252-45818fec11f7 service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:10.942366 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1379/2761] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:36:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:36:11.298972 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d2edd-b398-463b-a761-65c98cb6397a None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:11.301073 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-da8d2edd-b398-463b-a761-65c98cb6397a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:11.315440 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d2edd-b398-463b-a761-65c98cb6397a None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:11.321010 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32843a2d-aae1-4a06-ab71-48c3b3971dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:11.321966 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32843a2d-aae1-4a06-ab71-48c3b3971dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:11.322338 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32843a2d-aae1-4a06-ab71-48c3b3971dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:11.322487 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32843a2d-aae1-4a06-ab71-48c3b3971dfd admin admin] PATH_INFO: `/v3/projects/e831120f3ce04934a69b466018cfe4b3` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:11.323694 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32843a2d-aae1-4a06-ab71-48c3b3971dfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e831120f3ce04934a69b466018cfe4b3)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:11.325899 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32843a2d-aae1-4a06-ab71-48c3b3971dfd admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:11.383210 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-32843a2d-aae1-4a06-ab71-48c3b3971dfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e831120f3ce04934a69b466018cfe4b3', 'request_id': 'req-32843a2d-aae1-4a06-ab71-48c3b3971dfd'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:11.390523 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-32843a2d-aae1-4a06-ab71-48c3b3971dfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e831120f3ce04934a69b466018cfe4b3', 'request_id': 'req-32843a2d-aae1-4a06-ab71-48c3b3971dfd'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:11.400982 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-32843a2d-aae1-4a06-ab71-48c3b3971dfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e831120f3ce04934a69b466018cfe4b3', 'request_id': 'req-32843a2d-aae1-4a06-ab71-48c3b3971dfd'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:11.415927 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-32843a2d-aae1-4a06-ab71-48c3b3971dfd admin admin] The token cache is being invalidate because project e831120f3ce04934a69b466018cfe4b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:36:11.416333 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-32843a2d-aae1-4a06-ab71-48c3b3971dfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:11.417132 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-32843a2d-aae1-4a06-ab71-48c3b3971dfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:11.419077 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1383/2762] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:36:11 2022] DELETE /identity/v3/projects/e831120f3ce04934a69b466018cfe4b3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:36:11.425802 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed4976-ca0c-4ac8-a98e-19959bcc40bb None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:11.426038 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed4976-ca0c-4ac8-a98e-19959bcc40bb None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:11.426317 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed4976-ca0c-4ac8-a98e-19959bcc40bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:11.450893 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-d8ed4976-ca0c-4ac8-a98e-19959bcc40bb None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:36:11.452704 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-d8ed4976-ca0c-4ac8-a98e-19959bcc40bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:11.521605 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1380/2763] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:36:11.531980 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe77a17-e8a3-4988-b649-917235c34e0a None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:11.532362 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe77a17-e8a3-4988-b649-917235c34e0a None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:11.532721 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe77a17-e8a3-4988-b649-917235c34e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:11.555122 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-efe77a17-e8a3-4988-b649-917235c34e0a None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:36:11.556447 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-efe77a17-e8a3-4988-b649-917235c34e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:11.564897 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1384/2764] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:36:11.569546 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed4976-ca0c-4ac8-a98e-19959bcc40bb None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:11.580972 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed4976-ca0c-4ac8-a98e-19959bcc40bb None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:11.587006 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0378688-a1b0-425e-8d76-57447f75b0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:11.587641 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0378688-a1b0-425e-8d76-57447f75b0df admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:11.587981 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0378688-a1b0-425e-8d76-57447f75b0df admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:11.588203 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0378688-a1b0-425e-8d76-57447f75b0df admin admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:11.588869 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0378688-a1b0-425e-8d76-57447f75b0df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:36:11.589172 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0378688-a1b0-425e-8d76-57447f75b0df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:11.590875 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0378688-a1b0-425e-8d76-57447f75b0df admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:11.606003 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1381/2765] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:36:11.610583 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe77a17-e8a3-4988-b649-917235c34e0a None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:11.622248 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe77a17-e8a3-4988-b649-917235c34e0a None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:11.628439 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7333d10-0e4d-4715-9733-9521222b15da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:11.629272 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7333d10-0e4d-4715-9733-9521222b15da admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:11.629651 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7333d10-0e4d-4715-9733-9521222b15da admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:11.629989 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7333d10-0e4d-4715-9733-9521222b15da admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:11.630702 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7333d10-0e4d-4715-9733-9521222b15da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:11.633190 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7333d10-0e4d-4715-9733-9521222b15da admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:11.670120 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1385/2766] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:36:11 2022] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:36:11.675516 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0378688-a1b0-425e-8d76-57447f75b0df admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:11.688418 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0378688-a1b0-425e-8d76-57447f75b0df admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:11.810944 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c58e2-9f84-4a07-ab69-a057a2380a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:11.813711 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c58e2-9f84-4a07-ab69-a057a2380a13 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:11.814242 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c58e2-9f84-4a07-ab69-a057a2380a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:11.814736 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c58e2-9f84-4a07-ab69-a057a2380a13 admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:11.816057 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c58e2-9f84-4a07-ab69-a057a2380a13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:11.819920 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c58e2-9f84-4a07-ab69-a057a2380a13 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:11.860131 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1382/2767] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:36:11 2022] POST /identity/v3/users => generated 285 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:36:11.864244 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7333d10-0e4d-4715-9733-9521222b15da admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:11.882009 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7333d10-0e4d-4715-9733-9521222b15da admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:11.892320 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8bde6-821b-4b1f-8adf-c08a08dd9923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:11.893387 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8bde6-821b-4b1f-8adf-c08a08dd9923 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:11.893901 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8bde6-821b-4b1f-8adf-c08a08dd9923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:11.894388 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8bde6-821b-4b1f-8adf-c08a08dd9923 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:11.895601 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8bde6-821b-4b1f-8adf-c08a08dd9923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:11.906555 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8bde6-821b-4b1f-8adf-c08a08dd9923 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:11.931740 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1386/2768] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:36:11.934038 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c58e2-9f84-4a07-ab69-a057a2380a13 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:11.949417 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c58e2-9f84-4a07-ab69-a057a2380a13 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:11.954319 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873f556-b84a-4919-86b9-50921aab6ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:11.954937 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873f556-b84a-4919-86b9-50921aab6ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:11.955218 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873f556-b84a-4919-86b9-50921aab6ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:11.955485 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873f556-b84a-4919-86b9-50921aab6ca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:11.956134 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873f556-b84a-4919-86b9-50921aab6ca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:11.957782 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873f556-b84a-4919-86b9-50921aab6ca0 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:11.969887 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1383/2769] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:36:11.974660 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8bde6-821b-4b1f-8adf-c08a08dd9923 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:11.986283 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8bde6-821b-4b1f-8adf-c08a08dd9923 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:11.991189 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00021373-f8a9-437a-83c6-f8f39a3ff483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:11.991876 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00021373-f8a9-437a-83c6-f8f39a3ff483 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:11.992158 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00021373-f8a9-437a-83c6-f8f39a3ff483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:11.992431 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00021373-f8a9-437a-83c6-f8f39a3ff483 admin admin] PATH_INFO: `/v3/projects/ce6638912d9c4c0f88839f87e1c06c37/users/6cc22808f74e4bc7995a46e1466c8304/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:12.013718 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00021373-f8a9-437a-83c6-f8f39a3ff483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce6638912d9c4c0f88839f87e1c06c37, user_id=6cc22808f74e4bc7995a46e1466c8304, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:12.017437 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00021373-f8a9-437a-83c6-f8f39a3ff483 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:12.039423 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1387/2770] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:36:11 2022] PUT /identity/v3/projects/ce6638912d9c4c0f88839f87e1c06c37/users/6cc22808f74e4bc7995a46e1466c8304/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:36:12.051574 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945b51c-2673-4971-9643-f70310d6db29 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:12.051971 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945b51c-2673-4971-9643-f70310d6db29 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:12.052254 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945b51c-2673-4971-9643-f70310d6db29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:12.063285 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:12.092360 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-1945b51c-2673-4971-9643-f70310d6db29 None None] MFA Rules not processed for user `6cc22808f74e4bc7995a46e1466c8304`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:36:12.093951 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-1945b51c-2673-4971-9643-f70310d6db29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:12.180368 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1384/2771] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:36:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:36:12.185133 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00021373-f8a9-437a-83c6-f8f39a3ff483 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:12.286783 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00021373-f8a9-437a-83c6-f8f39a3ff483 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:12.291901 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0abc89-632d-469c-a9ed-68b3fdef4916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:12.292527 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0abc89-632d-469c-a9ed-68b3fdef4916 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:12.292812 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0abc89-632d-469c-a9ed-68b3fdef4916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:12.293091 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0abc89-632d-469c-a9ed-68b3fdef4916 admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:12.293790 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0abc89-632d-469c-a9ed-68b3fdef4916 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:12.296538 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0abc89-632d-469c-a9ed-68b3fdef4916 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:12.314987 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:12.332380 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1388/2772] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:36:12 2022] POST /identity/v3/projects => generated 369 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:36:12.337556 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945b51c-2673-4971-9643-f70310d6db29 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:12.350275 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945b51c-2673-4971-9643-f70310d6db29 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:12.447018 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a66042-6825-4aaa-a8f6-e69bd9dc123d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:12.447845 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a66042-6825-4aaa-a8f6-e69bd9dc123d admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:12.448125 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a66042-6825-4aaa-a8f6-e69bd9dc123d admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:12.448400 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a66042-6825-4aaa-a8f6-e69bd9dc123d admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:12.449132 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a66042-6825-4aaa-a8f6-e69bd9dc123d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:12.451261 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a66042-6825-4aaa-a8f6-e69bd9dc123d admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:12.477619 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1385/2773] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:36:12 2022] POST /identity/v3/users => generated 291 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:36:12.482531 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0abc89-632d-469c-a9ed-68b3fdef4916 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:12.495539 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0abc89-632d-469c-a9ed-68b3fdef4916 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:12.502026 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdb093-5791-4078-87f1-a8c38576580a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:12.502805 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdb093-5791-4078-87f1-a8c38576580a admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:12.503182 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdb093-5791-4078-87f1-a8c38576580a admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:12.503550 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdb093-5791-4078-87f1-a8c38576580a admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:12.504388 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cdb093-5791-4078-87f1-a8c38576580a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:12.506194 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cdb093-5791-4078-87f1-a8c38576580a admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:12.519414 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1389/2774] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:36:12.524092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a66042-6825-4aaa-a8f6-e69bd9dc123d admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:12.536387 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a66042-6825-4aaa-a8f6-e69bd9dc123d admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:12.541826 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7127d09-4fb2-4ff8-9d62-0cfa3121d673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:12.542450 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7127d09-4fb2-4ff8-9d62-0cfa3121d673 admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:12.542735 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7127d09-4fb2-4ff8-9d62-0cfa3121d673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:12.543012 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7127d09-4fb2-4ff8-9d62-0cfa3121d673 admin admin] PATH_INFO: `/v3/projects/1b37702990b1476da6dbbcbf966f5192/users/e8c3e26e923f463bbef57a252b7d8d80/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:12.564259 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7127d09-4fb2-4ff8-9d62-0cfa3121d673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b37702990b1476da6dbbcbf966f5192, user_id=e8c3e26e923f463bbef57a252b7d8d80, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:12.569798 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7127d09-4fb2-4ff8-9d62-0cfa3121d673 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:12.587794 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1386/2775] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:36:12 2022] PUT /identity/v3/projects/1b37702990b1476da6dbbcbf966f5192/users/e8c3e26e923f463bbef57a252b7d8d80/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:36:12.592137 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdb093-5791-4078-87f1-a8c38576580a admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:12.604511 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdb093-5791-4078-87f1-a8c38576580a admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:12.670146 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da55c3-6cc5-4791-b166-6c03ec4734b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:12.670761 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da55c3-6cc5-4791-b166-6c03ec4734b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:12.671088 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da55c3-6cc5-4791-b166-6c03ec4734b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:12.671301 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da55c3-6cc5-4791-b166-6c03ec4734b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:12.672068 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da55c3-6cc5-4791-b166-6c03ec4734b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:12.673723 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da55c3-6cc5-4791-b166-6c03ec4734b7 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:12.684139 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1390/2776] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:36:12.689052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7127d09-4fb2-4ff8-9d62-0cfa3121d673 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:12.699846 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7127d09-4fb2-4ff8-9d62-0cfa3121d673 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:12.705701 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db9129-8d9f-47d3-890a-926808561a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:12.706379 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db9129-8d9f-47d3-890a-926808561a6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:12.706688 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db9129-8d9f-47d3-890a-926808561a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:12.706963 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db9129-8d9f-47d3-890a-926808561a6c admin admin] PATH_INFO: `/v3/projects/1b37702990b1476da6dbbcbf966f5192/users/e8c3e26e923f463bbef57a252b7d8d80/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:12.709000 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db9129-8d9f-47d3-890a-926808561a6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b37702990b1476da6dbbcbf966f5192, user_id=e8c3e26e923f463bbef57a252b7d8d80, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:12.711684 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db9129-8d9f-47d3-890a-926808561a6c admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:12.724743 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1387/2777] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:36:12 2022] PUT /identity/v3/projects/1b37702990b1476da6dbbcbf966f5192/users/e8c3e26e923f463bbef57a252b7d8d80/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:36:12.736794 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdae4a6-6a2a-4599-9e63-0be93ae3b2e1 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:12.737080 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdae4a6-6a2a-4599-9e63-0be93ae3b2e1 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:12.737356 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdae4a6-6a2a-4599-9e63-0be93ae3b2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:12.772284 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-5fdae4a6-6a2a-4599-9e63-0be93ae3b2e1 None None] MFA Rules not processed for user `e8c3e26e923f463bbef57a252b7d8d80`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:36:12.774997 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-5fdae4a6-6a2a-4599-9e63-0be93ae3b2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:12.857284 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1391/2778] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:36:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:36:12.869953 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db9129-8d9f-47d3-890a-926808561a6c admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:12.871733 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-a3db9129-8d9f-47d3-890a-926808561a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:12.935726 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:12.987298 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db9129-8d9f-47d3-890a-926808561a6c admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:12.991745 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af38ad1-8f02-43f9-962d-ed7680268297 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:12.992423 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af38ad1-8f02-43f9-962d-ed7680268297 service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:12.992712 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af38ad1-8f02-43f9-962d-ed7680268297 service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:12.993003 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af38ad1-8f02-43f9-962d-ed7680268297 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:13.007583 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af38ad1-8f02-43f9-962d-ed7680268297 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:13.009107 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af38ad1-8f02-43f9-962d-ed7680268297 service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:13.022976 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1388/2779] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:36:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:36:13.085333 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdae4a6-6a2a-4599-9e63-0be93ae3b2e1 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:13.087192 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-5fdae4a6-6a2a-4599-9e63-0be93ae3b2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:13.100560 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdae4a6-6a2a-4599-9e63-0be93ae3b2e1 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:13.112444 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff43ab2-a705-4df9-b5f4-2a727f0d6193 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:13.113211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff43ab2-a705-4df9-b5f4-2a727f0d6193 service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:13.113563 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff43ab2-a705-4df9-b5f4-2a727f0d6193 service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:13.113951 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff43ab2-a705-4df9-b5f4-2a727f0d6193 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:13.220787 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff43ab2-a705-4df9-b5f4-2a727f0d6193 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:13.222264 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff43ab2-a705-4df9-b5f4-2a727f0d6193 service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:13.232189 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1392/2780] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:36:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:36:16.802088 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af38ad1-8f02-43f9-962d-ed7680268297 service cinder] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:16.896814 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af38ad1-8f02-43f9-962d-ed7680268297 service cinder] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:16.901763 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ec06c-83dd-41ab-9889-f461b10ee94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:16.902421 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ec06c-83dd-41ab-9889-f461b10ee94c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:16.902699 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ec06c-83dd-41ab-9889-f461b10ee94c admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:16.902972 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ec06c-83dd-41ab-9889-f461b10ee94c admin admin] PATH_INFO: `/v3/users/6cc22808f74e4bc7995a46e1466c8304` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:16.904783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ec06c-83dd-41ab-9889-f461b10ee94c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cc22808f74e4bc7995a46e1466c8304)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:16.906798 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ec06c-83dd-41ab-9889-f461b10ee94c admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:16.980165 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-c24ec06c-83dd-41ab-9889-f461b10ee94c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cc22808f74e4bc7995a46e1466c8304'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:16.981658 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-c24ec06c-83dd-41ab-9889-f461b10ee94c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cc22808f74e4bc7995a46e1466c8304'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:16.998036 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-c24ec06c-83dd-41ab-9889-f461b10ee94c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cc22808f74e4bc7995a46e1466c8304'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:17.017665 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-c24ec06c-83dd-41ab-9889-f461b10ee94c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cc22808f74e4bc7995a46e1466c8304'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:17.018512 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-c24ec06c-83dd-41ab-9889-f461b10ee94c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cc22808f74e4bc7995a46e1466c8304'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:17.051778 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1389/2781] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:36:16 2022] DELETE /identity/v3/users/6cc22808f74e4bc7995a46e1466c8304 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:36:17.057426 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ae902-0d1c-4db8-b005-dbd305811861 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:17.058630 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ae902-0d1c-4db8-b005-dbd305811861 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:17.058970 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ae902-0d1c-4db8-b005-dbd305811861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:17.060722 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64de9e-3622-46d7-bbe8-36aade3fc0d9 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:17.061125 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64de9e-3622-46d7-bbe8-36aade3fc0d9 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:17.061743 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64de9e-3622-46d7-bbe8-36aade3fc0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:17.069309 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=100 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:17.083721 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-c98ae902-0d1c-4db8-b005-dbd305811861 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:36:17.084972 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-c98ae902-0d1c-4db8-b005-dbd305811861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:17.098781 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-3b64de9e-3622-46d7-bbe8-36aade3fc0d9 None None] MFA Rules not processed for user `02e415eb75984daa97ee79fc0146f318`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:36:17.100503 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-3b64de9e-3622-46d7-bbe8-36aade3fc0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:17.162645 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:17.164515 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1393/2782] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:36:17.178074 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ae902-0d1c-4db8-b005-dbd305811861 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:17.179678 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-c98ae902-0d1c-4db8-b005-dbd305811861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:17.201021 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1390/2783] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Aug 23 22:36:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:36:17.259781 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ae902-0d1c-4db8-b005-dbd305811861 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:17.263521 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd4d07-0fcd-4a8d-9503-81e85c9610e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:17.264146 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd4d07-0fcd-4a8d-9503-81e85c9610e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:17.264430 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd4d07-0fcd-4a8d-9503-81e85c9610e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:17.265165 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64de9e-3622-46d7-bbe8-36aade3fc0d9 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:17.265346 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd4d07-0fcd-4a8d-9503-81e85c9610e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:17.267059 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-3b64de9e-3622-46d7-bbe8-36aade3fc0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:17.275362 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd4d07-0fcd-4a8d-9503-81e85c9610e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:17.276839 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd4d07-0fcd-4a8d-9503-81e85c9610e8 service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:17.288620 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1394/2784] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:36:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:36:17.359322 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64de9e-3622-46d7-bbe8-36aade3fc0d9 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:17.366931 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad1561-d930-4149-8a61-d425f7274b53 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abda1f23a18c4c808483cd6b53952975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:17.367747 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad1561-d930-4149-8a61-d425f7274b53 service swift] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:17.368032 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad1561-d930-4149-8a61-d425f7274b53 service swift] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:17.368366 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad1561-d930-4149-8a61-d425f7274b53 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:17.378422 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad1561-d930-4149-8a61-d425f7274b53 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:17.380136 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad1561-d930-4149-8a61-d425f7274b53 service swift] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:17.393209 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1391/2785] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Aug 23 22:36:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 22:36:17.637002 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd4d07-0fcd-4a8d-9503-81e85c9610e8 service neutron] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:17.638762 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-8afd4d07-0fcd-4a8d-9503-81e85c9610e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:17.660057 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd4d07-0fcd-4a8d-9503-81e85c9610e8 service neutron] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:17.670432 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45839d6d-5565-44c7-a4b8-b9edf2fdb80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:17.671973 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45839d6d-5565-44c7-a4b8-b9edf2fdb80a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:17.672151 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45839d6d-5565-44c7-a4b8-b9edf2fdb80a admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:17.672590 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45839d6d-5565-44c7-a4b8-b9edf2fdb80a admin admin] PATH_INFO: `/v3/projects/ce6638912d9c4c0f88839f87e1c06c37` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:17.674531 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45839d6d-5565-44c7-a4b8-b9edf2fdb80a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce6638912d9c4c0f88839f87e1c06c37)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:17.678158 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45839d6d-5565-44c7-a4b8-b9edf2fdb80a admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:17.742041 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-45839d6d-5565-44c7-a4b8-b9edf2fdb80a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce6638912d9c4c0f88839f87e1c06c37', 'request_id': 'req-45839d6d-5565-44c7-a4b8-b9edf2fdb80a'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:17.750058 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-45839d6d-5565-44c7-a4b8-b9edf2fdb80a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce6638912d9c4c0f88839f87e1c06c37', 'request_id': 'req-45839d6d-5565-44c7-a4b8-b9edf2fdb80a'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:17.761458 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-45839d6d-5565-44c7-a4b8-b9edf2fdb80a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce6638912d9c4c0f88839f87e1c06c37', 'request_id': 'req-45839d6d-5565-44c7-a4b8-b9edf2fdb80a'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:17.777786 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-45839d6d-5565-44c7-a4b8-b9edf2fdb80a admin admin] The token cache is being invalidate because project ce6638912d9c4c0f88839f87e1c06c37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:36:17.777786 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-45839d6d-5565-44c7-a4b8-b9edf2fdb80a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:17.777786 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-45839d6d-5565-44c7-a4b8-b9edf2fdb80a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:17.783369 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1395/2786] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:36:17 2022] DELETE /identity/v3/projects/ce6638912d9c4c0f88839f87e1c06c37 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:36:17.784421 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad1561-d930-4149-8a61-d425f7274b53 service swift] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:17.796940 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad1561-d930-4149-8a61-d425f7274b53 service swift] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:17.879509 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7d4ef-4bc9-4136-a860-82db41c00207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:17.880412 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7d4ef-4bc9-4136-a860-82db41c00207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:17.880825 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7d4ef-4bc9-4136-a860-82db41c00207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:17.881134 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7d4ef-4bc9-4136-a860-82db41c00207 admin admin] PATH_INFO: `/v3/users/e8c3e26e923f463bbef57a252b7d8d80` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:17.882649 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7d4ef-4bc9-4136-a860-82db41c00207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8c3e26e923f463bbef57a252b7d8d80)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:17.884717 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7d4ef-4bc9-4136-a860-82db41c00207 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:17.949306 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-eba7d4ef-4bc9-4136-a860-82db41c00207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8c3e26e923f463bbef57a252b7d8d80'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:17.950201 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-eba7d4ef-4bc9-4136-a860-82db41c00207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8c3e26e923f463bbef57a252b7d8d80'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:17.958458 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-eba7d4ef-4bc9-4136-a860-82db41c00207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8c3e26e923f463bbef57a252b7d8d80'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:17.969065 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-eba7d4ef-4bc9-4136-a860-82db41c00207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8c3e26e923f463bbef57a252b7d8d80'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:17.969941 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-eba7d4ef-4bc9-4136-a860-82db41c00207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8c3e26e923f463bbef57a252b7d8d80'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:17.981311 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:18.005183 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1392/2787] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:36:17 2022] DELETE /identity/v3/users/e8c3e26e923f463bbef57a252b7d8d80 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:36:18.440878 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45839d6d-5565-44c7-a4b8-b9edf2fdb80a admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:18.443252 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-45839d6d-5565-44c7-a4b8-b9edf2fdb80a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:18.480372 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45839d6d-5565-44c7-a4b8-b9edf2fdb80a admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:18.541141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:18.592465 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945e1fa-a02c-497d-8e89-b1a0ea36717b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:18.593694 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945e1fa-a02c-497d-8e89-b1a0ea36717b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:18.594119 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945e1fa-a02c-497d-8e89-b1a0ea36717b admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:18.594496 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945e1fa-a02c-497d-8e89-b1a0ea36717b admin admin] PATH_INFO: `/v3/projects/1b37702990b1476da6dbbcbf966f5192` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:18.595854 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945e1fa-a02c-497d-8e89-b1a0ea36717b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b37702990b1476da6dbbcbf966f5192)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:18.597906 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945e1fa-a02c-497d-8e89-b1a0ea36717b admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:18.703609 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-c945e1fa-a02c-497d-8e89-b1a0ea36717b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b37702990b1476da6dbbcbf966f5192', 'request_id': 'req-c945e1fa-a02c-497d-8e89-b1a0ea36717b'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:18.721319 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-c945e1fa-a02c-497d-8e89-b1a0ea36717b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b37702990b1476da6dbbcbf966f5192', 'request_id': 'req-c945e1fa-a02c-497d-8e89-b1a0ea36717b'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:18.736197 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-c945e1fa-a02c-497d-8e89-b1a0ea36717b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b37702990b1476da6dbbcbf966f5192', 'request_id': 'req-c945e1fa-a02c-497d-8e89-b1a0ea36717b'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:18.758700 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-c945e1fa-a02c-497d-8e89-b1a0ea36717b admin admin] The token cache is being invalidate because project 1b37702990b1476da6dbbcbf966f5192 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:36:18.759014 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-c945e1fa-a02c-497d-8e89-b1a0ea36717b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:18.759773 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-c945e1fa-a02c-497d-8e89-b1a0ea36717b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:18.762065 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1396/2788] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:36:18 2022] DELETE /identity/v3/projects/1b37702990b1476da6dbbcbf966f5192 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:36:18.767065 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde5e26-e238-4069-83b4-d27a6f0fa80f None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:18.767347 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde5e26-e238-4069-83b4-d27a6f0fa80f None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:18.767623 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde5e26-e238-4069-83b4-d27a6f0fa80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:18.793060 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-ecde5e26-e238-4069-83b4-d27a6f0fa80f None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:36:18.795296 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-ecde5e26-e238-4069-83b4-d27a6f0fa80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:18.891506 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1393/2789] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:36:18.902297 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d18e0b-580d-4ace-a446-3176b7dc4dc6 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:18.902577 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d18e0b-580d-4ace-a446-3176b7dc4dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:18.902879 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d18e0b-580d-4ace-a446-3176b7dc4dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:18.932904 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-c9d18e0b-580d-4ace-a446-3176b7dc4dc6 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:36:18.934351 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-c9d18e0b-580d-4ace-a446-3176b7dc4dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:18.948556 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1397/2790] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:36:18.949850 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde5e26-e238-4069-83b4-d27a6f0fa80f None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:18.965587 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde5e26-e238-4069-83b4-d27a6f0fa80f None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:18.975704 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfdf26-c265-487d-9e84-b1df230e2be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:18.976691 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfdf26-c265-487d-9e84-b1df230e2be8 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:18.977198 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfdf26-c265-487d-9e84-b1df230e2be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:18.977787 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfdf26-c265-487d-9e84-b1df230e2be8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:18.978813 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfdf26-c265-487d-9e84-b1df230e2be8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:36:18.980084 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfdf26-c265-487d-9e84-b1df230e2be8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:18.982593 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfdf26-c265-487d-9e84-b1df230e2be8 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:19.011459 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1394/2791] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:36:19.017075 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d18e0b-580d-4ace-a446-3176b7dc4dc6 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:19.029907 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d18e0b-580d-4ace-a446-3176b7dc4dc6 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:19.037201 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00a60d-fcb4-4eff-b2e3-15210e0603c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:19.037901 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00a60d-fcb4-4eff-b2e3-15210e0603c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:19.038174 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00a60d-fcb4-4eff-b2e3-15210e0603c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:19.038443 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00a60d-fcb4-4eff-b2e3-15210e0603c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:19.039094 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00a60d-fcb4-4eff-b2e3-15210e0603c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:19.043180 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00a60d-fcb4-4eff-b2e3-15210e0603c0 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:19.088027 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1398/2792] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:36:19 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:36:19.092819 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfdf26-c265-487d-9e84-b1df230e2be8 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:19.111710 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfdf26-c265-487d-9e84-b1df230e2be8 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:19.234065 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dca8ad-b995-4c87-a81c-5ab6babc1859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:19.234880 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dca8ad-b995-4c87-a81c-5ab6babc1859 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:19.235259 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dca8ad-b995-4c87-a81c-5ab6babc1859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:19.235635 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dca8ad-b995-4c87-a81c-5ab6babc1859 admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:19.236432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dca8ad-b995-4c87-a81c-5ab6babc1859 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:19.239641 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dca8ad-b995-4c87-a81c-5ab6babc1859 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:19.288007 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1395/2793] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:36:19 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:36:19.289328 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00a60d-fcb4-4eff-b2e3-15210e0603c0 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:19.326603 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00a60d-fcb4-4eff-b2e3-15210e0603c0 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:19.357949 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38a927-04ae-4723-b21c-7c90b5afb004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:19.362419 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38a927-04ae-4723-b21c-7c90b5afb004 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:19.362802 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38a927-04ae-4723-b21c-7c90b5afb004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:19.365471 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38a927-04ae-4723-b21c-7c90b5afb004 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:19.366299 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38a927-04ae-4723-b21c-7c90b5afb004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:19.368898 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38a927-04ae-4723-b21c-7c90b5afb004 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:19.398346 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1399/2794] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:36:19.399641 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dca8ad-b995-4c87-a81c-5ab6babc1859 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:19.415666 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dca8ad-b995-4c87-a81c-5ab6babc1859 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:19.431008 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3f846-a8b5-4ec3-be98-a6a2f1831784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:19.431956 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3f846-a8b5-4ec3-be98-a6a2f1831784 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:19.432849 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3f846-a8b5-4ec3-be98-a6a2f1831784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:19.433290 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3f846-a8b5-4ec3-be98-a6a2f1831784 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:19.434317 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3f846-a8b5-4ec3-be98-a6a2f1831784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:19.437100 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3f846-a8b5-4ec3-be98-a6a2f1831784 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:19.466858 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1396/2795] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:36:19.471859 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38a927-04ae-4723-b21c-7c90b5afb004 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:19.488754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38a927-04ae-4723-b21c-7c90b5afb004 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:19.506241 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a2f4a-d600-41af-a4b6-5d1adffb576c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:19.506936 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a2f4a-d600-41af-a4b6-5d1adffb576c admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:19.507798 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a2f4a-d600-41af-a4b6-5d1adffb576c admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:19.507798 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a2f4a-d600-41af-a4b6-5d1adffb576c admin admin] PATH_INFO: `/v3/projects/7d25216147d346948bdd82c5f8cbe0a6/users/2befee74e7df412c827fecf8c705e3fd/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:19.550355 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a2f4a-d600-41af-a4b6-5d1adffb576c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d25216147d346948bdd82c5f8cbe0a6, user_id=2befee74e7df412c827fecf8c705e3fd, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:19.553161 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a2f4a-d600-41af-a4b6-5d1adffb576c admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:19.584030 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1400/2796] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:36:19 2022] PUT /identity/v3/projects/7d25216147d346948bdd82c5f8cbe0a6/users/2befee74e7df412c827fecf8c705e3fd/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:36:19.595627 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0176d1e-6a5b-4426-b5cc-648994446d9b None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:19.595908 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0176d1e-6a5b-4426-b5cc-648994446d9b None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:19.596180 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0176d1e-6a5b-4426-b5cc-648994446d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:19.664954 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-e0176d1e-6a5b-4426-b5cc-648994446d9b None None] MFA Rules not processed for user `2befee74e7df412c827fecf8c705e3fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:36:19.670631 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-e0176d1e-6a5b-4426-b5cc-648994446d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:19.766314 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:19.805785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1397/2797] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:36:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:36:19.807526 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a2f4a-d600-41af-a4b6-5d1adffb576c admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:19.898570 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:19.903918 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a2f4a-d600-41af-a4b6-5d1adffb576c admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:19.913647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28448271-f13a-4b45-8ef1-bf8dd3776547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:19.914284 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28448271-f13a-4b45-8ef1-bf8dd3776547 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:19.914622 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28448271-f13a-4b45-8ef1-bf8dd3776547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:19.915032 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28448271-f13a-4b45-8ef1-bf8dd3776547 admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:19.915680 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28448271-f13a-4b45-8ef1-bf8dd3776547 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:19.918361 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28448271-f13a-4b45-8ef1-bf8dd3776547 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:19.997832 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1401/2798] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:36:19 2022] POST /identity/v3/projects => generated 385 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:36:20.002431 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0176d1e-6a5b-4426-b5cc-648994446d9b None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:20.022153 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0176d1e-6a5b-4426-b5cc-648994446d9b None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:20.155345 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16568c3-d510-4386-9ff1-a9079598d607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:20.156423 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16568c3-d510-4386-9ff1-a9079598d607 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:20.156847 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16568c3-d510-4386-9ff1-a9079598d607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:20.157272 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16568c3-d510-4386-9ff1-a9079598d607 admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:20.159435 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16568c3-d510-4386-9ff1-a9079598d607 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:20.165009 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16568c3-d510-4386-9ff1-a9079598d607 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:20.225280 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1398/2799] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:36:20 2022] POST /identity/v3/users => generated 299 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:36:20.226673 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28448271-f13a-4b45-8ef1-bf8dd3776547 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:20.244260 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28448271-f13a-4b45-8ef1-bf8dd3776547 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:20.258753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa72486-e2b6-490a-aa03-502c3542c957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:20.259379 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa72486-e2b6-490a-aa03-502c3542c957 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:20.261082 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa72486-e2b6-490a-aa03-502c3542c957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:20.261399 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa72486-e2b6-490a-aa03-502c3542c957 admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:20.262243 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa72486-e2b6-490a-aa03-502c3542c957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:20.263908 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa72486-e2b6-490a-aa03-502c3542c957 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:20.291496 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1402/2800] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:36:20.294981 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16568c3-d510-4386-9ff1-a9079598d607 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:20.319365 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16568c3-d510-4386-9ff1-a9079598d607 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:20.333405 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf9832-0d02-4c66-83f4-5196290087ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:20.334138 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf9832-0d02-4c66-83f4-5196290087ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:20.334453 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf9832-0d02-4c66-83f4-5196290087ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:20.334730 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf9832-0d02-4c66-83f4-5196290087ef admin admin] PATH_INFO: `/v3/projects/9ad145f180584b038082f723171d9b86/users/c24f6cc6a39b423abec8895e6b426ecf/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:20.367624 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf9832-0d02-4c66-83f4-5196290087ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad145f180584b038082f723171d9b86, user_id=c24f6cc6a39b423abec8895e6b426ecf, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:20.373351 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf9832-0d02-4c66-83f4-5196290087ef admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:20.412859 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1399/2801] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:36:20 2022] PUT /identity/v3/projects/9ad145f180584b038082f723171d9b86/users/c24f6cc6a39b423abec8895e6b426ecf/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:36:20.417536 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa72486-e2b6-490a-aa03-502c3542c957 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:20.433533 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa72486-e2b6-490a-aa03-502c3542c957 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:20.523712 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561a362-5586-4f26-a969-aa5f227aa87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:20.525314 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561a362-5586-4f26-a969-aa5f227aa87f admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:20.525856 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561a362-5586-4f26-a969-aa5f227aa87f admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:20.526381 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561a362-5586-4f26-a969-aa5f227aa87f admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:20.528530 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561a362-5586-4f26-a969-aa5f227aa87f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:20.531700 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561a362-5586-4f26-a969-aa5f227aa87f admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:20.548929 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1403/2802] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:36:20.553682 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf9832-0d02-4c66-83f4-5196290087ef admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:20.573899 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf9832-0d02-4c66-83f4-5196290087ef admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:20.581658 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06eff4-9189-48ab-a41e-6bc47ca6633e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:20.582506 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06eff4-9189-48ab-a41e-6bc47ca6633e admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:20.582704 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06eff4-9189-48ab-a41e-6bc47ca6633e admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:20.583043 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06eff4-9189-48ab-a41e-6bc47ca6633e admin admin] PATH_INFO: `/v3/projects/9ad145f180584b038082f723171d9b86/users/c24f6cc6a39b423abec8895e6b426ecf/roles/e806ce849cf34b92979b5524f3ea9ff6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:20.585702 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e06eff4-9189-48ab-a41e-6bc47ca6633e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad145f180584b038082f723171d9b86, user_id=c24f6cc6a39b423abec8895e6b426ecf, role_id=e806ce849cf34b92979b5524f3ea9ff6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:20.588704 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e06eff4-9189-48ab-a41e-6bc47ca6633e admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:20.609618 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1400/2803] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:36:20 2022] PUT /identity/v3/projects/9ad145f180584b038082f723171d9b86/users/c24f6cc6a39b423abec8895e6b426ecf/roles/e806ce849cf34b92979b5524f3ea9ff6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:36:20.625997 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bc9af-c836-49a9-9665-471975c85b1d None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:20.626283 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bc9af-c836-49a9-9665-471975c85b1d None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:20.626628 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bc9af-c836-49a9-9665-471975c85b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:20.664281 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-dd1bc9af-c836-49a9-9665-471975c85b1d None None] MFA Rules not processed for user `c24f6cc6a39b423abec8895e6b426ecf`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:36:20.666016 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-dd1bc9af-c836-49a9-9665-471975c85b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:20.780064 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1404/2804] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:36:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:36:20.800084 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06eff4-9189-48ab-a41e-6bc47ca6633e admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:20.803983 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-6e06eff4-9189-48ab-a41e-6bc47ca6633e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:20.931264 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06eff4-9189-48ab-a41e-6bc47ca6633e admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:20.939686 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c83b3-f13e-497d-bd9c-70c90ab48a6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:20.940993 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c83b3-f13e-497d-bd9c-70c90ab48a6f service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:20.941790 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c83b3-f13e-497d-bd9c-70c90ab48a6f service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:20.942805 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c83b3-f13e-497d-bd9c-70c90ab48a6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:20.962464 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c83b3-f13e-497d-bd9c-70c90ab48a6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:20.974049 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c83b3-f13e-497d-bd9c-70c90ab48a6f service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:20.994820 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1401/2805] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:36:20 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:36:22.134659 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bc9af-c836-49a9-9665-471975c85b1d None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:22.241831 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:22.257862 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bc9af-c836-49a9-9665-471975c85b1d None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:22.262734 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd01dd-6124-41ec-abaf-ab9ee2941cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:22.263392 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd01dd-6124-41ec-abaf-ab9ee2941cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:22.263667 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd01dd-6124-41ec-abaf-ab9ee2941cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:22.264137 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd01dd-6124-41ec-abaf-ab9ee2941cb9 admin admin] PATH_INFO: `/v3/users/2befee74e7df412c827fecf8c705e3fd` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:22.266276 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecd01dd-6124-41ec-abaf-ab9ee2941cb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2befee74e7df412c827fecf8c705e3fd)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:22.268618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecd01dd-6124-41ec-abaf-ab9ee2941cb9 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:22.348109 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-8ecd01dd-6124-41ec-abaf-ab9ee2941cb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2befee74e7df412c827fecf8c705e3fd'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:22.349978 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-8ecd01dd-6124-41ec-abaf-ab9ee2941cb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2befee74e7df412c827fecf8c705e3fd'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:22.377502 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-8ecd01dd-6124-41ec-abaf-ab9ee2941cb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2befee74e7df412c827fecf8c705e3fd'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:22.393566 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-8ecd01dd-6124-41ec-abaf-ab9ee2941cb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2befee74e7df412c827fecf8c705e3fd'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:22.429744 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-8ecd01dd-6124-41ec-abaf-ab9ee2941cb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2befee74e7df412c827fecf8c705e3fd'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:22.448941 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1405/2806] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:36:22 2022] DELETE /identity/v3/users/2befee74e7df412c827fecf8c705e3fd => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:36:22.452171 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a4f74-0ccd-4d93-91e2-75d65e7a559a None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:22.452923 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a4f74-0ccd-4d93-91e2-75d65e7a559a None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:22.452923 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a4f74-0ccd-4d93-91e2-75d65e7a559a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:22.489097 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-811a4f74-0ccd-4d93-91e2-75d65e7a559a None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:36:22.491332 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-811a4f74-0ccd-4d93-91e2-75d65e7a559a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:22.616493 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:22.665979 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1402/2807] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:36:22.683240 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd01dd-6124-41ec-abaf-ab9ee2941cb9 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:22.689833 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-8ecd01dd-6124-41ec-abaf-ab9ee2941cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:22.908141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd01dd-6124-41ec-abaf-ab9ee2941cb9 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:22.916398 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71d12b-4601-49d5-9e11-a929820dd852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:22.917822 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71d12b-4601-49d5-9e11-a929820dd852 service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:22.918458 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71d12b-4601-49d5-9e11-a929820dd852 service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:22.919095 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71d12b-4601-49d5-9e11-a929820dd852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:22.939308 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71d12b-4601-49d5-9e11-a929820dd852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:22.941721 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71d12b-4601-49d5-9e11-a929820dd852 service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:22.958423 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1406/2808] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:36:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:36:23.561208 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a4f74-0ccd-4d93-91e2-75d65e7a559a None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:23.580258 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-811a4f74-0ccd-4d93-91e2-75d65e7a559a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:23.609658 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a4f74-0ccd-4d93-91e2-75d65e7a559a None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:23.627522 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4af9d-edb4-43ef-9786-f38e1a6a17c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:23.628644 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4af9d-edb4-43ef-9786-f38e1a6a17c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:23.629138 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4af9d-edb4-43ef-9786-f38e1a6a17c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:23.629892 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4af9d-edb4-43ef-9786-f38e1a6a17c5 admin admin] PATH_INFO: `/v3/projects/7d25216147d346948bdd82c5f8cbe0a6` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:23.632539 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4af9d-edb4-43ef-9786-f38e1a6a17c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d25216147d346948bdd82c5f8cbe0a6)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:23.636664 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4af9d-edb4-43ef-9786-f38e1a6a17c5 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:23.720083 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-4fb4af9d-edb4-43ef-9786-f38e1a6a17c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d25216147d346948bdd82c5f8cbe0a6', 'request_id': 'req-4fb4af9d-edb4-43ef-9786-f38e1a6a17c5'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:23.737009 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-4fb4af9d-edb4-43ef-9786-f38e1a6a17c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d25216147d346948bdd82c5f8cbe0a6', 'request_id': 'req-4fb4af9d-edb4-43ef-9786-f38e1a6a17c5'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:23.746716 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-4fb4af9d-edb4-43ef-9786-f38e1a6a17c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d25216147d346948bdd82c5f8cbe0a6', 'request_id': 'req-4fb4af9d-edb4-43ef-9786-f38e1a6a17c5'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:23.773485 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-4fb4af9d-edb4-43ef-9786-f38e1a6a17c5 admin admin] The token cache is being invalidate because project 7d25216147d346948bdd82c5f8cbe0a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:36:23.773485 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-4fb4af9d-edb4-43ef-9786-f38e1a6a17c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:23.773485 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-4fb4af9d-edb4-43ef-9786-f38e1a6a17c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:23.775973 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1403/2809] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:36:23 2022] DELETE /identity/v3/projects/7d25216147d346948bdd82c5f8cbe0a6 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:36:23.778379 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71d12b-4601-49d5-9e11-a929820dd852 service neutron] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:23.806706 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71d12b-4601-49d5-9e11-a929820dd852 service neutron] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:23.897207 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dbfef1-bcd5-4aa5-b849-6796eeb51077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:23.898002 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbfef1-bcd5-4aa5-b849-6796eeb51077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:23.898367 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbfef1-bcd5-4aa5-b849-6796eeb51077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:23.899320 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbfef1-bcd5-4aa5-b849-6796eeb51077 admin admin] PATH_INFO: `/v3/users/c24f6cc6a39b423abec8895e6b426ecf` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:23.900762 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dbfef1-bcd5-4aa5-b849-6796eeb51077 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c24f6cc6a39b423abec8895e6b426ecf)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:23.903204 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dbfef1-bcd5-4aa5-b849-6796eeb51077 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:23.930184 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:23.974731 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-35dbfef1-bcd5-4aa5-b849-6796eeb51077 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c24f6cc6a39b423abec8895e6b426ecf'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:23.975371 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-35dbfef1-bcd5-4aa5-b849-6796eeb51077 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c24f6cc6a39b423abec8895e6b426ecf'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:23.983930 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-35dbfef1-bcd5-4aa5-b849-6796eeb51077 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c24f6cc6a39b423abec8895e6b426ecf'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:23.992706 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-35dbfef1-bcd5-4aa5-b849-6796eeb51077 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c24f6cc6a39b423abec8895e6b426ecf'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:24.023739 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-35dbfef1-bcd5-4aa5-b849-6796eeb51077 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c24f6cc6a39b423abec8895e6b426ecf'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:24.037218 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1407/2810] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:36:23 2022] DELETE /identity/v3/users/c24f6cc6a39b423abec8895e6b426ecf => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:36:24.392082 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4af9d-edb4-43ef-9786-f38e1a6a17c5 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:24.394176 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-4fb4af9d-edb4-43ef-9786-f38e1a6a17c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:24.431355 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4af9d-edb4-43ef-9786-f38e1a6a17c5 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:24.504835 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255353a8-7cb8-4f37-98d4-b982dd86acc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:24.505470 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255353a8-7cb8-4f37-98d4-b982dd86acc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:24.505760 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255353a8-7cb8-4f37-98d4-b982dd86acc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:24.506078 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255353a8-7cb8-4f37-98d4-b982dd86acc9 admin admin] PATH_INFO: `/v3/projects/9ad145f180584b038082f723171d9b86` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:24.507500 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255353a8-7cb8-4f37-98d4-b982dd86acc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ad145f180584b038082f723171d9b86)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:24.509613 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255353a8-7cb8-4f37-98d4-b982dd86acc9 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:24.568128 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-255353a8-7cb8-4f37-98d4-b982dd86acc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ad145f180584b038082f723171d9b86', 'request_id': 'req-255353a8-7cb8-4f37-98d4-b982dd86acc9'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:24.575949 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-255353a8-7cb8-4f37-98d4-b982dd86acc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ad145f180584b038082f723171d9b86', 'request_id': 'req-255353a8-7cb8-4f37-98d4-b982dd86acc9'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:24.585282 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-255353a8-7cb8-4f37-98d4-b982dd86acc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ad145f180584b038082f723171d9b86', 'request_id': 'req-255353a8-7cb8-4f37-98d4-b982dd86acc9'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:24.595472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:24.605604 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-255353a8-7cb8-4f37-98d4-b982dd86acc9 admin admin] The token cache is being invalidate because project 9ad145f180584b038082f723171d9b86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:36:24.606347 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-255353a8-7cb8-4f37-98d4-b982dd86acc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:24.608687 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-255353a8-7cb8-4f37-98d4-b982dd86acc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:24.616575 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1404/2811] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:36:24 2022] DELETE /identity/v3/projects/9ad145f180584b038082f723171d9b86 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:36:24.618278 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f94e22-0d52-42a4-9d8f-0877d020e63c None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:24.618781 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f94e22-0d52-42a4-9d8f-0877d020e63c None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:24.618901 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f94e22-0d52-42a4-9d8f-0877d020e63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:24.644159 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-b8f94e22-0d52-42a4-9d8f-0877d020e63c None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:36:24.645415 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-b8f94e22-0d52-42a4-9d8f-0877d020e63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:24.766880 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1408/2812] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:36:24.775996 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea5420-c7de-4146-9de7-3e3bf36d9441 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:24.776288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea5420-c7de-4146-9de7-3e3bf36d9441 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:24.776574 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea5420-c7de-4146-9de7-3e3bf36d9441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:24.804738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-61ea5420-c7de-4146-9de7-3e3bf36d9441 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:36:24.806040 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-61ea5420-c7de-4146-9de7-3e3bf36d9441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:24.815393 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1405/2813] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:36:24.819954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f94e22-0d52-42a4-9d8f-0877d020e63c None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:24.833573 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f94e22-0d52-42a4-9d8f-0877d020e63c None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:24.841128 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07fba9-b725-4e2a-87eb-37ff6ba3bc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:24.841815 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07fba9-b725-4e2a-87eb-37ff6ba3bc62 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:24.842128 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07fba9-b725-4e2a-87eb-37ff6ba3bc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:24.842396 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07fba9-b725-4e2a-87eb-37ff6ba3bc62 admin admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:24.843471 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07fba9-b725-4e2a-87eb-37ff6ba3bc62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:36:24.843979 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07fba9-b725-4e2a-87eb-37ff6ba3bc62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:24.845809 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07fba9-b725-4e2a-87eb-37ff6ba3bc62 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:24.863239 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1409/2814] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:36:24.867803 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea5420-c7de-4146-9de7-3e3bf36d9441 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:24.880442 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea5420-c7de-4146-9de7-3e3bf36d9441 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:24.888092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70852b6a-d1f7-4eb5-99a9-6c46fed4c078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:24.889886 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70852b6a-d1f7-4eb5-99a9-6c46fed4c078 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:24.890376 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70852b6a-d1f7-4eb5-99a9-6c46fed4c078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:24.890862 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70852b6a-d1f7-4eb5-99a9-6c46fed4c078 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:24.891701 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70852b6a-d1f7-4eb5-99a9-6c46fed4c078 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:24.893867 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70852b6a-d1f7-4eb5-99a9-6c46fed4c078 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:24.948594 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1406/2815] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:36:24 2022] POST /identity/v3/projects => generated 371 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:36:24.950181 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07fba9-b725-4e2a-87eb-37ff6ba3bc62 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:24.965151 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07fba9-b725-4e2a-87eb-37ff6ba3bc62 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:25.069524 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492c21f-88b1-4dd4-aa2c-f838df964434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:25.069524 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492c21f-88b1-4dd4-aa2c-f838df964434 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:25.069524 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492c21f-88b1-4dd4-aa2c-f838df964434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:25.069524 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492c21f-88b1-4dd4-aa2c-f838df964434 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:25.070072 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492c21f-88b1-4dd4-aa2c-f838df964434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:25.072443 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492c21f-88b1-4dd4-aa2c-f838df964434 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:25.101404 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1410/2816] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:36:24 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:36:25.105617 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70852b6a-d1f7-4eb5-99a9-6c46fed4c078 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:25.117835 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70852b6a-d1f7-4eb5-99a9-6c46fed4c078 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:25.123059 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2dda5a-6709-49f2-a5db-4235fd6b6172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:25.123809 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2dda5a-6709-49f2-a5db-4235fd6b6172 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:25.124807 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2dda5a-6709-49f2-a5db-4235fd6b6172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:25.125196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2dda5a-6709-49f2-a5db-4235fd6b6172 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:25.125915 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2dda5a-6709-49f2-a5db-4235fd6b6172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:25.127621 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2dda5a-6709-49f2-a5db-4235fd6b6172 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:25.139243 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1407/2817] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:36:25.143986 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492c21f-88b1-4dd4-aa2c-f838df964434 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:25.156588 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492c21f-88b1-4dd4-aa2c-f838df964434 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:25.161715 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0e791-6b2e-421b-9e85-039c14d3be5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:25.162384 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0e791-6b2e-421b-9e85-039c14d3be5a admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:25.162666 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0e791-6b2e-421b-9e85-039c14d3be5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:25.162938 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0e791-6b2e-421b-9e85-039c14d3be5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:25.163812 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c0e791-6b2e-421b-9e85-039c14d3be5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:25.165454 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c0e791-6b2e-421b-9e85-039c14d3be5a admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:25.172917 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:25.185043 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1411/2818] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:36:25.185657 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2dda5a-6709-49f2-a5db-4235fd6b6172 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:25.197717 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2dda5a-6709-49f2-a5db-4235fd6b6172 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:25.202930 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc9659-ae33-4471-ad5c-7b75f47d176e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:25.203591 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc9659-ae33-4471-ad5c-7b75f47d176e admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:25.203905 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc9659-ae33-4471-ad5c-7b75f47d176e admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:25.204262 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc9659-ae33-4471-ad5c-7b75f47d176e admin admin] PATH_INFO: `/v3/projects/e764ce729f2c4b41816c1ba6020f01b1/users/e7db34617ca541e8bae5278b906b0e4f/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:25.222701 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc9659-ae33-4471-ad5c-7b75f47d176e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e764ce729f2c4b41816c1ba6020f01b1, user_id=e7db34617ca541e8bae5278b906b0e4f, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:25.225629 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc9659-ae33-4471-ad5c-7b75f47d176e admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:25.241971 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1408/2819] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:36:25 2022] PUT /identity/v3/projects/e764ce729f2c4b41816c1ba6020f01b1/users/e7db34617ca541e8bae5278b906b0e4f/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:36:25.253274 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8135c1-7f3e-46f8-8d4a-5872a8dbc37e None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:25.254281 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8135c1-7f3e-46f8-8d4a-5872a8dbc37e None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:25.254935 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8135c1-7f3e-46f8-8d4a-5872a8dbc37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:25.290898 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-3d8135c1-7f3e-46f8-8d4a-5872a8dbc37e None None] MFA Rules not processed for user `e7db34617ca541e8bae5278b906b0e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:36:25.292081 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-3d8135c1-7f3e-46f8-8d4a-5872a8dbc37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:25.381844 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1412/2820] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:36:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:36:25.394922 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc9659-ae33-4471-ad5c-7b75f47d176e admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:25.396939 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-a1cc9659-ae33-4471-ad5c-7b75f47d176e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:25.495297 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc9659-ae33-4471-ad5c-7b75f47d176e admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:25.499517 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4b852-00f3-407b-b0f0-4001a7deecb3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '855cbc7a992d4c6697632d2d4d74abfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:25.500357 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4b852-00f3-407b-b0f0-4001a7deecb3 service glance] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:25.500678 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4b852-00f3-407b-b0f0-4001a7deecb3 service glance] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:25.500956 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4b852-00f3-407b-b0f0-4001a7deecb3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:25.511831 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4b852-00f3-407b-b0f0-4001a7deecb3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:25.512999 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4b852-00f3-407b-b0f0-4001a7deecb3 service glance] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:25.525545 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1409/2821] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:36:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:36:27.247034 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8135c1-7f3e-46f8-8d4a-5872a8dbc37e None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:27.249705 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-3d8135c1-7f3e-46f8-8d4a-5872a8dbc37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:27.524216 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8135c1-7f3e-46f8-8d4a-5872a8dbc37e None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:27.530198 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13627a59-3ce8-4e4e-bd92-1a508a0181af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2000b80e34ae45d2a8b658cd394419f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:27.530844 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13627a59-3ce8-4e4e-bd92-1a508a0181af service placement] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:27.531224 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13627a59-3ce8-4e4e-bd92-1a508a0181af service placement] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:27.531502 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13627a59-3ce8-4e4e-bd92-1a508a0181af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:27.534096 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-13627a59-3ce8-4e4e-bd92-1a508a0181af service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:27.550133 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13627a59-3ce8-4e4e-bd92-1a508a0181af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:27.552024 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13627a59-3ce8-4e4e-bd92-1a508a0181af service placement] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:27.565462 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1413/2822] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:36:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:36:35.519182 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=55,keystone:INSERT=2 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:37.558655 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=73 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:38.765883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c26e40-be1f-46c7-a2ea-f95d6b80b332 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:38.766382 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c26e40-be1f-46c7-a2ea-f95d6b80b332 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:38.766513 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c26e40-be1f-46c7-a2ea-f95d6b80b332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:38.788400 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-18c26e40-be1f-46c7-a2ea-f95d6b80b332 None None] MFA Rules not processed for user `02e415eb75984daa97ee79fc0146f318`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:36:38.789748 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-18c26e40-be1f-46c7-a2ea-f95d6b80b332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:38.851117 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1410/2823] 10.222.0.77 () {58 vars in 967 bytes} [Tue Aug 23 22:36:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:36:38.871208 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13627a59-3ce8-4e4e-bd92-1a508a0181af service placement] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:38.871208 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-13627a59-3ce8-4e4e-bd92-1a508a0181af service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:38.944792 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13627a59-3ce8-4e4e-bd92-1a508a0181af service placement] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:38.950120 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc3db3-8552-46b4-81c7-93bd259ebddf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abda1f23a18c4c808483cd6b53952975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:38.950753 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc3db3-8552-46b4-81c7-93bd259ebddf service swift] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:38.951027 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc3db3-8552-46b4-81c7-93bd259ebddf service swift] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:38.951295 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc3db3-8552-46b4-81c7-93bd259ebddf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:38.960681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc3db3-8552-46b4-81c7-93bd259ebddf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:38.962231 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc3db3-8552-46b4-81c7-93bd259ebddf service swift] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:38.970661 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1414/2824] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Aug 23 22:36:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 22:36:39.915196 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ce084-cb2c-411c-9ee5-ad0bc1622a9d None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:39.915849 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ce084-cb2c-411c-9ee5-ad0bc1622a9d None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:39.915849 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ce084-cb2c-411c-9ee5-ad0bc1622a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:39.937645 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-709ce084-cb2c-411c-9ee5-ad0bc1622a9d None None] MFA Rules not processed for user `02e415eb75984daa97ee79fc0146f318`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:36:39.938864 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-709ce084-cb2c-411c-9ee5-ad0bc1622a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:39.946101 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1411/2825] 10.222.0.77 () {58 vars in 967 bytes} [Tue Aug 23 22:36:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:36:39.959091 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc3db3-8552-46b4-81c7-93bd259ebddf service swift] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:39.971924 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc3db3-8552-46b4-81c7-93bd259ebddf service swift] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:39.977595 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0327d0-941f-4005-bf61-c2f880adb2e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abda1f23a18c4c808483cd6b53952975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:39.978288 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0327d0-941f-4005-bf61-c2f880adb2e8 service swift] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:39.978807 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0327d0-941f-4005-bf61-c2f880adb2e8 service swift] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:39.979304 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0327d0-941f-4005-bf61-c2f880adb2e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:39.990045 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0327d0-941f-4005-bf61-c2f880adb2e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:39.991647 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0327d0-941f-4005-bf61-c2f880adb2e8 service swift] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:40.001238 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1415/2826] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Aug 23 22:36:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 22:36:42.123128 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ce084-cb2c-411c-9ee5-ad0bc1622a9d None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:42.126912 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-709ce084-cb2c-411c-9ee5-ad0bc1622a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:42.211333 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ce084-cb2c-411c-9ee5-ad0bc1622a9d None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:42.218989 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118b06f-db7f-4557-87e9-1c4c20e90e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:42.219774 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118b06f-db7f-4557-87e9-1c4c20e90e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:42.220404 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118b06f-db7f-4557-87e9-1c4c20e90e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:42.220891 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118b06f-db7f-4557-87e9-1c4c20e90e46 admin admin] PATH_INFO: `/v3/users/995f054403704de9a9a1dab3094e542a` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:42.222130 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118b06f-db7f-4557-87e9-1c4c20e90e46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=995f054403704de9a9a1dab3094e542a)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:42.224943 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118b06f-db7f-4557-87e9-1c4c20e90e46 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:42.316349 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f118b06f-db7f-4557-87e9-1c4c20e90e46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '995f054403704de9a9a1dab3094e542a'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:42.317043 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f118b06f-db7f-4557-87e9-1c4c20e90e46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '995f054403704de9a9a1dab3094e542a'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:42.330025 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f118b06f-db7f-4557-87e9-1c4c20e90e46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '995f054403704de9a9a1dab3094e542a'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:42.343153 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f118b06f-db7f-4557-87e9-1c4c20e90e46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '995f054403704de9a9a1dab3094e542a'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:42.344765 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f118b06f-db7f-4557-87e9-1c4c20e90e46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '995f054403704de9a9a1dab3094e542a'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:42.370276 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1412/2827] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:36:42 2022] DELETE /identity/v3/users/995f054403704de9a9a1dab3094e542a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:36:42.620077 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0327d0-941f-4005-bf61-c2f880adb2e8 service swift] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:42.641135 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0327d0-941f-4005-bf61-c2f880adb2e8 service swift] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:42.741538 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076c840-75b4-490b-93f3-166343207e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:42.742391 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076c840-75b4-490b-93f3-166343207e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:42.742852 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076c840-75b4-490b-93f3-166343207e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:42.743293 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076c840-75b4-490b-93f3-166343207e7d admin admin] PATH_INFO: `/v3/projects/3733736038d44ed6924b825ab665f298` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:42.744723 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076c840-75b4-490b-93f3-166343207e7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3733736038d44ed6924b825ab665f298)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:42.747343 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076c840-75b4-490b-93f3-166343207e7d admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:42.821819 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-1076c840-75b4-490b-93f3-166343207e7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3733736038d44ed6924b825ab665f298', 'request_id': 'req-1076c840-75b4-490b-93f3-166343207e7d'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:42.828082 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-1076c840-75b4-490b-93f3-166343207e7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3733736038d44ed6924b825ab665f298', 'request_id': 'req-1076c840-75b4-490b-93f3-166343207e7d'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:42.844808 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-1076c840-75b4-490b-93f3-166343207e7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3733736038d44ed6924b825ab665f298', 'request_id': 'req-1076c840-75b4-490b-93f3-166343207e7d'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:42.859469 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-1076c840-75b4-490b-93f3-166343207e7d admin admin] The token cache is being invalidate because project 3733736038d44ed6924b825ab665f298 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:36:42.859833 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-1076c840-75b4-490b-93f3-166343207e7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:42.860552 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-1076c840-75b4-490b-93f3-166343207e7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:42.865580 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1416/2828] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:36:42 2022] DELETE /identity/v3/projects/3733736038d44ed6924b825ab665f298 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:36:42.869248 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577180c-260a-4891-896c-9874ea215e2c None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:42.869629 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577180c-260a-4891-896c-9874ea215e2c None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:42.869917 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577180c-260a-4891-896c-9874ea215e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:42.895939 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-9577180c-260a-4891-896c-9874ea215e2c None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:36:42.897612 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-9577180c-260a-4891-896c-9874ea215e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:42.916190 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:42.977703 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1413/2829] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:36:42.986378 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab06a2-ae21-4e37-992f-da5ae0b3ba34 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:42.986670 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab06a2-ae21-4e37-992f-da5ae0b3ba34 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:42.987150 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab06a2-ae21-4e37-992f-da5ae0b3ba34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:43.007166 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:43.017568 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-93ab06a2-ae21-4e37-992f-da5ae0b3ba34 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:36:43.018789 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-93ab06a2-ae21-4e37-992f-da5ae0b3ba34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:43.027319 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1417/2830] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:36:43.032435 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577180c-260a-4891-896c-9874ea215e2c None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:43.042895 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577180c-260a-4891-896c-9874ea215e2c None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:43.058015 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c72990-cb3f-434e-973c-e2c9df5d2af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:43.058589 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c72990-cb3f-434e-973c-e2c9df5d2af2 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:43.058868 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c72990-cb3f-434e-973c-e2c9df5d2af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:43.059135 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c72990-cb3f-434e-973c-e2c9df5d2af2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:43.059804 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c72990-cb3f-434e-973c-e2c9df5d2af2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:36:43.060134 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c72990-cb3f-434e-973c-e2c9df5d2af2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:43.062081 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c72990-cb3f-434e-973c-e2c9df5d2af2 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:43.080447 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1414/2831] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:36:43.086196 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab06a2-ae21-4e37-992f-da5ae0b3ba34 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:43.095904 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab06a2-ae21-4e37-992f-da5ae0b3ba34 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:43.100752 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbed37-28ef-4e6f-a8dd-a7b12c2643c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:43.101416 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbed37-28ef-4e6f-a8dd-a7b12c2643c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:43.101699 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbed37-28ef-4e6f-a8dd-a7b12c2643c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:43.101961 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbed37-28ef-4e6f-a8dd-a7b12c2643c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:43.102618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcbed37-28ef-4e6f-a8dd-a7b12c2643c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:43.104609 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcbed37-28ef-4e6f-a8dd-a7b12c2643c0 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:43.141300 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1418/2832] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:36:43 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:36:43.145779 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c72990-cb3f-434e-973c-e2c9df5d2af2 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:43.157769 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c72990-cb3f-434e-973c-e2c9df5d2af2 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:43.224378 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f6f4b-1b75-43dc-942e-2770c9c98a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:43.225000 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f6f4b-1b75-43dc-942e-2770c9c98a74 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:43.225279 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f6f4b-1b75-43dc-942e-2770c9c98a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:43.225603 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f6f4b-1b75-43dc-942e-2770c9c98a74 admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:43.226253 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f6f4b-1b75-43dc-942e-2770c9c98a74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:43.228260 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f6f4b-1b75-43dc-942e-2770c9c98a74 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:43.258650 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1415/2833] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:36:43 2022] POST /identity/v3/users => generated 286 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:36:43.262867 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbed37-28ef-4e6f-a8dd-a7b12c2643c0 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:43.275508 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbed37-28ef-4e6f-a8dd-a7b12c2643c0 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:43.281729 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8688d47-2c3f-4cb4-a633-bec80a3a2a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:43.282348 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8688d47-2c3f-4cb4-a633-bec80a3a2a7b admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:43.284100 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8688d47-2c3f-4cb4-a633-bec80a3a2a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:43.284389 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8688d47-2c3f-4cb4-a633-bec80a3a2a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:43.285057 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8688d47-2c3f-4cb4-a633-bec80a3a2a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:43.287023 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8688d47-2c3f-4cb4-a633-bec80a3a2a7b admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:43.299543 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1419/2834] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:36:43.303734 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f6f4b-1b75-43dc-942e-2770c9c98a74 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:43.315160 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f6f4b-1b75-43dc-942e-2770c9c98a74 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:43.320960 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdf42a-8afc-4dd8-bb85-61ecfff11c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:43.321736 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdf42a-8afc-4dd8-bb85-61ecfff11c42 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:43.322118 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdf42a-8afc-4dd8-bb85-61ecfff11c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:43.322493 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdf42a-8afc-4dd8-bb85-61ecfff11c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:43.323438 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bdf42a-8afc-4dd8-bb85-61ecfff11c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:43.325210 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bdf42a-8afc-4dd8-bb85-61ecfff11c42 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:43.346255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1416/2835] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:36:43.350359 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8688d47-2c3f-4cb4-a633-bec80a3a2a7b admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:43.361784 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8688d47-2c3f-4cb4-a633-bec80a3a2a7b admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:43.367329 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08393e6f-0eb0-444e-b181-0a4638dfcc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:43.367936 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08393e6f-0eb0-444e-b181-0a4638dfcc62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:43.368222 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08393e6f-0eb0-444e-b181-0a4638dfcc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:43.369001 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08393e6f-0eb0-444e-b181-0a4638dfcc62 admin admin] PATH_INFO: `/v3/projects/563c97359c904e19879c90d8ef019502/users/9ce619f93adb4259812aeeb0111eff21/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:43.386101 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08393e6f-0eb0-444e-b181-0a4638dfcc62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=563c97359c904e19879c90d8ef019502, user_id=9ce619f93adb4259812aeeb0111eff21, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:43.388806 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08393e6f-0eb0-444e-b181-0a4638dfcc62 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:43.405960 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1420/2836] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:36:43 2022] PUT /identity/v3/projects/563c97359c904e19879c90d8ef019502/users/9ce619f93adb4259812aeeb0111eff21/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:36:43.417650 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a162119-57e2-449e-895b-be59dc436acc None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:43.418156 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a162119-57e2-449e-895b-be59dc436acc None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:43.418434 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a162119-57e2-449e-895b-be59dc436acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:43.453738 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-9a162119-57e2-449e-895b-be59dc436acc None None] MFA Rules not processed for user `9ce619f93adb4259812aeeb0111eff21`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:36:43.455293 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-9a162119-57e2-449e-895b-be59dc436acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:43.552883 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1417/2837] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:36:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:36:43.566196 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08393e6f-0eb0-444e-b181-0a4638dfcc62 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:43.570800 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-08393e6f-0eb0-444e-b181-0a4638dfcc62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:43.639996 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08393e6f-0eb0-444e-b181-0a4638dfcc62 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:43.644341 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf188eed-1288-4435-af18-919a4fe23769 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:43.644961 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf188eed-1288-4435-af18-919a4fe23769 service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:43.645247 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf188eed-1288-4435-af18-919a4fe23769 service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:43.645552 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf188eed-1288-4435-af18-919a4fe23769 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:43.658051 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf188eed-1288-4435-af18-919a4fe23769 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:43.659781 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf188eed-1288-4435-af18-919a4fe23769 service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:43.669822 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1421/2838] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:36:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:36:43.698845 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a162119-57e2-449e-895b-be59dc436acc None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:43.713331 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:43.774288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a162119-57e2-449e-895b-be59dc436acc None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:43.781341 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d45eb0-0d3e-4dc9-892f-8fd8f4954aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:43.786360 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d45eb0-0d3e-4dc9-892f-8fd8f4954aa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:43.786360 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d45eb0-0d3e-4dc9-892f-8fd8f4954aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:43.786360 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d45eb0-0d3e-4dc9-892f-8fd8f4954aa6 admin admin] PATH_INFO: `/v3/users/9ce619f93adb4259812aeeb0111eff21` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:43.786360 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d45eb0-0d3e-4dc9-892f-8fd8f4954aa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ce619f93adb4259812aeeb0111eff21)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:43.786980 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d45eb0-0d3e-4dc9-892f-8fd8f4954aa6 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:43.838821 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f7d45eb0-0d3e-4dc9-892f-8fd8f4954aa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ce619f93adb4259812aeeb0111eff21'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:43.839435 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f7d45eb0-0d3e-4dc9-892f-8fd8f4954aa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ce619f93adb4259812aeeb0111eff21'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:43.847221 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f7d45eb0-0d3e-4dc9-892f-8fd8f4954aa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ce619f93adb4259812aeeb0111eff21'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:43.855232 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f7d45eb0-0d3e-4dc9-892f-8fd8f4954aa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ce619f93adb4259812aeeb0111eff21'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:43.856003 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-f7d45eb0-0d3e-4dc9-892f-8fd8f4954aa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ce619f93adb4259812aeeb0111eff21'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:43.875627 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1418/2839] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:36:43 2022] DELETE /identity/v3/users/9ce619f93adb4259812aeeb0111eff21 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:36:43.880101 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9675ab-6b13-4358-a9b7-4bb6e1cb1fa4 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:43.880424 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9675ab-6b13-4358-a9b7-4bb6e1cb1fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:43.880699 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9675ab-6b13-4358-a9b7-4bb6e1cb1fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:43.900619 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-5d9675ab-6b13-4358-a9b7-4bb6e1cb1fa4 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:36:43.901905 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-5d9675ab-6b13-4358-a9b7-4bb6e1cb1fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:43.972628 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1422/2840] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:36:43.982536 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d45eb0-0d3e-4dc9-892f-8fd8f4954aa6 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:43.985399 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-f7d45eb0-0d3e-4dc9-892f-8fd8f4954aa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:44.049167 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d45eb0-0d3e-4dc9-892f-8fd8f4954aa6 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:44.053062 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4a5a3-5b7e-4190-8d08-69739cec456f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:44.053697 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4a5a3-5b7e-4190-8d08-69739cec456f service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:44.053978 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4a5a3-5b7e-4190-8d08-69739cec456f service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:44.054250 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4a5a3-5b7e-4190-8d08-69739cec456f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:44.064473 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4a5a3-5b7e-4190-8d08-69739cec456f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:44.065954 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4a5a3-5b7e-4190-8d08-69739cec456f service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:44.076294 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1419/2841] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:36:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:36:44.441489 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9675ab-6b13-4358-a9b7-4bb6e1cb1fa4 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:44.443099 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-5d9675ab-6b13-4358-a9b7-4bb6e1cb1fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:44.456650 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9675ab-6b13-4358-a9b7-4bb6e1cb1fa4 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:44.468365 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137a6b7-0b5e-4ed1-91d1-bdaa1f5f1689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:44.469099 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137a6b7-0b5e-4ed1-91d1-bdaa1f5f1689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:44.469395 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137a6b7-0b5e-4ed1-91d1-bdaa1f5f1689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:44.472068 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137a6b7-0b5e-4ed1-91d1-bdaa1f5f1689 admin admin] PATH_INFO: `/v3/projects/563c97359c904e19879c90d8ef019502` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:44.473406 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137a6b7-0b5e-4ed1-91d1-bdaa1f5f1689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=563c97359c904e19879c90d8ef019502)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:44.476730 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137a6b7-0b5e-4ed1-91d1-bdaa1f5f1689 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:44.539931 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:44.548042 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-b137a6b7-0b5e-4ed1-91d1-bdaa1f5f1689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '563c97359c904e19879c90d8ef019502', 'request_id': 'req-b137a6b7-0b5e-4ed1-91d1-bdaa1f5f1689'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:44.556196 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-b137a6b7-0b5e-4ed1-91d1-bdaa1f5f1689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '563c97359c904e19879c90d8ef019502', 'request_id': 'req-b137a6b7-0b5e-4ed1-91d1-bdaa1f5f1689'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:44.565761 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-b137a6b7-0b5e-4ed1-91d1-bdaa1f5f1689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '563c97359c904e19879c90d8ef019502', 'request_id': 'req-b137a6b7-0b5e-4ed1-91d1-bdaa1f5f1689'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:44.580856 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-b137a6b7-0b5e-4ed1-91d1-bdaa1f5f1689 admin admin] The token cache is being invalidate because project 563c97359c904e19879c90d8ef019502 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:36:44.581359 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-b137a6b7-0b5e-4ed1-91d1-bdaa1f5f1689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:44.582173 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-b137a6b7-0b5e-4ed1-91d1-bdaa1f5f1689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:44.587525 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1423/2842] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:36:44 2022] DELETE /identity/v3/projects/563c97359c904e19879c90d8ef019502 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:36:44.594335 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb9e33-4938-4e2f-aa25-d187ceb72c56 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:44.595250 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb9e33-4938-4e2f-aa25-d187ceb72c56 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:44.595538 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb9e33-4938-4e2f-aa25-d187ceb72c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:44.625973 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-b9fb9e33-4938-4e2f-aa25-d187ceb72c56 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:36:44.627432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-b9fb9e33-4938-4e2f-aa25-d187ceb72c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:44.674406 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:44.715449 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1420/2843] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:36:44.781819 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c597b-9f1f-4cf5-95b1-77796b17d48b None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:44.782664 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c597b-9f1f-4cf5-95b1-77796b17d48b None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:44.783123 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c597b-9f1f-4cf5-95b1-77796b17d48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:44.804249 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-fe4c597b-9f1f-4cf5-95b1-77796b17d48b None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:36:44.805515 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-fe4c597b-9f1f-4cf5-95b1-77796b17d48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:44.818025 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1424/2844] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:36:44.819177 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb9e33-4938-4e2f-aa25-d187ceb72c56 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:44.832838 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb9e33-4938-4e2f-aa25-d187ceb72c56 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:44.848305 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e595950-fac7-4211-98a5-7a9b1489dd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:44.849201 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e595950-fac7-4211-98a5-7a9b1489dd56 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:44.849522 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e595950-fac7-4211-98a5-7a9b1489dd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:44.850562 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e595950-fac7-4211-98a5-7a9b1489dd56 admin admin] PATH_INFO: `/v3/domains` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:44.851277 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e595950-fac7-4211-98a5-7a9b1489dd56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:36:44.851947 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e595950-fac7-4211-98a5-7a9b1489dd56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:44.854282 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e595950-fac7-4211-98a5-7a9b1489dd56 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:44.877036 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1421/2845] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:36:44.882266 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c597b-9f1f-4cf5-95b1-77796b17d48b None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:44.899720 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c597b-9f1f-4cf5-95b1-77796b17d48b None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:44.915486 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d987da0-9fb4-42df-90ca-69dc1f0cc997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:44.916261 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d987da0-9fb4-42df-90ca-69dc1f0cc997 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:44.916699 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d987da0-9fb4-42df-90ca-69dc1f0cc997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:44.917299 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d987da0-9fb4-42df-90ca-69dc1f0cc997 admin admin] PATH_INFO: `/v3/projects` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:44.918909 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d987da0-9fb4-42df-90ca-69dc1f0cc997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:44.921473 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d987da0-9fb4-42df-90ca-69dc1f0cc997 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:44.973578 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1425/2846] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:36:44 2022] POST /identity/v3/projects => generated 375 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:36:44.977111 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e595950-fac7-4211-98a5-7a9b1489dd56 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:45.007964 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e595950-fac7-4211-98a5-7a9b1489dd56 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:45.124841 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e0bd9-4fe7-4cb0-ac1a-75b35b49143a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:45.125482 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e0bd9-4fe7-4cb0-ac1a-75b35b49143a admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:45.125750 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e0bd9-4fe7-4cb0-ac1a-75b35b49143a admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:45.126019 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e0bd9-4fe7-4cb0-ac1a-75b35b49143a admin admin] PATH_INFO: `/v3/users` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:45.126714 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45e0bd9-4fe7-4cb0-ac1a-75b35b49143a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:45.128711 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45e0bd9-4fe7-4cb0-ac1a-75b35b49143a admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:45.157439 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1422/2847] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:36:44 2022] POST /identity/v3/users => generated 288 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:36:45.160314 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d987da0-9fb4-42df-90ca-69dc1f0cc997 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:45.177984 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d987da0-9fb4-42df-90ca-69dc1f0cc997 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:45.185031 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c5b84-5693-4153-8015-94f33f0e5bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:45.185775 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c5b84-5693-4153-8015-94f33f0e5bda admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:45.187372 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c5b84-5693-4153-8015-94f33f0e5bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:45.187372 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c5b84-5693-4153-8015-94f33f0e5bda admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:45.187972 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c5b84-5693-4153-8015-94f33f0e5bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:45.189772 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c5b84-5693-4153-8015-94f33f0e5bda admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:45.204557 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1426/2848] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:36:45.205817 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e0bd9-4fe7-4cb0-ac1a-75b35b49143a admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:45.222220 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e0bd9-4fe7-4cb0-ac1a-75b35b49143a admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:45.228207 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d68de-f548-4fdb-a780-479b3d480533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:45.228783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d68de-f548-4fdb-a780-479b3d480533 admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:45.229074 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d68de-f548-4fdb-a780-479b3d480533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:45.229350 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d68de-f548-4fdb-a780-479b3d480533 admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:45.230054 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d68de-f548-4fdb-a780-479b3d480533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:45.231680 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d68de-f548-4fdb-a780-479b3d480533 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:45.245805 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1423/2849] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:36:45.250736 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c5b84-5693-4153-8015-94f33f0e5bda admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:45.263583 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c5b84-5693-4153-8015-94f33f0e5bda admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:45.270423 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db383c3-7ec3-4d72-a074-1cbadc02299f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:45.271115 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db383c3-7ec3-4d72-a074-1cbadc02299f admin admin] REQUEST_METHOD: `PUT` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:45.271402 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db383c3-7ec3-4d72-a074-1cbadc02299f admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:45.271888 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db383c3-7ec3-4d72-a074-1cbadc02299f admin admin] PATH_INFO: `/v3/projects/c95ccb2495924d63bce7c70f7acd6f61/users/f3a681a3c35b486ca2ac95656ee08696/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:45.289954 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db383c3-7ec3-4d72-a074-1cbadc02299f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c95ccb2495924d63bce7c70f7acd6f61, user_id=f3a681a3c35b486ca2ac95656ee08696, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:45.292696 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db383c3-7ec3-4d72-a074-1cbadc02299f admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:45.312331 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1427/2850] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:36:45 2022] PUT /identity/v3/projects/c95ccb2495924d63bce7c70f7acd6f61/users/f3a681a3c35b486ca2ac95656ee08696/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:36:45.323092 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab63177-5e53-42c6-917e-977c0de443b8 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:45.323364 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab63177-5e53-42c6-917e-977c0de443b8 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:45.323729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab63177-5e53-42c6-917e-977c0de443b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:45.370191 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-8ab63177-5e53-42c6-917e-977c0de443b8 None None] MFA Rules not processed for user `f3a681a3c35b486ca2ac95656ee08696`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:36:45.371473 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-8ab63177-5e53-42c6-917e-977c0de443b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:45.458022 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1424/2851] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:36:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:36:45.471996 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db383c3-7ec3-4d72-a074-1cbadc02299f admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:45.474206 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-4db383c3-7ec3-4d72-a074-1cbadc02299f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:45.538037 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db383c3-7ec3-4d72-a074-1cbadc02299f admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:45.541741 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1fc3c2-a303-4a01-85d4-bb7dec173913 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:45.542356 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fc3c2-a303-4a01-85d4-bb7dec173913 service cinder] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:45.542633 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fc3c2-a303-4a01-85d4-bb7dec173913 service cinder] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:45.542902 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fc3c2-a303-4a01-85d4-bb7dec173913 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:45.552289 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1fc3c2-a303-4a01-85d4-bb7dec173913 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:45.553764 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1fc3c2-a303-4a01-85d4-bb7dec173913 service cinder] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:45.563868 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1428/2852] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:36:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:36:46.622149 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab63177-5e53-42c6-917e-977c0de443b8 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:46.624785 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-8ab63177-5e53-42c6-917e-977c0de443b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:46.677860 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:46.713759 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab63177-5e53-42c6-917e-977c0de443b8 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:46.718778 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4071f-0b2c-4811-a42c-0a6ba52c6cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:46.719423 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4071f-0b2c-4811-a42c-0a6ba52c6cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:46.719702 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4071f-0b2c-4811-a42c-0a6ba52c6cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:46.719974 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4071f-0b2c-4811-a42c-0a6ba52c6cac admin admin] PATH_INFO: `/v3/users/c4aa03196af3474284bfaa19bef8e95b` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:46.721153 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb4071f-0b2c-4811-a42c-0a6ba52c6cac admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4aa03196af3474284bfaa19bef8e95b)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:46.723119 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb4071f-0b2c-4811-a42c-0a6ba52c6cac admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:46.780646 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-7cb4071f-0b2c-4811-a42c-0a6ba52c6cac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4aa03196af3474284bfaa19bef8e95b'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:46.781633 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-7cb4071f-0b2c-4811-a42c-0a6ba52c6cac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4aa03196af3474284bfaa19bef8e95b'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:46.790548 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-7cb4071f-0b2c-4811-a42c-0a6ba52c6cac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4aa03196af3474284bfaa19bef8e95b'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:46.799672 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-7cb4071f-0b2c-4811-a42c-0a6ba52c6cac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4aa03196af3474284bfaa19bef8e95b'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:46.800255 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-7cb4071f-0b2c-4811-a42c-0a6ba52c6cac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4aa03196af3474284bfaa19bef8e95b'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:46.818974 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1425/2853] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:36:46 2022] DELETE /identity/v3/users/c4aa03196af3474284bfaa19bef8e95b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:36:47.003520 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6eede-7405-42c1-9fe3-5742f9b0f67e None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:47.004064 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6eede-7405-42c1-9fe3-5742f9b0f67e None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:47.004064 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6eede-7405-42c1-9fe3-5742f9b0f67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:47.013704 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4071f-0b2c-4811-a42c-0a6ba52c6cac admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:47.015826 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-7cb4071f-0b2c-4811-a42c-0a6ba52c6cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:47.040824 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-4df6eede-7405-42c1-9fe3-5742f9b0f67e None None] MFA Rules not processed for user `f3a681a3c35b486ca2ac95656ee08696`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:36:47.042116 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-4df6eede-7405-42c1-9fe3-5742f9b0f67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:47.089899 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4071f-0b2c-4811-a42c-0a6ba52c6cac admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:47.095004 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91dae0d-34f6-4b38-8dcf-f87e5309a1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:47.095648 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dae0d-34f6-4b38-8dcf-f87e5309a1b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:47.096113 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dae0d-34f6-4b38-8dcf-f87e5309a1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:47.096398 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dae0d-34f6-4b38-8dcf-f87e5309a1b5 admin admin] PATH_INFO: `/v3/projects/26170ca9f4a34b6387b776d66c9525d7` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:47.097806 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91dae0d-34f6-4b38-8dcf-f87e5309a1b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26170ca9f4a34b6387b776d66c9525d7)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:47.099730 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91dae0d-34f6-4b38-8dcf-f87e5309a1b5 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:47.102909 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1429/2854] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:36:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:36:47.151736 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-e91dae0d-34f6-4b38-8dcf-f87e5309a1b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26170ca9f4a34b6387b776d66c9525d7', 'request_id': 'req-e91dae0d-34f6-4b38-8dcf-f87e5309a1b5'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:47.153616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:47.165017 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-e91dae0d-34f6-4b38-8dcf-f87e5309a1b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26170ca9f4a34b6387b776d66c9525d7', 'request_id': 'req-e91dae0d-34f6-4b38-8dcf-f87e5309a1b5'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:47.174718 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-e91dae0d-34f6-4b38-8dcf-f87e5309a1b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26170ca9f4a34b6387b776d66c9525d7', 'request_id': 'req-e91dae0d-34f6-4b38-8dcf-f87e5309a1b5'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:47.186438 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-e91dae0d-34f6-4b38-8dcf-f87e5309a1b5 admin admin] The token cache is being invalidate because project 26170ca9f4a34b6387b776d66c9525d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:36:47.186766 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-e91dae0d-34f6-4b38-8dcf-f87e5309a1b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:47.187435 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-e91dae0d-34f6-4b38-8dcf-f87e5309a1b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:47.189141 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1426/2855] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:36:47 2022] DELETE /identity/v3/projects/26170ca9f4a34b6387b776d66c9525d7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:36:47.193618 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6eede-7405-42c1-9fe3-5742f9b0f67e None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:47.205357 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6eede-7405-42c1-9fe3-5742f9b0f67e None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:47.215869 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:47.271725 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f671334-d22c-45fa-9c35-a79276bdecf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:47.272371 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f671334-d22c-45fa-9c35-a79276bdecf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:47.272641 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f671334-d22c-45fa-9c35-a79276bdecf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:47.272916 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f671334-d22c-45fa-9c35-a79276bdecf3 admin admin] PATH_INFO: `/v3/users/57837f42a696417a9acbaba990a2830f` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:47.274141 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f671334-d22c-45fa-9c35-a79276bdecf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57837f42a696417a9acbaba990a2830f)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:47.275993 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f671334-d22c-45fa-9c35-a79276bdecf3 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:47.340523 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-6f671334-d22c-45fa-9c35-a79276bdecf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57837f42a696417a9acbaba990a2830f'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:47.341257 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-6f671334-d22c-45fa-9c35-a79276bdecf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57837f42a696417a9acbaba990a2830f'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:47.351534 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-6f671334-d22c-45fa-9c35-a79276bdecf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57837f42a696417a9acbaba990a2830f'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:47.360117 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-6f671334-d22c-45fa-9c35-a79276bdecf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57837f42a696417a9acbaba990a2830f'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:47.372469 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-6f671334-d22c-45fa-9c35-a79276bdecf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57837f42a696417a9acbaba990a2830f'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:47.379590 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1430/2856] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:36:47 2022] DELETE /identity/v3/users/57837f42a696417a9acbaba990a2830f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:36:47.641235 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91dae0d-34f6-4b38-8dcf-f87e5309a1b5 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:47.643045 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-e91dae0d-34f6-4b38-8dcf-f87e5309a1b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:47.662986 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91dae0d-34f6-4b38-8dcf-f87e5309a1b5 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:47.741977 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac343de-5a3c-44bf-ae75-5b4e38a139c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:47.742655 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac343de-5a3c-44bf-ae75-5b4e38a139c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:47.743052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac343de-5a3c-44bf-ae75-5b4e38a139c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:47.743341 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac343de-5a3c-44bf-ae75-5b4e38a139c9 admin admin] PATH_INFO: `/v3/projects/05f33a2ef5fe4a4ea2311daab111cc1c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:47.746250 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac343de-5a3c-44bf-ae75-5b4e38a139c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05f33a2ef5fe4a4ea2311daab111cc1c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:47.749253 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac343de-5a3c-44bf-ae75-5b4e38a139c9 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:47.803239 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-fac343de-5a3c-44bf-ae75-5b4e38a139c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05f33a2ef5fe4a4ea2311daab111cc1c', 'request_id': 'req-fac343de-5a3c-44bf-ae75-5b4e38a139c9'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:47.809609 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-fac343de-5a3c-44bf-ae75-5b4e38a139c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05f33a2ef5fe4a4ea2311daab111cc1c', 'request_id': 'req-fac343de-5a3c-44bf-ae75-5b4e38a139c9'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:47.819459 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-fac343de-5a3c-44bf-ae75-5b4e38a139c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05f33a2ef5fe4a4ea2311daab111cc1c', 'request_id': 'req-fac343de-5a3c-44bf-ae75-5b4e38a139c9'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:47.833496 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-fac343de-5a3c-44bf-ae75-5b4e38a139c9 admin admin] The token cache is being invalidate because project 05f33a2ef5fe4a4ea2311daab111cc1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:36:47.833792 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-fac343de-5a3c-44bf-ae75-5b4e38a139c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:47.834512 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-fac343de-5a3c-44bf-ae75-5b4e38a139c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:47.836028 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1427/2857] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:36:47 2022] DELETE /identity/v3/projects/05f33a2ef5fe4a4ea2311daab111cc1c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:36:52.218466 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f671334-d22c-45fa-9c35-a79276bdecf3 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:52.219935 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-6f671334-d22c-45fa-9c35-a79276bdecf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:52.232818 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f671334-d22c-45fa-9c35-a79276bdecf3 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:52.290895 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d23c31-892c-4d92-9db0-8a13794bdc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:52.291452 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d23c31-892c-4d92-9db0-8a13794bdc65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:52.291735 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d23c31-892c-4d92-9db0-8a13794bdc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:52.292008 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d23c31-892c-4d92-9db0-8a13794bdc65 admin admin] PATH_INFO: `/v3/users/e7db34617ca541e8bae5278b906b0e4f` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:52.293146 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d23c31-892c-4d92-9db0-8a13794bdc65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7db34617ca541e8bae5278b906b0e4f)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:52.295871 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d23c31-892c-4d92-9db0-8a13794bdc65 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:52.337070 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:52.349531 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-87d23c31-892c-4d92-9db0-8a13794bdc65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7db34617ca541e8bae5278b906b0e4f'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:52.351874 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-87d23c31-892c-4d92-9db0-8a13794bdc65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7db34617ca541e8bae5278b906b0e4f'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:52.361057 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-87d23c31-892c-4d92-9db0-8a13794bdc65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7db34617ca541e8bae5278b906b0e4f'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:52.371102 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-87d23c31-892c-4d92-9db0-8a13794bdc65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7db34617ca541e8bae5278b906b0e4f'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:52.394112 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-87d23c31-892c-4d92-9db0-8a13794bdc65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7db34617ca541e8bae5278b906b0e4f'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:52.400952 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1431/2858] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:36:52 2022] DELETE /identity/v3/users/e7db34617ca541e8bae5278b906b0e4f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:36:52.405798 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebb3bf-d391-4e36-899e-ddfcc02d230d None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:52.406314 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebb3bf-d391-4e36-899e-ddfcc02d230d None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:52.406442 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebb3bf-d391-4e36-899e-ddfcc02d230d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:52.427214 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-56ebb3bf-d391-4e36-899e-ddfcc02d230d None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:36:52.428433 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-56ebb3bf-d391-4e36-899e-ddfcc02d230d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:52.495006 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1428/2859] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:36:52.506020 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d23c31-892c-4d92-9db0-8a13794bdc65 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:52.507542 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-87d23c31-892c-4d92-9db0-8a13794bdc65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:52.574830 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d23c31-892c-4d92-9db0-8a13794bdc65 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:52.579306 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dcd997-92fe-4e56-9492-1133fcba7de2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:52.579913 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcd997-92fe-4e56-9492-1133fcba7de2 service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:52.580220 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcd997-92fe-4e56-9492-1133fcba7de2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:52.580490 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcd997-92fe-4e56-9492-1133fcba7de2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:52.590021 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dcd997-92fe-4e56-9492-1133fcba7de2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:52.591458 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dcd997-92fe-4e56-9492-1133fcba7de2 service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:52.602098 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1432/2860] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:36:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:36:52.886599 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebb3bf-d391-4e36-899e-ddfcc02d230d None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:52.887895 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-56ebb3bf-d391-4e36-899e-ddfcc02d230d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:52.902371 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebb3bf-d391-4e36-899e-ddfcc02d230d None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:52.909000 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49444de-dfe4-4629-9d44-a65d8a4b8892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:52.909882 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49444de-dfe4-4629-9d44-a65d8a4b8892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:52.910168 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49444de-dfe4-4629-9d44-a65d8a4b8892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:52.910443 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49444de-dfe4-4629-9d44-a65d8a4b8892 admin admin] PATH_INFO: `/v3/projects/e764ce729f2c4b41816c1ba6020f01b1` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:52.911868 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49444de-dfe4-4629-9d44-a65d8a4b8892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e764ce729f2c4b41816c1ba6020f01b1)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:52.913886 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49444de-dfe4-4629-9d44-a65d8a4b8892 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:52.922498 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:52.968026 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-e49444de-dfe4-4629-9d44-a65d8a4b8892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e764ce729f2c4b41816c1ba6020f01b1', 'request_id': 'req-e49444de-dfe4-4629-9d44-a65d8a4b8892'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:52.976105 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-e49444de-dfe4-4629-9d44-a65d8a4b8892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e764ce729f2c4b41816c1ba6020f01b1', 'request_id': 'req-e49444de-dfe4-4629-9d44-a65d8a4b8892'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:52.985262 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-e49444de-dfe4-4629-9d44-a65d8a4b8892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e764ce729f2c4b41816c1ba6020f01b1', 'request_id': 'req-e49444de-dfe4-4629-9d44-a65d8a4b8892'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:52.996958 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-e49444de-dfe4-4629-9d44-a65d8a4b8892 admin admin] The token cache is being invalidate because project e764ce729f2c4b41816c1ba6020f01b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:36:52.997281 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-e49444de-dfe4-4629-9d44-a65d8a4b8892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:52.997949 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-e49444de-dfe4-4629-9d44-a65d8a4b8892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:36:52.999544 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1429/2861] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:36:52 2022] DELETE /identity/v3/projects/e764ce729f2c4b41816c1ba6020f01b1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:37:01.034713 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7123c-0e0d-4abe-a47d-89822a377dc9 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:01.035214 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7123c-0e0d-4abe-a47d-89822a377dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:01.035338 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7123c-0e0d-4abe-a47d-89822a377dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:01.054522 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-2bb7123c-0e0d-4abe-a47d-89822a377dc9 None None] MFA Rules not processed for user `02e415eb75984daa97ee79fc0146f318`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:37:01.055735 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-2bb7123c-0e0d-4abe-a47d-89822a377dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:37:01.114457 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1433/2862] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Aug 23 22:37:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:37:01.128907 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49444de-dfe4-4629-9d44-a65d8a4b8892 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:37:01.130484 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-e49444de-dfe4-4629-9d44-a65d8a4b8892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:37:01.201582 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49444de-dfe4-4629-9d44-a65d8a4b8892 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:37:01.207578 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985810e-f439-429a-9ade-fc408ba0a3dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abda1f23a18c4c808483cd6b53952975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:37:01.208199 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985810e-f439-429a-9ade-fc408ba0a3dc service swift] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:01.208484 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985810e-f439-429a-9ade-fc408ba0a3dc service swift] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:01.208762 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985810e-f439-429a-9ade-fc408ba0a3dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:01.217180 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985810e-f439-429a-9ade-fc408ba0a3dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:37:01.218896 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985810e-f439-429a-9ade-fc408ba0a3dc service swift] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:37:01.227108 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1430/2863] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Aug 23 22:37:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 22:37:01.748541 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c68543-83ca-4d40-9b58-61dd58728493 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:01.748851 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c68543-83ca-4d40-9b58-61dd58728493 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:01.749795 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c68543-83ca-4d40-9b58-61dd58728493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:01.769501 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-85c68543-83ca-4d40-9b58-61dd58728493 None None] MFA Rules not processed for user `02e415eb75984daa97ee79fc0146f318`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:37:01.770645 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-85c68543-83ca-4d40-9b58-61dd58728493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:37:01.778058 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1434/2864] 10.222.0.77 () {58 vars in 967 bytes} [Tue Aug 23 22:37:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:37:01.790760 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985810e-f439-429a-9ade-fc408ba0a3dc service swift] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:37:01.801840 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985810e-f439-429a-9ade-fc408ba0a3dc service swift] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:37:01.806845 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c60191-aac4-4a59-a3e4-b8f01f77a3df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abda1f23a18c4c808483cd6b53952975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:37:01.807441 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c60191-aac4-4a59-a3e4-b8f01f77a3df service swift] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:01.807716 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c60191-aac4-4a59-a3e4-b8f01f77a3df service swift] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:01.807985 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c60191-aac4-4a59-a3e4-b8f01f77a3df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:01.816751 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c60191-aac4-4a59-a3e4-b8f01f77a3df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:37:01.818387 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c60191-aac4-4a59-a3e4-b8f01f77a3df service swift] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:37:01.826372 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1431/2865] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Aug 23 22:37:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 22:37:02.044737 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1d5f1-467a-4846-8b14-771d9566715b None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:02.045316 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1d5f1-467a-4846-8b14-771d9566715b None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:02.045316 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1d5f1-467a-4846-8b14-771d9566715b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:02.064862 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-1bc1d5f1-467a-4846-8b14-771d9566715b None None] MFA Rules not processed for user `02e415eb75984daa97ee79fc0146f318`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:37:02.066102 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-1bc1d5f1-467a-4846-8b14-771d9566715b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:37:02.073347 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1435/2866] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Aug 23 22:37:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:37:02.085563 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c60191-aac4-4a59-a3e4-b8f01f77a3df service swift] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:37:02.097488 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c60191-aac4-4a59-a3e4-b8f01f77a3df service swift] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:37:02.102642 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f78c5c-aab4-4d7e-8fa6-a45ec1b57770 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abda1f23a18c4c808483cd6b53952975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:37:02.103244 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f78c5c-aab4-4d7e-8fa6-a45ec1b57770 service swift] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:02.103553 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f78c5c-aab4-4d7e-8fa6-a45ec1b57770 service swift] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:02.103916 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f78c5c-aab4-4d7e-8fa6-a45ec1b57770 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:02.113308 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f78c5c-aab4-4d7e-8fa6-a45ec1b57770 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:37:02.115001 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f78c5c-aab4-4d7e-8fa6-a45ec1b57770 service swift] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:37:02.123273 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1432/2867] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Aug 23 22:37:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 22:37:02.453351 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb69e1-7b9f-4066-b227-d18a8c0348bf None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:02.453644 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb69e1-7b9f-4066-b227-d18a8c0348bf None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:02.453918 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb69e1-7b9f-4066-b227-d18a8c0348bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:02.474308 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-f6cb69e1-7b9f-4066-b227-d18a8c0348bf None None] MFA Rules not processed for user `02e415eb75984daa97ee79fc0146f318`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:37:02.475086 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-f6cb69e1-7b9f-4066-b227-d18a8c0348bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:37:02.484635 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1436/2868] 10.222.0.77 () {58 vars in 967 bytes} [Tue Aug 23 22:37:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:37:02.496911 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f78c5c-aab4-4d7e-8fa6-a45ec1b57770 service swift] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:37:02.508143 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f78c5c-aab4-4d7e-8fa6-a45ec1b57770 service swift] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:37:02.513266 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2a09c-bd96-4687-93cd-828c3e87dae1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abda1f23a18c4c808483cd6b53952975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:37:02.513889 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2a09c-bd96-4687-93cd-828c3e87dae1 service swift] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:02.514170 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2a09c-bd96-4687-93cd-828c3e87dae1 service swift] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:02.514441 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2a09c-bd96-4687-93cd-828c3e87dae1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:02.522634 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2a09c-bd96-4687-93cd-828c3e87dae1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:37:02.524203 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2a09c-bd96-4687-93cd-828c3e87dae1 service swift] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:37:02.532357 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1433/2869] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Aug 23 22:37:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 22:37:04.768653 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb69e1-7b9f-4066-b227-d18a8c0348bf None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:37:04.770264 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-f6cb69e1-7b9f-4066-b227-d18a8c0348bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:37:04.816017 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:37:04.840684 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb69e1-7b9f-4066-b227-d18a8c0348bf None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:37:04.846016 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67bb5d-7052-4016-b143-8c8270408763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:37:04.846646 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67bb5d-7052-4016-b143-8c8270408763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:04.846934 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67bb5d-7052-4016-b143-8c8270408763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:04.847211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67bb5d-7052-4016-b143-8c8270408763 admin admin] PATH_INFO: `/v3/users/f3a681a3c35b486ca2ac95656ee08696` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:04.848378 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67bb5d-7052-4016-b143-8c8270408763 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3a681a3c35b486ca2ac95656ee08696)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:37:04.850346 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67bb5d-7052-4016-b143-8c8270408763 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:37:04.899180 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2e67bb5d-7052-4016-b143-8c8270408763 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3a681a3c35b486ca2ac95656ee08696'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:37:04.899838 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2e67bb5d-7052-4016-b143-8c8270408763 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3a681a3c35b486ca2ac95656ee08696'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:37:04.908142 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2e67bb5d-7052-4016-b143-8c8270408763 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3a681a3c35b486ca2ac95656ee08696'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:37:04.915815 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2e67bb5d-7052-4016-b143-8c8270408763 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3a681a3c35b486ca2ac95656ee08696'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:37:04.928250 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-2e67bb5d-7052-4016-b143-8c8270408763 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3a681a3c35b486ca2ac95656ee08696'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:37:04.934310 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1437/2870] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:37:04 2022] DELETE /identity/v3/users/f3a681a3c35b486ca2ac95656ee08696 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:37:04.940017 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03a19c-35f9-4225-aaba-143f6c12953f None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:04.940531 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03a19c-35f9-4225-aaba-143f6c12953f None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:04.940644 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03a19c-35f9-4225-aaba-143f6c12953f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:04.960481 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-de03a19c-35f9-4225-aaba-143f6c12953f None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:37:04.961745 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-de03a19c-35f9-4225-aaba-143f6c12953f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:37:05.003081 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:37:05.025004 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1434/2871] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:37:05.035165 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67bb5d-7052-4016-b143-8c8270408763 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:37:05.036833 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-2e67bb5d-7052-4016-b143-8c8270408763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:37:05.100535 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67bb5d-7052-4016-b143-8c8270408763 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:37:05.104252 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8602ad-35fa-4ea2-afdc-a00d7d9f48d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:37:05.104860 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8602ad-35fa-4ea2-afdc-a00d7d9f48d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:05.105138 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8602ad-35fa-4ea2-afdc-a00d7d9f48d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:05.105442 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8602ad-35fa-4ea2-afdc-a00d7d9f48d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:05.115369 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8602ad-35fa-4ea2-afdc-a00d7d9f48d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:37:05.116801 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8602ad-35fa-4ea2-afdc-a00d7d9f48d4 service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:37:05.127341 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1438/2872] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:37:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:37:05.307062 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03a19c-35f9-4225-aaba-143f6c12953f None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:37:05.308822 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-de03a19c-35f9-4225-aaba-143f6c12953f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:37:05.321732 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03a19c-35f9-4225-aaba-143f6c12953f None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:37:05.326507 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0cf41a-5b25-4df8-8d12-b68d9ee659fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:37:05.327247 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0cf41a-5b25-4df8-8d12-b68d9ee659fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:05.328472 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0cf41a-5b25-4df8-8d12-b68d9ee659fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:05.328775 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0cf41a-5b25-4df8-8d12-b68d9ee659fb admin admin] PATH_INFO: `/v3/projects/c95ccb2495924d63bce7c70f7acd6f61` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:05.329996 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0cf41a-5b25-4df8-8d12-b68d9ee659fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c95ccb2495924d63bce7c70f7acd6f61)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:37:05.332070 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0cf41a-5b25-4df8-8d12-b68d9ee659fb admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:37:05.384019 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-2e0cf41a-5b25-4df8-8d12-b68d9ee659fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c95ccb2495924d63bce7c70f7acd6f61', 'request_id': 'req-2e0cf41a-5b25-4df8-8d12-b68d9ee659fb'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:37:05.391044 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-2e0cf41a-5b25-4df8-8d12-b68d9ee659fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c95ccb2495924d63bce7c70f7acd6f61', 'request_id': 'req-2e0cf41a-5b25-4df8-8d12-b68d9ee659fb'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:37:05.399290 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-2e0cf41a-5b25-4df8-8d12-b68d9ee659fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c95ccb2495924d63bce7c70f7acd6f61', 'request_id': 'req-2e0cf41a-5b25-4df8-8d12-b68d9ee659fb'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:37:05.410955 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-2e0cf41a-5b25-4df8-8d12-b68d9ee659fb admin admin] The token cache is being invalidate because project c95ccb2495924d63bce7c70f7acd6f61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:37:05.411243 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-2e0cf41a-5b25-4df8-8d12-b68d9ee659fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:37:05.411886 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-2e0cf41a-5b25-4df8-8d12-b68d9ee659fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:37:05.413394 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1435/2873] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:37:05 2022] DELETE /identity/v3/projects/c95ccb2495924d63bce7c70f7acd6f61 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:37:05.418517 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e851e35-a86a-4230-a798-a2a416b8036d None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:05.418802 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e851e35-a86a-4230-a798-a2a416b8036d None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:05.419069 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e851e35-a86a-4230-a798-a2a416b8036d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:05.438133 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-5e851e35-a86a-4230-a798-a2a416b8036d None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:37:05.439333 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-5e851e35-a86a-4230-a798-a2a416b8036d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:37:05.500903 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1439/2874] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:37:05.508552 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125d252-7e08-41f3-aa77-c2bed92cf6a1 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:05.508842 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125d252-7e08-41f3-aa77-c2bed92cf6a1 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:05.509124 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125d252-7e08-41f3-aa77-c2bed92cf6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:05.529296 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-d125d252-7e08-41f3-aa77-c2bed92cf6a1 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:37:05.530528 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-d125d252-7e08-41f3-aa77-c2bed92cf6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:37:05.539647 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1436/2875] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:37:05.543981 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e851e35-a86a-4230-a798-a2a416b8036d None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:37:05.549326 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:37:05.556481 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e851e35-a86a-4230-a798-a2a416b8036d None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:37:05.563087 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c710d2-2efe-4d3e-89ba-7d9898e47c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:37:05.563759 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c710d2-2efe-4d3e-89ba-7d9898e47c11 admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:05.564164 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c710d2-2efe-4d3e-89ba-7d9898e47c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:05.564466 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c710d2-2efe-4d3e-89ba-7d9898e47c11 admin admin] PATH_INFO: `/v3/domains` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:05.565143 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c710d2-2efe-4d3e-89ba-7d9898e47c11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:37:05.565492 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c710d2-2efe-4d3e-89ba-7d9898e47c11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:37:05.567156 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c710d2-2efe-4d3e-89ba-7d9898e47c11 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:37:05.580185 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1440/2876] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Aug 23 22:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:37:05.584577 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125d252-7e08-41f3-aa77-c2bed92cf6a1 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:37:05.595229 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125d252-7e08-41f3-aa77-c2bed92cf6a1 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:37:05.600137 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3097f7c-24a2-4822-8fad-9916243258e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:37:05.600739 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3097f7c-24a2-4822-8fad-9916243258e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:05.601023 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3097f7c-24a2-4822-8fad-9916243258e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:05.601298 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3097f7c-24a2-4822-8fad-9916243258e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:05.601970 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3097f7c-24a2-4822-8fad-9916243258e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:37:05.603881 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3097f7c-24a2-4822-8fad-9916243258e2 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:37:05.632177 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1437/2877] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Aug 23 22:37:05 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:37:05.636876 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c710d2-2efe-4d3e-89ba-7d9898e47c11 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:37:05.648983 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c710d2-2efe-4d3e-89ba-7d9898e47c11 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:37:05.707531 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700ee30-eda3-49a5-8da6-45a7c4325c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:37:05.708277 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700ee30-eda3-49a5-8da6-45a7c4325c07 admin admin] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:05.708558 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700ee30-eda3-49a5-8da6-45a7c4325c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:05.708856 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700ee30-eda3-49a5-8da6-45a7c4325c07 admin admin] PATH_INFO: `/v3/users` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:05.709756 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700ee30-eda3-49a5-8da6-45a7c4325c07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:37:05.711821 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700ee30-eda3-49a5-8da6-45a7c4325c07 admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:37:05.736853 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1441/2878] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Aug 23 22:37:05 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:37:05.738161 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3097f7c-24a2-4822-8fad-9916243258e2 admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:37:05.749995 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3097f7c-24a2-4822-8fad-9916243258e2 admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:37:05.755405 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0801b62-e4aa-406d-9c18-6b06e69a8ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:37:05.756019 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0801b62-e4aa-406d-9c18-6b06e69a8ecc admin admin] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:05.756304 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0801b62-e4aa-406d-9c18-6b06e69a8ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:05.756581 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0801b62-e4aa-406d-9c18-6b06e69a8ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:05.757239 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0801b62-e4aa-406d-9c18-6b06e69a8ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:37:05.758897 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0801b62-e4aa-406d-9c18-6b06e69a8ecc admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:37:05.770983 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1438/2879] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:37:05.775087 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700ee30-eda3-49a5-8da6-45a7c4325c07 admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:37:05.786284 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700ee30-eda3-49a5-8da6-45a7c4325c07 admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:37:05.790985 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497910d-c435-4258-b94a-eb559abb1d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:37:05.791600 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497910d-c435-4258-b94a-eb559abb1d0f admin admin] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:05.791877 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497910d-c435-4258-b94a-eb559abb1d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:05.792142 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497910d-c435-4258-b94a-eb559abb1d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:05.793082 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497910d-c435-4258-b94a-eb559abb1d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:37:05.794896 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497910d-c435-4258-b94a-eb559abb1d0f admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:37:05.806494 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1442/2880] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Aug 23 22:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:37:05.811368 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0801b62-e4aa-406d-9c18-6b06e69a8ecc admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:37:05.822656 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0801b62-e4aa-406d-9c18-6b06e69a8ecc admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:37:05.827328 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f419aa8-25e1-4a1b-97c8-4295ccd698ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:37:05.828602 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f419aa8-25e1-4a1b-97c8-4295ccd698ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:05.829120 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f419aa8-25e1-4a1b-97c8-4295ccd698ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:05.829420 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f419aa8-25e1-4a1b-97c8-4295ccd698ca admin admin] PATH_INFO: `/v3/projects/799f43147c944e4b91b8f4f0ba2cb894/users/4a09fe9266e949b7b4bec49cb87562a4/roles/eabf42a0387a47218c5ce577dd65f61c` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:05.845026 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f419aa8-25e1-4a1b-97c8-4295ccd698ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=799f43147c944e4b91b8f4f0ba2cb894, user_id=4a09fe9266e949b7b4bec49cb87562a4, role_id=eabf42a0387a47218c5ce577dd65f61c)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:37:05.847719 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f419aa8-25e1-4a1b-97c8-4295ccd698ca admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:37:05.861885 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1439/2881] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Aug 23 22:37:05 2022] PUT /identity/v3/projects/799f43147c944e4b91b8f4f0ba2cb894/users/4a09fe9266e949b7b4bec49cb87562a4/roles/eabf42a0387a47218c5ce577dd65f61c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:37:05.867148 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40f3a3-f2fc-4a05-8920-c8b6528f813e None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:05.867435 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40f3a3-f2fc-4a05-8920-c8b6528f813e None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:05.867714 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40f3a3-f2fc-4a05-8920-c8b6528f813e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:05.887241 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-eb40f3a3-f2fc-4a05-8920-c8b6528f813e None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:37:05.888563 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-eb40f3a3-f2fc-4a05-8920-c8b6528f813e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:37:05.949530 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1443/2882] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:37:05.959591 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f419aa8-25e1-4a1b-97c8-4295ccd698ca admin admin] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:37:05.961461 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-4f419aa8-25e1-4a1b-97c8-4295ccd698ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:37:06.023438 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f419aa8-25e1-4a1b-97c8-4295ccd698ca admin admin] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:37:06.027237 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ebb70-5a04-4719-9288-9ab0af982b2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:37:06.027860 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ebb70-5a04-4719-9288-9ab0af982b2e service neutron] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:06.028145 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ebb70-5a04-4719-9288-9ab0af982b2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:06.028423 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ebb70-5a04-4719-9288-9ab0af982b2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:06.040143 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ebb70-5a04-4719-9288-9ab0af982b2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:37:06.041658 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ebb70-5a04-4719-9288-9ab0af982b2e service neutron] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:37:06.052085 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1440/2883] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:37:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:37:06.689702 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3fb1d-f76d-48eb-880a-b871e513b370 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:06.690024 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3fb1d-f76d-48eb-880a-b871e513b370 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:06.690380 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3fb1d-f76d-48eb-880a-b871e513b370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:06.731318 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-0af3fb1d-f76d-48eb-880a-b871e513b370 None None] MFA Rules not processed for user `4a09fe9266e949b7b4bec49cb87562a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:37:06.737416 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-0af3fb1d-f76d-48eb-880a-b871e513b370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:37:06.812991 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:37:06.825328 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1444/2884] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:37:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:37:06.830665 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ebb70-5a04-4719-9288-9ab0af982b2e service neutron] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:37:06.832288 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-ea0ebb70-5a04-4719-9288-9ab0af982b2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:37:06.844884 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:37:06.908311 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ebb70-5a04-4719-9288-9ab0af982b2e service neutron] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:37:06.912244 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce92ae0-6d63-4439-bdb7-a98b4ad03180 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:37:06.912893 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce92ae0-6d63-4439-bdb7-a98b4ad03180 service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:06.913179 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce92ae0-6d63-4439-bdb7-a98b4ad03180 service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:06.913493 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce92ae0-6d63-4439-bdb7-a98b4ad03180 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:06.924024 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce92ae0-6d63-4439-bdb7-a98b4ad03180 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:37:06.925505 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce92ae0-6d63-4439-bdb7-a98b4ad03180 service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:37:06.934962 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1441/2885] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:37:06 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:37:08.297600 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fac27a-fd30-4517-a0da-c36bdd6e6974 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:08.298182 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fac27a-fd30-4517-a0da-c36bdd6e6974 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:08.298182 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fac27a-fd30-4517-a0da-c36bdd6e6974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:08.317712 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-74fac27a-fd30-4517-a0da-c36bdd6e6974 None None] MFA Rules not processed for user `4a09fe9266e949b7b4bec49cb87562a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:37:08.318918 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-74fac27a-fd30-4517-a0da-c36bdd6e6974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:37:08.325743 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1445/2886] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:37:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:37:16.930629 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=23 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:37:18.311615 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=4 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:37:31.268176 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae291837-8d13-4c01-8896-411489e7b1f8 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:31.268708 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae291837-8d13-4c01-8896-411489e7b1f8 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:31.268841 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae291837-8d13-4c01-8896-411489e7b1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:31.290277 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-ae291837-8d13-4c01-8896-411489e7b1f8 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:37:31.291477 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-ae291837-8d13-4c01-8896-411489e7b1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:37:31.299400 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1442/2887] 10.222.0.84 () {58 vars in 1016 bytes} [Tue Aug 23 22:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:37:31.322217 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fac27a-fd30-4517-a0da-c36bdd6e6974 None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:37:31.324044 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-74fac27a-fd30-4517-a0da-c36bdd6e6974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:37:31.400177 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fac27a-fd30-4517-a0da-c36bdd6e6974 None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:37:31.405907 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7302c7-3b2c-4da9-98b8-4dc718ce87b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:37:31.406521 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7302c7-3b2c-4da9-98b8-4dc718ce87b6 service nova] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:31.406801 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7302c7-3b2c-4da9-98b8-4dc718ce87b6 service nova] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:31.407072 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7302c7-3b2c-4da9-98b8-4dc718ce87b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:31.417177 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7302c7-3b2c-4da9-98b8-4dc718ce87b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:37:31.418880 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7302c7-3b2c-4da9-98b8-4dc718ce87b6 service nova] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:37:31.428737 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1446/2888] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:37:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:37:34.350455 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a818422-b895-4bc1-aacc-5cb1836130d2 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:34.351000 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a818422-b895-4bc1-aacc-5cb1836130d2 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:34.351000 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a818422-b895-4bc1-aacc-5cb1836130d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:34.494695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-8a818422-b895-4bc1-aacc-5cb1836130d2 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:37:34.495922 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-8a818422-b895-4bc1-aacc-5cb1836130d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:37:34.504638 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1443/2889] 10.222.0.84 () {58 vars in 1016 bytes} [Tue Aug 23 22:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:37:34.527985 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7302c7-3b2c-4da9-98b8-4dc718ce87b6 service nova] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:37:34.529524 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-3f7302c7-3b2c-4da9-98b8-4dc718ce87b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:37:34.545258 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7302c7-3b2c-4da9-98b8-4dc718ce87b6 service nova] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:37:34.551374 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c58708-4a79-4787-a6e5-9fae4e8b071f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:37:34.551976 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c58708-4a79-4787-a6e5-9fae4e8b071f service nova] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:34.552294 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c58708-4a79-4787-a6e5-9fae4e8b071f service nova] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:34.552611 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c58708-4a79-4787-a6e5-9fae4e8b071f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:34.562559 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c58708-4a79-4787-a6e5-9fae4e8b071f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:37:34.564139 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c58708-4a79-4787-a6e5-9fae4e8b071f service nova] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:37:34.575172 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1447/2890] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:37:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:37:37.604909 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b815b9-b132-4c42-9e39-fca9a1831dae None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:37.605533 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b815b9-b132-4c42-9e39-fca9a1831dae None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:37.605533 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b815b9-b132-4c42-9e39-fca9a1831dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:37.624715 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-c0b815b9-b132-4c42-9e39-fca9a1831dae None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:37:37.625882 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-c0b815b9-b132-4c42-9e39-fca9a1831dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:37:37.634678 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1444/2891] 10.222.0.84 () {58 vars in 1016 bytes} [Tue Aug 23 22:37:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:37:37.655323 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c58708-4a79-4787-a6e5-9fae4e8b071f service nova] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:37:37.667290 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c58708-4a79-4787-a6e5-9fae4e8b071f service nova] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:37:37.672754 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5be4c-09cf-48e8-87a5-4473783ecdaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:37:37.673339 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5be4c-09cf-48e8-87a5-4473783ecdaa service nova] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:37.673653 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5be4c-09cf-48e8-87a5-4473783ecdaa service nova] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:37.673926 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5be4c-09cf-48e8-87a5-4473783ecdaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:37.682290 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5be4c-09cf-48e8-87a5-4473783ecdaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:37:37.683843 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5be4c-09cf-48e8-87a5-4473783ecdaa service nova] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:37:37.694565 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1448/2892] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:37:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:37:40.705025 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf7f08-ca61-4ab7-be90-25041188fae4 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:40.705602 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf7f08-ca61-4ab7-be90-25041188fae4 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:40.705602 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf7f08-ca61-4ab7-be90-25041188fae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:40.725328 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-44cf7f08-ca61-4ab7-be90-25041188fae4 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:37:40.726565 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-44cf7f08-ca61-4ab7-be90-25041188fae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:37:40.735241 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1445/2893] 10.222.0.84 () {58 vars in 1016 bytes} [Tue Aug 23 22:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:37:40.758126 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5be4c-09cf-48e8-87a5-4473783ecdaa service nova] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:37:40.770729 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5be4c-09cf-48e8-87a5-4473783ecdaa service nova] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:37:40.776645 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb209b9e-cd4d-40b2-b5a8-f06ed8f493f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:37:40.777260 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb209b9e-cd4d-40b2-b5a8-f06ed8f493f4 service nova] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:40.777572 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb209b9e-cd4d-40b2-b5a8-f06ed8f493f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:40.777849 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb209b9e-cd4d-40b2-b5a8-f06ed8f493f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:40.787183 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb209b9e-cd4d-40b2-b5a8-f06ed8f493f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:37:40.788781 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb209b9e-cd4d-40b2-b5a8-f06ed8f493f4 service nova] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:37:40.799193 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1449/2894] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:37:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:37:49.054165 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc11853-622c-4444-a626-e5aff1704526 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:49.054751 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc11853-622c-4444-a626-e5aff1704526 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:49.054751 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc11853-622c-4444-a626-e5aff1704526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:49.076394 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-0fc11853-622c-4444-a626-e5aff1704526 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:37:49.077729 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-0fc11853-622c-4444-a626-e5aff1704526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:37:49.086688 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1446/2895] 10.222.0.84 () {58 vars in 1016 bytes} [Tue Aug 23 22:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:37:49.113226 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb209b9e-cd4d-40b2-b5a8-f06ed8f493f4 service nova] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:37:49.125952 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb209b9e-cd4d-40b2-b5a8-f06ed8f493f4 service nova] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:37:49.132421 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c6472-2b6d-4b54-81a6-c62ca9aa3d36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:37:49.133040 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c6472-2b6d-4b54-81a6-c62ca9aa3d36 service nova] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:49.133324 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c6472-2b6d-4b54-81a6-c62ca9aa3d36 service nova] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:49.133628 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c6472-2b6d-4b54-81a6-c62ca9aa3d36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:49.143095 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c6472-2b6d-4b54-81a6-c62ca9aa3d36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:37:49.144687 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c6472-2b6d-4b54-81a6-c62ca9aa3d36 service nova] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:37:49.156338 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1450/2896] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:37:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:37:52.246533 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13a52c-b615-4416-9d73-f8812d10d708 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:52.247122 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13a52c-b615-4416-9d73-f8812d10d708 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:52.247122 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13a52c-b615-4416-9d73-f8812d10d708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:52.269286 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-bf13a52c-b615-4416-9d73-f8812d10d708 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:37:52.270757 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-bf13a52c-b615-4416-9d73-f8812d10d708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:37:52.283539 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1447/2897] 10.222.0.84 () {58 vars in 1016 bytes} [Tue Aug 23 22:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:37:52.308291 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c6472-2b6d-4b54-81a6-c62ca9aa3d36 service nova] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:37:52.324631 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c6472-2b6d-4b54-81a6-c62ca9aa3d36 service nova] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:37:52.330268 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc882ca5-bf2d-4e52-8254-6375bbb3eba3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:37:52.330888 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc882ca5-bf2d-4e52-8254-6375bbb3eba3 service nova] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:52.331173 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc882ca5-bf2d-4e52-8254-6375bbb3eba3 service nova] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:52.331448 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc882ca5-bf2d-4e52-8254-6375bbb3eba3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:52.341553 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc882ca5-bf2d-4e52-8254-6375bbb3eba3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:37:52.343166 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc882ca5-bf2d-4e52-8254-6375bbb3eba3 service nova] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:37:52.355082 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1451/2898] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:37:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:37:55.377031 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13a52c-b615-4416-9d73-f8812d10d708 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:37:55.378597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-bf13a52c-b615-4416-9d73-f8812d10d708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:37:55.391845 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13a52c-b615-4416-9d73-f8812d10d708 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:37:55.395597 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb1d78-b837-4087-a787-9f934d6ad91f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f6180d62a2415ca4bb7ad55fe33c5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:37:55.396460 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb1d78-b837-4087-a787-9f934d6ad91f service cinder] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:55.396790 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb1d78-b837-4087-a787-9f934d6ad91f service cinder] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:55.397056 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb1d78-b837-4087-a787-9f934d6ad91f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:55.398950 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-5bbb1d78-b837-4087-a787-9f934d6ad91f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:37:55.415102 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb1d78-b837-4087-a787-9f934d6ad91f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:37:55.416565 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb1d78-b837-4087-a787-9f934d6ad91f service cinder] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:37:55.431263 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1448/2899] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:37:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:37:58.121767 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc882ca5-bf2d-4e52-8254-6375bbb3eba3 service nova] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:37:58.133116 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc882ca5-bf2d-4e52-8254-6375bbb3eba3 service nova] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:37:58.136759 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54b613-9a08-481c-a529-59cdaadf369c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ea6fbc3de84b7db9e62b9ee6055c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:37:58.137377 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54b613-9a08-481c-a529-59cdaadf369c service neutron] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:58.137684 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54b613-9a08-481c-a529-59cdaadf369c service neutron] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:58.137958 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54b613-9a08-481c-a529-59cdaadf369c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:58.139726 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-de54b613-9a08-481c-a529-59cdaadf369c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:37:58.155282 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54b613-9a08-481c-a529-59cdaadf369c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:37:58.156728 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54b613-9a08-481c-a529-59cdaadf369c service neutron] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:37:58.178936 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1452/2900] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:37:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:38:05.423593 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=24 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:38:06.749777 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4cd5f-b8cd-48bb-ba79-bf40e62afc36 None None] REQUEST_METHOD: `POST` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:38:06.750475 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4cd5f-b8cd-48bb-ba79-bf40e62afc36 None None] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:38:06.750475 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4cd5f-b8cd-48bb-ba79-bf40e62afc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:38:06.774048 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.auth.core [None req-a3a4cd5f-b8cd-48bb-ba79-bf40e62afc36 None None] MFA Rules not processed for user `4a09fe9266e949b7b4bec49cb87562a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:38:06.775189 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.fernet_utils [None req-a3a4cd5f-b8cd-48bb-ba79-bf40e62afc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:38:06.782444 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1449/2901] 10.222.0.77 () {58 vars in 958 bytes} [Tue Aug 23 22:38:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:38:08.164789 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=70 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:38:16.770356 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=3 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:38:17.329644 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ff16f-6eb1-46c0-b538-e568d1656fa8 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:38:17.330336 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ff16f-6eb1-46c0-b538-e568d1656fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:38:17.330336 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ff16f-6eb1-46c0-b538-e568d1656fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:38:17.352211 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-6d6ff16f-6eb1-46c0-b538-e568d1656fa8 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:38:17.353492 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-6d6ff16f-6eb1-46c0-b538-e568d1656fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:38:17.361517 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1453/2902] 10.222.0.84 () {58 vars in 1016 bytes} [Tue Aug 23 22:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:38:17.383112 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4cd5f-b8cd-48bb-ba79-bf40e62afc36 None None] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:38:17.396810 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4cd5f-b8cd-48bb-ba79-bf40e62afc36 None None] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:38:17.402392 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b892a-f3bd-4828-9ce8-e12462e4f4f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:38:17.402998 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b892a-f3bd-4828-9ce8-e12462e4f4f5 service nova] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:38:17.403277 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b892a-f3bd-4828-9ce8-e12462e4f4f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:38:17.403548 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b892a-f3bd-4828-9ce8-e12462e4f4f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:38:17.412232 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b892a-f3bd-4828-9ce8-e12462e4f4f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:38:17.414629 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b892a-f3bd-4828-9ce8-e12462e4f4f5 service nova] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:38:17.425236 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1450/2903] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:38:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:38:20.598855 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84081eb-9e98-499c-a079-564b16c9babc None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:38:20.599407 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84081eb-9e98-499c-a079-564b16c9babc None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:38:20.599407 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84081eb-9e98-499c-a079-564b16c9babc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:38:20.621686 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-b84081eb-9e98-499c-a079-564b16c9babc None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:38:20.622906 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-b84081eb-9e98-499c-a079-564b16c9babc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:38:20.631073 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1454/2904] 10.222.0.84 () {58 vars in 1016 bytes} [Tue Aug 23 22:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:38:20.652526 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b892a-f3bd-4828-9ce8-e12462e4f4f5 service nova] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:38:20.664778 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b892a-f3bd-4828-9ce8-e12462e4f4f5 service nova] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:38:20.670458 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84bc27-8f48-4aa2-ac38-095dc5a22196 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:38:20.671052 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84bc27-8f48-4aa2-ac38-095dc5a22196 service nova] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:38:20.671334 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84bc27-8f48-4aa2-ac38-095dc5a22196 service nova] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:38:20.671603 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84bc27-8f48-4aa2-ac38-095dc5a22196 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:38:20.680867 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84bc27-8f48-4aa2-ac38-095dc5a22196 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:38:20.682432 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84bc27-8f48-4aa2-ac38-095dc5a22196 service nova] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:38:20.693389 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1451/2905] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:38:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:38:23.682593 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e82a3-81d0-48f5-aa54-6380ab101e89 None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:38:23.683142 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e82a3-81d0-48f5-aa54-6380ab101e89 None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:38:23.683142 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e82a3-81d0-48f5-aa54-6380ab101e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:38:23.702537 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-217e82a3-81d0-48f5-aa54-6380ab101e89 None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:38:23.703775 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-217e82a3-81d0-48f5-aa54-6380ab101e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:38:23.712101 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1455/2906] 10.222.0.84 () {58 vars in 1016 bytes} [Tue Aug 23 22:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:38:23.732811 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84bc27-8f48-4aa2-ac38-095dc5a22196 service nova] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:38:23.745724 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84bc27-8f48-4aa2-ac38-095dc5a22196 service nova] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:38:23.751528 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136f970-3287-4c64-abf0-250d00b3d651 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:38:23.752128 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136f970-3287-4c64-abf0-250d00b3d651 service nova] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:38:23.752406 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136f970-3287-4c64-abf0-250d00b3d651 service nova] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:38:23.752864 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136f970-3287-4c64-abf0-250d00b3d651 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:38:23.765390 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136f970-3287-4c64-abf0-250d00b3d651 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:38:23.766984 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136f970-3287-4c64-abf0-250d00b3d651 service nova] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:38:23.778887 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1452/2907] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:38:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:38:26.871871 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad5809-441e-4358-8e25-52137ec1a70a None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:38:26.872426 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad5809-441e-4358-8e25-52137ec1a70a None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:38:26.872560 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad5809-441e-4358-8e25-52137ec1a70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:38:26.899425 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-f6ad5809-441e-4358-8e25-52137ec1a70a None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:38:26.900650 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-f6ad5809-441e-4358-8e25-52137ec1a70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:38:26.908932 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1456/2908] 10.222.0.84 () {58 vars in 1016 bytes} [Tue Aug 23 22:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:38:26.933651 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136f970-3287-4c64-abf0-250d00b3d651 service nova] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:38:26.944967 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136f970-3287-4c64-abf0-250d00b3d651 service nova] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:38:26.951802 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd795314-0b60-4db5-86d4-4550004b2dc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:38:26.952396 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd795314-0b60-4db5-86d4-4550004b2dc0 service nova] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:38:26.952674 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd795314-0b60-4db5-86d4-4550004b2dc0 service nova] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:38:26.952946 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd795314-0b60-4db5-86d4-4550004b2dc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:38:26.961744 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd795314-0b60-4db5-86d4-4550004b2dc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:38:26.963298 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd795314-0b60-4db5-86d4-4550004b2dc0 service nova] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:38:26.974783 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1453/2909] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:38:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:38:30.036733 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d38fd0-6ee7-410d-89d6-4bc0631f35cf None None] REQUEST_METHOD: `POST` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:38:30.037301 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d38fd0-6ee7-410d-89d6-4bc0631f35cf None None] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:38:30.037301 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d38fd0-6ee7-410d-89d6-4bc0631f35cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:38:30.058258 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.auth.core [None req-82d38fd0-6ee7-410d-89d6-4bc0631f35cf None None] MFA Rules not processed for user `3713f38f8dcb48a58e22f5fcfa10c524`. Rule list: `[]` (Enabled: `True`). {{(pid=81752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:38:30.059484 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-82d38fd0-6ee7-410d-89d6-4bc0631f35cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:38:30.067487 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1457/2910] 10.222.0.84 () {58 vars in 1016 bytes} [Tue Aug 23 22:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:38:30.093662 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd795314-0b60-4db5-86d4-4550004b2dc0 service nova] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:38:30.106390 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd795314-0b60-4db5-86d4-4550004b2dc0 service nova] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:38:30.112266 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3b164-7803-4cfb-b57c-fa8df16a42a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0af5bf009b48a8915c7320b16d08dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:38:30.112872 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3b164-7803-4cfb-b57c-fa8df16a42a8 service nova] REQUEST_METHOD: `GET` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:38:30.113150 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3b164-7803-4cfb-b57c-fa8df16a42a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:38:30.113462 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3b164-7803-4cfb-b57c-fa8df16a42a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:38:30.122669 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3b164-7803-4cfb-b57c-fa8df16a42a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:38:30.124228 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3b164-7803-4cfb-b57c-fa8df16a42a8 service nova] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:38:30.134574 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1454/2911] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:38:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:38:40.052003 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=15 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:38:40.129616 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=30 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:38:58.084776 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d38fd0-6ee7-410d-89d6-4bc0631f35cf None None] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:38:58.097102 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d38fd0-6ee7-410d-89d6-4bc0631f35cf None None] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:38:58.102209 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026d5bb-1de2-482b-876c-43e8f8ad4c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:38:58.102867 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026d5bb-1de2-482b-876c-43e8f8ad4c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:38:58.103148 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026d5bb-1de2-482b-876c-43e8f8ad4c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:38:58.103425 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026d5bb-1de2-482b-876c-43e8f8ad4c0e admin admin] PATH_INFO: `/v3/users/4a09fe9266e949b7b4bec49cb87562a4` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:38:58.104590 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026d5bb-1de2-482b-876c-43e8f8ad4c0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a09fe9266e949b7b4bec49cb87562a4)` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:38:58.107763 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026d5bb-1de2-482b-876c-43e8f8ad4c0e admin admin] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:38:58.163668 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-3026d5bb-1de2-482b-876c-43e8f8ad4c0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a09fe9266e949b7b4bec49cb87562a4'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:38:58.164334 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-3026d5bb-1de2-482b-876c-43e8f8ad4c0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a09fe9266e949b7b4bec49cb87562a4'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:38:58.173591 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-3026d5bb-1de2-482b-876c-43e8f8ad4c0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a09fe9266e949b7b4bec49cb87562a4'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:38:58.180899 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-3026d5bb-1de2-482b-876c-43e8f8ad4c0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a09fe9266e949b7b4bec49cb87562a4'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:38:58.194792 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.notifications [None req-3026d5bb-1de2-482b-876c-43e8f8ad4c0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a09fe9266e949b7b4bec49cb87562a4'} {{(pid=81752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:38:58.201443 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1458/2912] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Aug 23 22:38:58 2022] DELETE /identity/v3/users/4a09fe9266e949b7b4bec49cb87562a4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:38:58.391847 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3b164-7803-4cfb-b57c-fa8df16a42a8 service nova] Authenticating user token {{(pid=81751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:38:58.414006 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3b164-7803-4cfb-b57c-fa8df16a42a8 service nova] Validating token access rules against request {{(pid=81751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:38:58.475601 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcaefe6-5695-44a8-8ff2-8bc33417da26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3713f38f8dcb48a58e22f5fcfa10c524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dad9b8e962404742bf84b26f82ffb671', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:38:58.476139 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcaefe6-5695-44a8-8ff2-8bc33417da26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:38:58.476419 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcaefe6-5695-44a8-8ff2-8bc33417da26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:38:58.476695 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcaefe6-5695-44a8-8ff2-8bc33417da26 admin admin] PATH_INFO: `/v3/projects/799f43147c944e4b91b8f4f0ba2cb894` {{(pid=81751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:38:58.477855 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcaefe6-5695-44a8-8ff2-8bc33417da26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=799f43147c944e4b91b8f4f0ba2cb894)` {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:38:58.479736 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcaefe6-5695-44a8-8ff2-8bc33417da26 admin admin] RBAC: Authorization granted {{(pid=81751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:38:58.529985 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-bdcaefe6-5695-44a8-8ff2-8bc33417da26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '799f43147c944e4b91b8f4f0ba2cb894', 'request_id': 'req-bdcaefe6-5695-44a8-8ff2-8bc33417da26'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:38:58.538038 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-bdcaefe6-5695-44a8-8ff2-8bc33417da26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '799f43147c944e4b91b8f4f0ba2cb894', 'request_id': 'req-bdcaefe6-5695-44a8-8ff2-8bc33417da26'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:38:58.550254 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-bdcaefe6-5695-44a8-8ff2-8bc33417da26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '799f43147c944e4b91b8f4f0ba2cb894', 'request_id': 'req-bdcaefe6-5695-44a8-8ff2-8bc33417da26'} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:38:58.565317 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-bdcaefe6-5695-44a8-8ff2-8bc33417da26 admin admin] The token cache is being invalidate because project 799f43147c944e4b91b8f4f0ba2cb894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:38:58.565786 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-bdcaefe6-5695-44a8-8ff2-8bc33417da26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:38:58.566614 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG keystone.notifications [None req-bdcaefe6-5695-44a8-8ff2-8bc33417da26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:38:58.568097 dv-cinder-850321-4-smb devstack@keystone.service[81751]: [pid: 81751|app: 0|req: 1455/2913] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Aug 23 22:38:58 2022] DELETE /identity/v3/projects/799f43147c944e4b91b8f4f0ba2cb894 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:39:08.197288 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:39:08.560628 dv-cinder-850321-4-smb devstack@keystone.service[81751]: DEBUG dbcounter [-] [81751] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:33.209329 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026d5bb-1de2-482b-876c-43e8f8ad4c0e admin admin] Authenticating user token {{(pid=81752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:33.210834 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-3026d5bb-1de2-482b-876c-43e8f8ad4c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:33.284537 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026d5bb-1de2-482b-876c-43e8f8ad4c0e admin admin] Validating token access rules against request {{(pid=81752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:33.351681 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3baa44-6d96-404f-b31f-17df0497ac8d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2000b80e34ae45d2a8b658cd394419f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da9a86463d68412884746b115667d2fc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:33.352306 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3baa44-6d96-404f-b31f-17df0497ac8d service placement] REQUEST_METHOD: `GET` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:33.352588 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3baa44-6d96-404f-b31f-17df0497ac8d service placement] SCRIPT_NAME: `/identity` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:33.352860 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3baa44-6d96-404f-b31f-17df0497ac8d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:33.354645 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.fernet_utils [None req-0b3baa44-6d96-404f-b31f-17df0497ac8d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:33.367346 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3baa44-6d96-404f-b31f-17df0497ac8d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:33.368943 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3baa44-6d96-404f-b31f-17df0497ac8d service placement] RBAC: Authorization granted {{(pid=81752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:33.379494 dv-cinder-850321-4-smb devstack@keystone.service[81752]: [pid: 81752|app: 0|req: 1459/2914] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Aug 23 22:41:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:41:43.375249 dv-cinder-850321-4-smb devstack@keystone.service[81752]: DEBUG dbcounter [-] [81752] Writing DB stats keystone:SELECT=58 {{(pid=81752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}